A System for Manipulating Audio Interfaces Using Timbre Spaces

  • Craig Nicol
  • Stephen Brewster
  • Philip Gray

Abstract

The creation of audio interfaces is currently hampered by the difficulty of designing sounds for them. This paper presents a novel system for generating and manipulating non-speech sounds. The system is designed to generate Auditory Icons and Earcons through a common interface. It has been developed to make the design of audio interfaces easier. Using a Timbre Space representation of the sound, it generates output via an FM synthesiser. The Timbre Space has been compiled in both Fourier and Constant Q Transform versions using Principal Components Analysis (PCA). The design of the system and initial evaluations of these two versions are discussed, showing that the Fourier analysis appears to be better, contrary to initial expectations.

Keywords

Auditory Icons Earcons Multimedia interfaces Timbre Spaces User interface design and specification methods and languages 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    Blattner, M.M., Sumikawa, D.A., and Greenberg, R.M., Earcons and Icons: Their Structure and Common Design Principles, Human Computer Interaction, Vol. 4, No. 1, 1989, pp. 11–44.Google Scholar
  2. [2]
    Brewster, S., Wright, P., and Edwards, A., A Detailed Investigation into the Effectiveness of Earcons, in G. Kramer (ed.), Proceedings of the lst International Conference on Auditory Display ICAD’92 (Santa Fe, 28–30 October 1992), “Auditory Display, Sonification, Audification and Auditory Interfaces”, Addison-Wesley, New York, 1992, pp. 471–498.Google Scholar
  3. [3]
    Brewster, S., Wright, P., and Edwards, A., An evaluation of Earcons for Use in Auditory Human-Computer Interfaces, in Proc. of the ACM Conf. on Human Factors in Computing Systems INTERCHI’93 (Amsterdam, 24–29 April 1993), ACM Press, New York, 1993,pp. 222–227.Google Scholar
  4. [4]
    Chowning, J., The Synthesis of Complex Audio Spectra by Means of Frequency Modulation, Journal of the Audio Engineering Society (JAES), Vol. 21, No. 7, 1973, pp. 526–534.Google Scholar
  5. [5]
    Conversy, S., Ad-Hoc Synthesis of Auditory Icons, in S.A. Brewster, A.D.N. Edwards (eds.), Proceedings of 5th International Conference on Auditory Display ICAD’98 (Glasgow, 1–4 November 1998), British Computer Society Press, eWiC series, 1998, accessible at http://www.icad.org/websiteV2.0/Conferences/ICAD98/papers/CONVERSY.PDFGoogle Scholar
  6. [6]
    Gaver, W.W., How do we Hear in the World? Explorations in Ecological Acoustics. Ecological Psychology, Vol. 5, No. 4, 1993, pp. 285–313.CrossRefMathSciNetGoogle Scholar
  7. [7]
    Gaver, W.W., Synthesizing Auditory Icons, in Proc. of the ACM Conf. on Human Factors in Computing Systems INTERCHI’93 (Amsterdam, 24–29 April 1993), ACM Press, New York, 1993, pp. 222–235.Google Scholar
  8. [8]
    Grey, J., Timbre Discrimination in Musical Patterns, Journal of the Acoustical Society of America, Vol. 64, 1977, pp. 467–472.Google Scholar
  9. [9]
    Hourdin, C., Charbonneau, G., and Moussa, T., A Multidimensional Scaling Analysis of musical Instruments’ Time-Varying Spectra, Computer Music Journal, Vol. 21, No. 2, 1997, pp. 40–55.Google Scholar
  10. [10]
    Hourdin, C., Charbonneau, G., and Moussa, T., A Sound-Synthesis Technique Based On Multidimensional Scaling of Spectra, Computer Music Journal, Vol. 21, No. 2, 1997, pp. 56–68.Google Scholar
  11. [11]
    Kaminskyj, I., Multidimensional Scaling Analysis of Musical Instrument Sounds’ Spectra, in Proceedings of the Australasian Computer Music Conference ACMC’99 (Wellington, 1999), pp. 36–39.Google Scholar
  12. [12]
    Masri, P., Bateman, A., and Canagarajah, C.N., A Review of Time Frequency Representations, With Application to Sound/Music Analysis-Resynthesis, Organised Sound, Vol. 2, No. 3, 1997, pp. 193–205.Google Scholar
  13. [13]
    Mynatt, E.D., Designing with Auditory Icons: How Well do we Identify Auditory Cues?, in Proceedings of ACM Conference on Human Factors in Computing Systems CHI’94 (Boston, 24–28 April 1994), ACM Press, New York, 1994, pp. 269–270.Google Scholar
  14. [14]
    Mynatt, E.D., Back, M., Want, R., Baer, M., and Ellis, J.B., Designing Audio Aura, in Proceedings of ACM Conference on Human Factors in Computing Systems CHI’98 (Los Angeles, 18–23 April 1994), ACM Press, New York, 1994, pp. 566–573.Google Scholar
  15. [15]
    Roads, C., The Computer Music Tutorial, Massachusetts Institute of Technology, Cambridge, 1996.Google Scholar
  16. [16]
    von Helmholtz, H.L.F., On the Sensations of Tone as a Physiological Basis for the Theory of Music, Dover, 1954.Google Scholar

Copyright information

© Kluwer Academic Publishers 2005

Authors and Affiliations

  • Craig Nicol
    • 1
  • Stephen Brewster
    • 1
  • Philip Gray
    • 1
  1. 1.Computing Science DepartmentUniversity of GlasgowGlasgowScotland

Personalised recommendations