Abstract
The current generation of mobile devices is capable of producing polyphonic sounds, has enough processing power for real-time signal processing, and much better sound quality than their predecessors. The importance of audio is increasing as we are moving towards multimodal user interfaces where audio is one of the major components. In this paper, we present new ways of using audio feedback more efficiently and intelligently in mobile user interfaces by utilizing real-time signal processing. To test the ideas in practice, a prototype calendar application was implemented. We arranged a one week field trial to validate the design ideas. The results indicate that sound effects are capable of passing information to the user in some extent, but they are more useful in impressing the user and making existing audio feedback sound better.
Chapter PDF
Similar content being viewed by others
Keywords
References
Kramer, G., et al.: Sonification Report: Status of the Field and Research Agenda (1997), http://www.icad.org/websiteV2.0/References/nsf.html
Hermann, T., Dres, J., Ritter, H.: Broadcasting Auditory Weather Reports – A Pilot Project. In: ICAD. Proceedings of International Conference on Auditory Display (2003)
Gaver, W.: Auditory Interfaces. In: Helander, M., Landauer, T., Prabhu, P. (eds.) Handbook of Interaction, Elsevier, Amsterdam (1997)
Brewster, S., Wright, P., Edwards, A.: An Evaluation of Earcons for Use in Auditory Human-Computer Interfaces. In: Proceedings of INTERCHI Conference (1993)
Brewster, S., Räty, V-P., Kortekangas, A.: Earcons as a Method of Providing Navigational Cues in a Menu Hierarchy. In: Proceedings of HCI Conference (1996)
Leplatre, G., Brewster, S.: Designing Non-Speech Sounds to Support Navigation in Mobile Phone Menus. In: ICAD. Proceedings of International Conference on Auditory Display (2000)
Helle, S., Leplatre, G., Marila, J., Laine, P.: Menu Sonification in a Mobile Phone – A Prototype Study. In: ICAD. Proceedings of International Conference on Auditory Display (2001)
Lehman, S.: Reverberation (accessed April 11th, 2007) (1996), Avalable online at: http://www.harmony-central.com/Effects/Articles/Reverb/
Parthy, A., Jin, C., van Schaik, A.: Reverberation for Ambient Data Communication. In: ICAD. Proceedings of International Conference on Auditory Display (2004)
Gaver, W., Smith, R., O’Shea, T.: Effective Sounds in Complex Systems: The Arkola Simulation. In: Proceedings of ACM Conference, ACM Press, New York (1991)
Larsson, P., Västfjäll, D., Kleiner, M.: Do We Really Live in a Silent World? The (Mis)use of Audio in Virtual Environments. In: Proceedings of AVR II and CONVR Conference, pp. 182–188 (2001)
Bly, S.: Presenting Information in Sound. In: Proceedings of Human Factors in Computer Systems, pp. 371–375 (1982)
Mezrich, J.J, Frysinger, S., Slivjanovski, R.: Dynamic Representation of Multivariate Time Series Data. Journal of the American Statistical Association 79(385), 34–40 (1984)
Brown, M., Newsome, S., Glinert, E.: An Experiment into the Use of Auditory Cues to Reduce Visual Workload. In: Proceedings of Computer-Human Interaction Conference, pp. 339–346 (1989)
Janata, P., Childs, E.: Marketbuzz: Sonification of Real-Time Financial Data. In: ICAD. Proceedings of International Conference on Auditory Display (2004)
Dombois, F.: Auditory Seismology: On Free Oscillations, Focal Mechanisms, Explosions, and Synthetic Seismograms. In: ICAD. Proceedings of International Conference on Auditory Display (2002)
Holm, J.: Pitch-Shifting Methods for Wavetable Synthesis. M.Sc. Thesis, Tampere University of Technology (2000)
Laroche, J.: Time and Pitch Scale Modification of Audio Signals. In: Kahrs, M., Brandenburg, K. (eds.) Applications of Digital Signal Processing to Audio and Acoustics, Kluwer Academic Publishers, Boston, MA (1998)
Davies, T.C., Burn, C.M.: Do You Hear What I Hear? Reflecting on Auditory Display in Medicine (accessed April 11th, 2007), Available online at: http://hcro.enigma.co.nz/website/index.cfm?fuseaction=articledisplay&FeatureID=040906
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 IFIP International Federation for Information Processing
About this paper
Cite this paper
Korhonen, H., Holm, J., Heikkinen, M. (2007). Utilizing Sound Effects in Mobile User Interface Design. In: Baranauskas, C., Palanque, P., Abascal, J., Barbosa, S.D.J. (eds) Human-Computer Interaction – INTERACT 2007. INTERACT 2007. Lecture Notes in Computer Science, vol 4662. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74796-3_27
Download citation
DOI: https://doi.org/10.1007/978-3-540-74796-3_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74794-9
Online ISBN: 978-3-540-74796-3
eBook Packages: Computer ScienceComputer Science (R0)