We propose a novel paradigm of consuming rich web content in a mobile setting (which are often eyes-free), through a predominantly 3D audio interface. Web content, formatted in audio, is streamed via the mobile device’s network connection, and placed virtually in a 3D audio space. The user moves in the virtual space, using a variety of human computer interaction (HCI) means, such as voice input, touching, rotating, and shaking the device, as well as hand and head gesturing. We provide applications benefitting from this paradigm of rich mobile 3D audio web consumption. We provide system designs, and a system architecture for mobile 3D audio. Finally, we implement our ideas in a system prototype using the Apple iOS mobile platform.


3D audio mobile HCI mobile web 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
    Parker-Pope, T.: What Clown on a Unicycle? Studying Cellphone Distraction, New York Times (October 2009),
  3. 3.
    Richtel, M.: Forget Gum. Walking and Using Phone Is Risky, New York Times (January 2010),
  4. 4.
  5. 5.
    Evolution to LTE report. Global Mobile Suppliers Association (April 2010),
  6. 6.
    Cherry, E.C.: Some Experiments on the Recognition of Speech, with One and with Two Ears. Journal of the Acoustical Society of America 25(5), 975–979 (1953)CrossRefGoogle Scholar
  7. 7.
    Bronkhorst, A.W.: The Cocktail Party Phenomenon: A Review of Research on Speech Intelligibility in Multiple-Talker Conditions. Acta Acustica united with Acustica 86, 117–128 (2000)Google Scholar
  8. 8.
    Shinn-Cunningham, B.G., Ihlefeld, A.: Selective and Divided Attention: Extracting Information from Simultaneous Sound Sources. In: International Conference on Auditory Display (ICAD), Sydney, Australia (July 2004)Google Scholar
  9. 9.
    Best, V., Gallun, F.J., Ihlefeld, A., Shinn-Cunningham, B.G.: The Influence of Spatial Separation on Divided Listening. Journal of the Acoustical Society of America 120(3), 1506–1516 (2006)CrossRefGoogle Scholar
  10. 10.
    Ihlefeld, A., Shinn-Cunningham, B.G.: Spatial Release from Energetic and Informational Masking in a Divided Speech Identification Task. Journal of the Acoustical Society of America 123(6), 4380–4392 (2008)CrossRefGoogle Scholar
  11. 11.
    Lumsden, J., Brewster, S.: A Paradigm Shift: Alternative Interaction Techniques for Use with Mobile and Wearable Devices. In: Conference of the Centre for Advanced Studies on Collaborative Research (CASCON), Toronto, Canada, pp. 197–210 (October 2003)Google Scholar
  12. 12.
    Marentakis, G., Brewster, S.: A Study on Gestural Interaction with a 3D Audio Display. In: Brewster, S., Dunlop, M.D. (eds.) Mobile HCI 2004. LNCS, vol. 3160, pp. 180–191. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  13. 13.
    Brewster, S., Murray-Smith, R., Crossan, A., Vasquez-Alvarez, Y., Rico, J.: The GAIME project: Gestural and Auditory Interactions for Mobile Environments. In: Whole Body Interaction Workshop, ACM Conference on Human Factors in Computing Systems (CHI), Boston, MA (April 2009)Google Scholar
  14. 14.
  15. 15.
    Vasquez-Alvarez, Y., Brewster, S.: Audio Minimization: Applying 3D Audio Techniques to Multi-Stream Audio Interfaces. In: Poster Session International Workshop on Haptic and Audio Design (HAID), Dresden, Germany (September 2009)Google Scholar
  16. 16.
    Parente, P.: Audio Enriched Links: Web Page Previews for Blind Users. In: International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS), Atlanta, GA, pp. 2–8 (October 2004)Google Scholar
  17. 17.
    Yu, W., Kuber, R., Murphy, E., Strain, P., McAllister, G.: A Novel Multimodal Interface for Improving Visually Impaired People’s Web Accessibility. Virtual Reality 9(2), 133–148 (2006)CrossRefGoogle Scholar
  18. 18.
    Bigham, J., Prince, C., Ladner, R.: WebAnywhere: A Screen Reader On-the-Go. In: ACM International Cross-disciplinary Conference on Web Accessibility (W4A), Beijing, China, pp. 73–82 (April 2008)Google Scholar
  19. 19.
    Moray, N.: Attention in Dichotic Listening: Affective Cues and the Influence of Instructions. The Quarterly Journal of Experimental Psychology 11, 56–60 (1959)CrossRefGoogle Scholar
  20. 20.
    Wu, V.K.Y.: 3D Audio RSS/Music Player. Apple App. Store,
  21. 21.

Copyright information

© ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering 2012

Authors and Affiliations

  • Victor K. Y. Wu
    • 1
  • Roy H. Campbell
    • 2
  1. 1.Department of Electrical EngineeringUniversity of Illinois at Urbana-ChampaignUSA
  2. 2.Department of Computer ScienceUniversity of Illinois at Urbana-ChampaignUSA

Personalised recommendations