Summary
Alternative non-immersive perspectives enable new paradigms of perception, especially in the context of frames-of-reference for musical audition and groupware. MAW, acronymic for multidimensional audio windows, is an application for manipulating sound sources and sinks in virtual rooms, featuring an exocentric graphical interface driving an egocentric audio backend. Listening to sound presented in such a spatial fashion is as different from conventional stereo mixes as sculpture is from painting. Schizophrenic virtual existence suggests sonic (analytic) cubism, presenting multiple acoustic perspectives simultaneously. Clusters can be used to hierarchically organize mixels, [sound] mixing elements. New interaction modalities are enabled by this sort of perceptual aggression and liquid perspective. In particular, virtual concerts may be “broken down” by individuals and groups.
Key words and Phrases
binaural directional mixing console CSCW (computer-supported collaborative work) frames of reference group-ware mixel ([sound] mixing element) points of view sonic (analytical) cubism sound localization spatial sound.Preview
Unable to display preview. Download preview PDF.
References
- 1.Allen Becker. High resolution virtual displays, pages 27-34, 1992.Google Scholar
- 2.Jens Blauert. Spatial Hearing: The Psychophysics of Human Sound Localization. MIT Press, 1983. ISBN 0-262-02190-0.Google Scholar
- 3.Albert S. Bregman. Auditory Scene Analysis: The Perceptual Organization of Sound. MIT Press, 1990. ISBN 0-262-02297-4.Google Scholar
- 4.T. P. Caudell and David W. Mizell. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In HICSS: Proc. H awaii I nt. C onf. on S ystem S ciences. IEEE, January 1992.Google Scholar
- 5.Michael Cohen. Integrating graphical and audio windows. Presence: Teleoperators and Virtual Environments, 1(4): 468–481, Fall 1993.Google Scholar
- 6.Michael Cohen. Throwing, pitching, and catching sound: Audio windowing models and modes. IJMMS: the Journal of Person-Computer Interaction, 39(2): 269–304, August 1993. ISSN 0020-7373.Google Scholar
- 7.Michael Cohen. Cybertokyo: a survey of public VRtractions. Presence: Teleoperators and Virtual Environments (Special Issue on Pacific Rim Research), 3(1): 87–93, Winter 1994.Google Scholar
- 8.Michael Cohen. Besides immersion: Overlaid points of view and frames of reference; using audio windows to analyze audio scenes. In Susumu Tachi, editor, Proc. ICAT/VRST: I nt. C onf. A rtificial Reality and T ele-Existence/Conf. on V irtual R eality S oftware and T echnology, pages 29-38, Makuhari, Chiba; Japan, November 1995. ACM-SIGCHI(TBD), SICE (Society of Instrument and Control Engineers), JTTAS Japan Technology Transfer Association), and NIKKEI (Nihon Keizai Shimbun, Inc.).Google Scholar
- 9.Michael Cohen, Shigeaki Aoki, and Nobuo Koizumi. Augmented audio reality: Telepresence/vr hybrid acoustic environments. In Ro-Man: Proc. 2nd IEEE International Workshop on Ro bot and Human Communication, pages 361-364, Tokyo, November 1993. ISBN 0-7803-1407-7.Google Scholar
- 10.Michael Cohen and Nobuo Koizumi. Audio window. In Den Gaku. Tokyo Contemporary Music Festival: Music for Computer, December 1991.Google Scholar
- 11.Michael Cohen and Nobuo Koizumi. Iconic control for audio windows. In Proc. Eighth Symp. on Human Interface, pages 333-340, Kawasaki, Japan, October 1992. 1411.Google Scholar
- 12.Michael Cohen and Nobuo Koizumi. Audio windows for virtual concerts. In JMACS: Proc. J apan M usic A nd C omputer S cience S ociety Meeting, pages 27-32, Tokyo, February 1993. No. 47.Google Scholar
- 13.Michael Cohen and Nobuo Koizumi. Putting spatial sound into voicemail. In NR94: Proc. 1st International Workshop on N etworked R eality in Tele Communication, Tokyo, May 1994. IEEE COMSOC, IEICE.Google Scholar
- 14.Michael Cohen and Nobuo Koizumi. Audio Windows for Virtual Concerts II: Sonic Cubism. In Susumu Tachi, editor, Video Proc. ICAT/VRST: I nt. C onf. A rtificial Reality and T ele-Existence/Conf. on V irtual R eality S oftware and T echnology, page 254, Makuhari, Chiba; Japan, November 1995. ACM-SIGCHI (TBD), SICE (Society of Instrument and Control Engineers), JTTAS (Japan Technology Transfer Association), and NIKKEI (Nihon Keizai Shimbun, Inc.).Google Scholar
- 15.Michael Cohen and Lester F. Ludwig. Multidimensional audio window management. IJMMS: the Journal of Person-Computer Interaction, 34(3): 319–336, March 1991. Special Issue on Computer Supported Cooperative Work and Groupware. ISSN 0020-7373.Google Scholar
- 16.Richard Dennison, Michio Ogata, and Mike Pawka. Rasta/patios dictionary, http://www.Willamette.edu/~t jones/languages/rasta-lang. html.Google Scholar
- 17.George W. Fumas. Generalized fisheye views. In CHI: Proc. ACM Conf on C omputer-H uman I nteraction, pages 16-23, Boston, April 1986.Google Scholar
- 18.Richard M. Held and Nathaniel I. Durlach. Telepresence. Presence: Teleoperators and Virtual Environments, 1(1): 109–112, 1993.Google Scholar
- 19.Jens Herder and Michael Cohen. Project report: Design of a helical keyboard. In ICAD: Proc. I nt. C onf A uditory D isplay, Palo Alto, CA, November 1996.Google Scholar
- 20.Lawrence J. Hettinger and Robert B. Welch. Presence: Teleoperators and Virtual Environments, Summer 1992. 1(3).Google Scholar
- 21.Michitaka Hirose and Kensuke Yokoyama. VR Application for Transmission of Synthetic Sensation. In Susumu Tachi, editor, ICAT: Proc. Int. C onf A rtificial Reality and T ele-Existence, pages 145-154, Tokyo, July 1992.Google Scholar
- 22.Hiroshi Ishii. Translucent multiuser interface for realtime collaboration. IEICE Trans, on Fundamentals of Electronics, Communications and Computer Sciences (Special Section on Fundamentals of Next Generation Human Interface), E75-A(2): 122–131, February 1992. 0916-8508.Google Scholar
- 23.Hiroshi Ishii, Minoru Kobayashi, and Jonathan Grudin. Integration of interpersonal space and shared workspace: Clearboard design and experiments. TOIS: ACM Trans, on I nformation S ystems (Special Issue on CSCW ′92), 11(4): 349–375, July 1993.CrossRefGoogle Scholar
- 24.David Jaffe and Lee Boynton. An Overview of the Sound and Music Kits for the NeXT Computer. Computer Music Journal, 13(2): 48–55, Summer 1989.CrossRefGoogle Scholar
- 25.Myron W. Krueger. Artificial Reality II. Addison-Wesley, Reading, MA, 1991. 0-201-52260-8.Google Scholar
- 26.Michael Naimark. Elements of realspace imaging: A proposed taxonomy. In Proc. SPIE/SPSE Electronic Imaging Conf., San Jose, CA, 1991. Vol. 1457.Google Scholar
- 27.Eimei Oyama, Naoki Tsunemoto, and Susumu Tachi. Remote manipulation using virtual environment. In ISMCR: Proc. I nt. S ymp. on M easurement and C ontrol in R obotics, pages 311-318, Tsukuba Science City, Japan, November 1992. Society of Instrument and Control Engineers.Google Scholar
- 28.Randy Pausch, Tommy Burnette, Dan Brockway, and Michael E. Weiblen. Locomotion in virtual worlds via flight into hand-held miniatures. In SIGGRAPH Proc., LA, CA, July 1995.Google Scholar
- 29.Ramana Rao, Jan O. Pedersen, Marti A. Hearst, Jock D. Mackinlay, Stuart K. Card, Larry Masinter, Per-Kristian Halvorsen, and George G. Robertson. Rich interaction in the digital library. Communications of the ACM, 38(4):29, April 1995.CrossRefGoogle Scholar
- 30.Warren Robinett. Synthetic experience: A proposed taxonomy. Presence: Teleoperators and Virtual Environments, 1(2): 229–247, 1992.Google Scholar
- 31.Manojit Sarkar and Marc H. Brown. Graphical fisheye views. Communications of the ACM, 37(12): 73–84, December 1994.CrossRefGoogle Scholar
- 32.Doug Schaffer, Zhengping Zuo, Saul Greenberg, John Dill, Shelli Dubs, Mark Roseman, and Lyn Bartram. Navigating hierarchically clustered networks through fisheye and full-zoom methods. TOIS: ACM T rans, on I nformation S ystems, January 1996.Google Scholar
- 33.Roger N. Shepard. The Psychology of Music, chapter Structural Representations of Musical Pitch, pages 343-390. Academic Press, December 1982.Google Scholar
- 34.Roger N. Shepard. Demonstrations of circular components of pitch. 31(9): 641–649, September 1983.Google Scholar
- 35.Thomas B. Sheridan. Progress and challenge in human telerobot control. In ISMCR: Proc. I nt. S ymp. on M easurement and C ontrol in R obotics, pages 19-29, Tsukuba Science City, Japan, November 1992. Society of Instrument and Control Engineers.Google Scholar
- 36.Thomas B. Sheridan. Musings on telepresence and virtual presence. Presence: Teleoperators and Virtual Environments, 1(1): 120–125, 1993.Google Scholar
- 37.Julie Stanfel. Mandala: Virtual cities. In SIGGRAPH Computer Graphics Visual Proc., page 208, Anaheim, CA, August 1993.Google Scholar
- 38.Gavin R. Starks and Ken N. Linton. A 3-D Stereo Processing Tool. In AES: Proc. A udio E ngineering S ociety Conv., Amsterdam, February 1994. 3830 (P9.1).Google Scholar
- 39.Gen Suzuki and Takashi Kouno. Virtual collaborative workspace. In ICAT: Proc. Int. C onf. A rtificial Reality and T ele-Existence, pages 119-125, 1992.Google Scholar
- 40.Susumu Tachi, Hirohiko Arai, Taro Maeda, Eimei Oyama, Naoki Tsunemoto, and Yasuyuki Inoue. Tele-existence in real world and virtual world. In ICAR: Proc. Fifth Int. Conf. on Advanced Robotics, pages 193-198, Pisa, Italy, June 1991.Google Scholar
- 41.Pierre Wellner, Wendy Mackay, and Rich Gold. Communications of the ACM, July 1993.Google Scholar
- 42.Elizabeth M. Wenzel. Localization in virtual acoustic displays. Presence: Teleoperators and Virtual Environments, 1(1): 80–107, 1992.MathSciNetGoogle Scholar
- 43.Susan Wyshynski and Vincent John Vincent. Full-body unencumbered immersion in virtual worlds. In Alan Wexelblat, editor, Virtual Reality: Applications and Explorations, chapter 6, pages 123-144. Academic Press, 1993. ISBN 0-12-745046-7.Google Scholar
- 44.Yamaha Corp. VP1 Virtual Acoustic Synthesizer, 1994.Google Scholar
- 45.Michael J. Zyda, David R. Pratt, John S. Falby, Chuck Lombardo, and Kristen M. Kelleher. The software required for the computer generation of virtual environments. Presence: Teleoperators and Virtual Environments, 2(2): 130–140, 1994.Google Scholar