Perception of Audio-Generated and Custom Motion Programs in Multimedia Display of Action-Oriented DVD Films

  • Kent Walker
  • William L. Martens
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4129)


This paper addresses a practical problem associated with multimedia display systems which utilize motion-platforms or chairs. Given audio-visual content for which motion data is not available, motion may be automatically generated from multichannel audio, usually from a Low-Frequency Effects channel (LFE) such as that distributed on Digital Versatile Discs (DVDs). Alternatively, custom motion programs may be created to accompany multimedia content. This paper presents the results of a study designed to test the sense of realism, sense of presence, and global preference for multimedia playback in these two distinct cases of platform accompaniment: motion which has been generated automatically from audio, and motion which has been designed expressly for the purpose of stimulating appropriate haptic and vestibular sensations.


Motion Platform Global Preference Motion Program Audiovisual Content Digital Versatile Disc 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Begault, D.: Haptic Perception and the Development of New Tools for Digital Studio Technology. Lecture given to McGill University (unpublished, 2006)Google Scholar
  2. 2.
    Bouguila, L., Ishii, M., Sato, M.: What Impact Does the Haptic-Stereo Intergration Have on Perception in Stereographic Virtual Environment? In: Murray-Smith, R. (ed.) Haptic HCI 2000. LNCS, vol. 2058, pp. 135–150. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  3. 3.
    Daub, M., Altinsoy, M.E.: Audiotactile simultaneity perception of musical-produced whole-body vibrations. In: Proceedings of the Joint Congress CFA/DAGA (2004)Google Scholar
  4. 4.
    Griffin, M.J.: Handbook of Human Vibration. Elsevier/Academic Press (1990)Google Scholar
  5. 5.
    Holman, T.: 5.1 Surround Sound Up and Running. Focal Press (1999)Google Scholar
  6. 6.
    International Telecommunications Union. Recommendation BS.775-1, Multichannel stereophonic sound systems with and without accompanying picture (1994)Google Scholar
  7. 7.
    Martens, W.L., Woszczyk, W.: Guidelines for Enhancing the Sense of Presence in Virtual Acoustic Environments. In: Thwaites, H. (ed.) Proceedings of the 9th International Conference on Virtual Systems and Multimedia, pp. 306–313 (2003)Google Scholar
  8. 8.
    McGee, M.R., Gray, P., Brewster, S.: The Effective Combination of Haptic and Auditory Textural Information. In: Murray-Smith, R. (ed.) Haptic HCI 2000. LNCS, vol. 2058, pp. 118–126. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  9. 9.
    Paillard, B., Roy, P., Vittecoq, P., Panneton, R.: Odyssée: A new kinetic actuator for use in the home entertainment environment. In: Proceedings of DSPFest 2000, Texas Instruments, Houston, Texas (2000)Google Scholar
  10. 10.
    Rumsey, F.: Spatial Audio. Focal Press (2001)Google Scholar
  11. 11.
    Ryan, T., Martens, W.L., Woszczyk, W.: The effects of acoustical treatment on lateralization of low-frequency sources. In: Proc. of 149th Meeting of the Acoustical Society of America, vol. 117, p. 2392 (2005)Google Scholar
  12. 12.
    Taylor, J., Johnson, M.R., Crawford, C.G.: DVD Demystified. McGraw-Hill, New York (2006)Google Scholar
  13. 13.
    Terashima, N.: Intelligent Communication Systems. Academic Press, London (2002)Google Scholar
  14. 14.
    Todd, C., et al.: Flexible perceptual coding for audio transmission and storage. In: Proceedings of the 96th Convention of the Audio Engineering Society (1994)Google Scholar
  15. 15.
    Walker, K., Martens, W.L.: Haptic-Auditory Distance Cues in Virtual Environments: Exploring Adjustable Parameters for Enhancing Experience. In: Proceedings of the IEEE International Workshop on Haptic Audio Visual Environments and their applications HAVE 2005, Ottawa, Canada, pp. 101–103 (2005)Google Scholar
  16. 16.
    Walker, K., Martens, W.L., Kim, S.: Perception of Simultaneity and Detection of Asynchrony Between Audio and Structural Vibration in Multimodal Music Reproduction. In: Proceedings of the 120th Convention of the Audio Engineering Society, Paris, France (2006)Google Scholar
  17. 17.
    Woszczyk, W., Cooperstock, J., Roston, J., Martens, W.: Shake, Rattle, and Roll: Getting Immersed in Multisensory, Interactive Music via Broadband Networks. Journal of the Audio Engineering Society 53(4), 336–344 (2005)Google Scholar
  18. 18.
    Wu, W.: Development of Cueing Algorithm for the Control of Simulator Motion systems. MS Thesis, State University of New York at Binghamton (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Kent Walker
    • 1
  • William L. Martens
    • 1
  1. 1.Sound Recording Area, Department of Theory, Schulich School of MusicMcGill UniversityMontréalCanada

Personalised recommendations