Abstract
There is little dispute that Whole Body Interaction is a good fit of interaction style for some categories of application domain, such as the motion capture of gestures for computer games and virtual physical sports. This reflects the observation that in such applications the mapping between user gesture and the desired effect is, broadly speaking, the identity function. For more abstract application areas such as mathematics, programming and musical harmony, finding appropriate mappings between gesture and effect is less straightforward. The creation of appropriate whole body interaction designs for such abstract application areas remains challenging. However, this is not to argue that whole body interaction is unsuited to abstract domains. Indeed, there is evidence, outlined below, that whole body interaction offers excellent affordances for some highly abstract applications areas.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
 Subitizing is the ability to make judgements, without counting, about numbers of items up to about three or four. It has been empirically demonstrated that this ability is present in babies and some animals. It appears that different brain areas are used for subitizing vs. counting. Subitizing is claimed to be one foundation, via conceptual metaphor and blending, for the concepts of number and arithmetic [22].
- 2.
 A common convention is to capitalize the names of schema and conceptual metaphors.
References
Antle, A.N., Corness, G., Droumeva, M.: Human-computer-intuition? Exploring the cognitive basis for intuition in embodied interaction. Int. J. Arts Technol. 2(3), 235–254 (2009)
Antle, A.N., Droumeva, M., Corness, G.: Playing with the sound maker: do embodied Âmetaphors help children learn? In: Proceedings of the 7th International Conference on Interaction Design and Children, Chicago, pp. 178–185. Association for Computing Machinery, New York (2008)
Bach-y-Rita, P.: Brain Mechanisms in Sensory Substitution. Academic, New York (1972). Studies 64(1), 1–15 (2005)
Balzano, G.J.: The group-theoretic description of 12-fold and microtonal pitch systems. Comput. Music J. 4(4 Winter), 66–84 (1980)
Bird, J., Holland, S., Marshall, P., Rogers, Y., Clark, A.: Feel the force: using tactile technologies to investigate the extended mind. In: Proceedings of Devices That Alter Perception Workshop (DAP 08), Seoul (2008)
Brower, C.: A cognitive theory of musical meaning. J. Music Theory 44(2), 323–379 (2000)
Dourish, P.: Where the Action Is: The Foundations of Embodied Interaction. MIT Press, Cambridge (2001). ISBN 978-0-262-54178-7
Eitan, Z., Timmers, R.: Beethoven’s last piano sonata and those who follow crocodiles: cross-domain mappings of auditory pitch in a musical context. Cognition 114(3), 405–422 (2010)
Fauconnier, G., Turner, M.: The Way We Think: Conceptual Blending and the Mind’s Hidden Complexities. Basic Books, New York (2002)
Gold, B.: Mathematical Association of America Online Book Review. http://www.maa.org/reviews/wheremath.html(2001). Accessed Oct 2010
Held, R., Hein, A.V.: Adaptation of disarranged hand-eye coordination contingent upon re-afferent stimulation. Percept. Mot. Skills 8(1958), 87–90 (1958)
Holland, S.: Learning about harmony with harmony space: an overview. In: Smith, M., Wiggins, G. (eds.) Music Education: An Artificial Intelligence Approach. Springer, London (1994)
Holland, S., Bouwer, A., Dalgleish, M., Hurtig, T.: Feeling the beat where it counts: fostering multi-limb rhythm skills with the haptic drum kit. In: Proceedings of TEI 2010, Boston, Cambridge (2010)
Holland, S., Marshall, P., Bird, J., Dalton, S., Morris, R., Pantidi, N., Rogers, Y., Clark, A.: Running up Blueberry Hill: prototyping whole body interaction in harmony space. In: Proceedings of the Third Conference on Tangible and Embodied Interaction, pp. 92–98. ACM, New York (2009)
Holland, S.: Artificial intelligence, education and music. Ph.D. thesis, Institute of Educational Technology, The Open University (1989)
Hurtienne, J., Blessing, L.: Design for intuitive use – testing image schema theory for user interface design. In: Proceedings of the 16th International Conference on Engineering Design, pp. 1–12. Paris (2007)
Hurtienne, J., Israel, J.H., Weber, K.: Cooking up real world business applications combining physicality, digitality, and image schemas. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, Bonn, pp. 239–246. ACM, New York (2008)
Johnson, M.: The philosophical significance of image schemas. In: Hampe, B., Grady, J. (eds.) From Perception to Meaning: Image Schemas in Cognitive Linguistics, pp. 15–33. Walter de Gruyter, Berlin (2005)
Klemmer, S.R., Hartmann, B., Takayama, L.: How bodies matter: five themes for interaction design. In: Proceedings of the 6th Conference on Designing Interactive Systems (DIS’06), pp. 140–149. University Park, 26–28 June 2006.. ACM, New York (2006)
Lakoff, G.: Moral Politics: How Liberals and Conservatives Think. University of Chicago Press, Chicago (2002)
Lakoff, G., Johnson, M.: Metaphors We Live by. The University of Chicago, London (2003)
Lakoff, G., Núñez, R.: Where Mathematics Comes from: How the Embodied Mind Brings Mathematics into Being. Basic Books, New York (2000)
Larson, S.: Musical forces and melodic patterns. Theory Pract. 22–23, 55–71 (1997–1998)
O’Regan, K., Noe, A.: A sensorimotor account of vision and visual consciousness. Behav. Brain Sci. 24(5), 883–917 (2001)
Rohrer, T.: The body in space: dimensions of embodiment. In: Ziemke, T., Zlatev, J., Frank, R., Dirven, R. (eds.) Body, Language, and Mind: Embodiment, pp. 339–378. Walter de Gruyter, Berlin (2007)
Saslaw, J.: Forces, containers, and paths: the role of body-derived image schemas in the conceptualization of music. J. Music Theory 40(2 Autumn), 217–243 (1996)
Wilkie, K., Holland, S., Mulholland, P.: What can the language of musicians tell us about music interaction design? Comput. Music J. 34(4), 34–48 (2010)
Wilkie, K., Holland, S., Mulholland, P.: Evaluating musical software using conceptual metaphors. In: Proceedings of the 23rd British Computer Society Conference on Human Computer Interaction, Cambridge, pp. 232–237. British Computer Society, Cambridge (2009)
Zbikowski, L.M.: Metaphor and music theory: reflections from cognitive science. Music Theory Online 4, 1–8 (1998)
Zbikowski, L.M.: Conceptual models and cross-domain mapping: new perspective on theories of music and hierarchy. J. Music Theory 41(2 Autumn), 193–225 (1997)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag London Limited
About this chapter
Cite this chapter
Holland, S., Wilkie, K., Bouwer, A., Dalgleish, M., Mulholland, P. (2011). Whole Body Interaction in Abstract Domains. In: England, D. (eds) Whole Body Interaction. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-0-85729-433-3_3
Download citation
DOI: https://doi.org/10.1007/978-0-85729-433-3_3
Published:
Publisher Name: Springer, London
Print ISBN: 978-0-85729-432-6
Online ISBN: 978-0-85729-433-3
eBook Packages: Computer ScienceComputer Science (R0)