Skip to main content

The Haptic Bracelets: Learning Multi-Limb Rhythm Skills from Haptic Stimuli While Reading

  • Chapter
  • First Online:
Music and Human-Computer Interaction

Part of the book series: Springer Series on Cultural Computing ((SSCC))

Abstract

The Haptic Bracelets are a system designed to help people learn multi-limbed rhythms (which involve multiple simultaneous rhythmic patterns) while they carry out other tasks. The Haptic Bracelets consist of vibrotactiles attached to each wrist and ankle, together with a computer system to control them. In this chapter, we report on an early empirical test of the capabilities of this system, and consider design implications. In the pre-test phase, participants were asked to play a series of multi-limb rhythms on a drum kit, guided by audio recordings. Participants’ performances in this phase provided a base reference for later comparisons. During the following passive learning phase, away from the drum kit, just two rhythms from the set were silently ‘played’ to each subject via vibrotactiles attached to wrists and ankles, while participants carried out a 30-min reading comprehension test. Different pairs of rhythms were chosen for different subjects to control for effects of rhythm complexity. In each case, the two rhythms were looped and alternated every few minutes. In the final phase, subjects were asked to play again at the drum kit the complete set of rhythms from the pre-test, including, of course, the two rhythms to which they had been passively exposed. Pending analysis of quantitative data focusing on accuracy, timing, number of attempts and number of errors, in this chapter we present preliminary findings based on participants’ subjective evaluations. Most participants thought that the technology helped them to understand rhythms and to play rhythms better, and preferred haptic to audio to find out which limb to play when. Most participants indicated that they would prefer using a combination of haptics and audio for learning rhythms to either modality on its own. Replies to open questions were analysed to identify design issues, and implications for design improvements were considered.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    In earlier work, we referred to a prototype of the family of systems we have designed and built, as the “Haptic iPod”. We have now changed the name to the Haptic Bracelets, to avoid any confusion with products of Apple Inc. The Haptic Bracelets have numerous non-musical applications, for example in three-dimensional navigation, fitness, sports and rehabilitation. When it helps to emphasise the specific application to learning multi-limb rhythms, we sometimes use the alternative name “Rhythm Bracelets”. The conception, overall design and theory of the Haptic Bracelets are due to Holland. The implementation and design of the current experiment is due to Bouwer. The design and implementation of the static design featured in this chapter is due to Dalgleish.

References

  • Andresen, M. S., Bach, M., & Kristensen, K. R. (2010). The LapSlapper: Feel the beat. In Proceedings of HAID 2010, international conference on Haptic and Audio Interaction Design (pp. 160–168). Berlin, Heidelberg: Springer.

    Google Scholar 

  • Arom, S. (1991). African polyphony and polyrhythm, musical structure and methodology. England: Cambridge University Press. ISBN 052124160x.

    Book  Google Scholar 

  • Bird, J., Holland, S., Marshall, P., Rogers, Y., & Clark, A. (2008). Feel the force: Using tactile technologies to investigate the extended mind. In Proceedings of DAP 2008, workshop on devices that alter perception, 21 September 2008, Seoul, South Korea, pp 1–4.

    Google Scholar 

  • Brown, M. (2002). Conductive education and the use of rhythmical intention for people with Parkinson’s disease. In I. Kozma & E. Balogh (Eds.), Conductive education occasional papers, no. 8 (pp. 75–80). Budapest: International Peto Institute.

    Google Scholar 

  • Clayton, M., Sager, R., & Will, U. (2004). In time with the music: The concept of entrainment and its significance for ethnomusicology. ESEM CounterPoint, 1, 1–82.

    Google Scholar 

  • Collicutt, M., Casciato, C., & Wanderley, M. M. (2009). From real to virtual: A comparison of input devices for percussion tasks. In B. Dannenberg, & K. D. Ries (Eds.), Proceedings of NIME 2009, 4–6 June 2009, (pp. 1–6). Pittsburgh: Carnegie Mellon University.

    Google Scholar 

  • Feygin, D., Keehner, M., & Tendick, F. (2002). Haptic guidance: Experimental evaluation of a haptic training method for a perceptual motor skill. In Proceedings of Haptics 2002, the 10th International Symposium of Haptic Interfaces for Virtual Environment and Teleoperator Systems, March 24–25, 2002, Orlando, FL (pp. 40–47). New York: IEEE.

    Google Scholar 

  • Grindlay, G. (2008). Haptic guidance benefits musical motor learning. In: Proceedings of symposium on haptic interfaces for virtual environments and teleoperator systems 2008, March, Reno, Nevada, USA, 978-1-4244-2005-6/08, pp. 13–14.

    Google Scholar 

  • Gutcheon, J. (1978). Improvising rock piano. New York: Consolidated Music Publishers. ISBN 0-8256-4071-7.

    Google Scholar 

  • Holland, S., Bouwer, A. J., Dalgleish, M., & Hurtig, T. M. (2010). Feeling the beat where it counts: Fostering multi-limb rhythm skills with the haptic drum kit. In Proceedings of the 4th international conference on Tangible, Embedded, and Embodied Interaction (TEI’10), January 25–27, 2010, Cambridge, MA (pp. 21–28). New York: ACM, ISBN: 978-1-60558-841-4.

    Google Scholar 

  • Huang, K., Do, E. Y., & Starner, T. (2008). PianoTouch: A wearable haptic piano instruction system for passive learning of piano skills. In Proceedings of ISWC 2008, the 12th IEEE International Symposium on Wearable Computers, September 28–October 1, 2008, Pittsburgh, PA (pp. 41–44).

    Google Scholar 

  • Huang, K., Starner, T., Do, E., Weiberg, G., Kohlsdorf, D., Ahlrichs, C., & Leibrandt, R. (2010). Mobile music touch: Mobile tactile stimulation for passive learning. In Proceedings of the 28th international conference on human factors in computing systems (CHI ’10) (pp. 791–800). New York: ACM.

    Google Scholar 

  • Juntunen, M. L. (2004). Embodiment in Dalcroze Eurhythmics. PhD thesis, University of Oulu, Finland.

    Google Scholar 

  • Kressig, R. W., Allali, G., & Beauchet, O. (2005). Long-term practice of Jaques-Dalcroze eurhythmics prevents age-related increase of gait variability under a dual task. Letter to Journal of the American Geriatrics Society, April 2005, 53(4), 728–729.

    Article  Google Scholar 

  • Lerdahl, F., & Jackendoff, R. (1983). A generative theory of tonal music. Cambridge, MA: MIT Press.

    Google Scholar 

  • Lewiston, C. (2008). MaGKeyS: A haptic guidance keyboard system for facilitating sensorimotor training and rehabilitation. PhD thesis, MIT Media Laboratory, Massachusetts.

    Google Scholar 

  • McNulty, J. K. (2009). Polyrhythm hero: A multimodal polyrhythm training game for mobile phones. Unpublished, Retrieved on 6 May 2012, from the word-wide web at http://robotmouth.com/papers_files/Polyrhythm_Hero.pdf

  • Miranda, E. R., & Wanderley, M. (2006). New digital musical instruments: Control and interaction beyond the keyboard. Middleton: A-R Editions.

    Google Scholar 

  • Morris, D., Tan, H., Barbagli, F., Chang, T., & Salisbury, K. (2007). Haptic feedback enhances force skill learning. In: Proceedings of World Haptics 2007, the 2nd Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, March 22–24, 2007 (pp. 21–26). Tsukuba: IEEE Computer Society.

    Google Scholar 

  • Ni, L. G. (2010). The programmable haptic rhythm trainer. In Proceedings of HAVE 2010, IEEE international symposium on Haptic Audio-Visual Environments and Games, 16–17 Oct. 2010, Phoenix, Arizona.

    Google Scholar 

  • O’Modhrain, S. (2000). Playing by feel: Incorporating haptic feedback into computer-based musical instruments. PhD thesis, Stanford University.

    Google Scholar 

  • O’Regan, K., & Noe, A. (2001). A sensorimotor account of vision and visual consciousness. Behavioral and Brain Sciences, 24(5), 883–917.

    Google Scholar 

  • Sinclair, S. (2007). Force-feedback hand controllers for musical interaction. MSc thesis, Music Technology Area, Schulich School of Music, McGill University, Montreal, Canada.

    Google Scholar 

  • Sloboda, J. (1985). The musical mind: The cognitive psychology of music. Oxford: Clarendon.

    Google Scholar 

  • Smith, K. C., Cuddy, L. L., & Upitis, R. (1994). Figural and metric understanding of rhythm. Psychology of Music, 22, 117–135.

    Article  Google Scholar 

  • Spelmezan, D., Jacobs, M., Hilgers, A., & Borchers, J. (2009). Tactile motion instructions for physical activities. CHI, 2009, 2243–2252.

    Google Scholar 

  • Tamaki, E., Miyaki, T., & Rekimoto, J. (2011). PossessedHand: Techniques for controlling human hands using electrical muscles stimuli. In Proceedings of the 2011 annual conference on human factors in computing systems (CHI ’11) (pp. 543–552). New York: ACM.

    Google Scholar 

  • Upitis, R. (1987). Children’s understanding of rhythm: The relationship between development and musical training. Psychomusicology, 7(1), 41–60.

    Article  Google Scholar 

  • van der Linden, J., Johnson, R., Bird, J., Rogers, Y., & Schoonderwaldt, E. (2011). Buzzing to play: Lessons learned from an in the wild study of real-time vibrotactile feedback. In Proceedings of the 29th international conference on human factors in computing systems, Vancouver, BC, Canada.

    Google Scholar 

  • Zimmerman, T. G., Lanier, J., Blanchard, C., Bryson, S., & Harvill, Y. (1987). A hand gesture interface device. In J. M. Carroll, & P. P. Tanner (Eds.), Proceedings of the SIGCHI/GI conference on human factors in computing systems and Graphics Interface (CHI ’87) (pp.189–192). New York: ACM.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Anders Bouwer or Simon Holland .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag London

About this chapter

Cite this chapter

Bouwer, A., Holland, S., Dalgleish, M. (2013). The Haptic Bracelets: Learning Multi-Limb Rhythm Skills from Haptic Stimuli While Reading. In: Holland, S., Wilkie, K., Mulholland, P., Seago, A. (eds) Music and Human-Computer Interaction. Springer Series on Cultural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-2990-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2990-5_6

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2989-9

  • Online ISBN: 978-1-4471-2990-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics