Skip to main content

Conductor Tutoring Using the Microsoft Kinect

  • Conference paper
  • First Online:
Advances in Visual Computing (ISVC 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9475))

Included in the following conference series:

Abstract

In this paper we present a system that uses the Microsoft Kinect to provide beginner conducting students real time feedback about their performance. Using upper body joint coordinates we detect common mistakes such as swaying, rocking, excessive hinge movement, and mirroring. We compute instant velocities to determine tempo and classify articulation as legato or staccato. Our experiments show that the system performs perfectly when detecting erroneous movements, correctly classifies articulation type most of the time, and can correctly determine tempo by counting the number of beats per minute. The system was well received by conducting students and their instructor, as it allows them to practice by themselves, without an orchestra.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Behringer, R.: Conducting digitally stored music by computer vision tracking. In: First International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution (AXMEDIS05), Florence, Italy (2005)

    Google Scholar 

  2. Wilson, A., Bobick, A.: Realtime online adaptive gesture recognition. In: International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, Corfu, Greece

    Google Scholar 

  3. Murphy, D., Andersen, T.H., Jensen, K.: Conducting audio files via computer vision. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 529–540. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  4. Marrin, T., Paradiso, J.: The digital baton: a versatile performance instrument. In: International Computer Music Conference, Thessaloniki, Greece, pp. 313–316 (1997)

    Google Scholar 

  5. Nakra, T.M., Ivanov, Y., Smaragdis, P., Ault, C.: The ubs virtual maestro: an interactive conducting system. In: New Interfaces for Musical Expression (NIME), Pittsburgh, PA (2009)

    Google Scholar 

  6. Salgian, A., Pfirrmann, M., Nakra, T.M.: Follow the beat? Understanding conducting gestures from video. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Paragios, N., Tanveer, S.-M., Ju, T., Liu, Z., Coquillart, S., Cruz-Neira, C., Müller, T., Malzbender, T. (eds.) ISVC 2007, Part I. LNCS, vol. 4841, pp. 414–423. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  7. Peng, L., Gerhard, D.: A wii-based gestural interface for computer-based conducting systems. In: New Interfaces for Musical Expression (NIME), Pittsburgh, PA (2009)

    Google Scholar 

  8. Ivanova, E., Wang, L., Fu, Y., Gadzala, J.: Maestro: a practice system to track, record, and observe for novice orchestral conductors. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems

    Google Scholar 

  9. Library, M.: Kinect for windows sdk. https://msdn.microsoft.com/en-us/library/hh855347.aspx. Accessed 20 August 2015

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andrea Salgian .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Salgian, A., Hsu, L., Milkosky, N., Vickerman, D. (2015). Conductor Tutoring Using the Microsoft Kinect. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2015. Lecture Notes in Computer Science(), vol 9475. Springer, Cham. https://doi.org/10.1007/978-3-319-27863-6_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27863-6_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27862-9

  • Online ISBN: 978-3-319-27863-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics