Using Mobile Projection to Support Guitar Learning

  • Markus Löchtefeld
  • Sven Gehring
  • Ralf Jung
  • Antonio Krüger
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6815)


The guitar is one of the most widespread instruments amongst autodidacts, but even though a huge amount of learning material exists, it is still hard to learn especially without a guitar teacher. In this paper we propose an Augmented Reality concept that assists guitar students mastering their instrument using a mobile projector. With the projector mounted onto the headstock of the guitar, it is possible to project instructions directly onto the strings of the guitar. With that the user is easily able to realize where the fingers have to be placed on the fretboard (fingering) to play a certain chord or a tone sequence correctly.


Guitar Mobile Projection Learning Interfaces Projector Phone 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Burns, A., Wanderley, M.: Visual methods for the retrieval of guitarist fingering. In: Proceedings of the 2006 conference on New interfaces for musical expression (NIME 2006) IRCAM, Centre Pompidou, Paris, France (2006)Google Scholar
  2. 2.
  3. 3.
  4. 4.
    Cakmakci, O., Berard, F., Coutaz, J.: An Augmented Reality Based Learning Assistant for Electric Bass Guitar. In: Tenth International Conference on Human-Computer Interaction, HCI 2003, Rome, Italy (2003)Google Scholar
  5. 5.
    Fretlight, (last visited March 24, 2011)
  6. 6.
    Johnson, R., van der Linden, J., Rogers, Y.: MusicJacket: the efficacy of real-time vibrotactile feedback for learning to play the violin. In: Proceedings of the 28th of the International Conference Extended Abstracts on Human Factors in Computing systems (CHI EA 2010). ACM, New York (2010)Google Scholar
  7. 7.
    Kerdvibulvech, C., Saito, H.: Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters. In: Mery, D., Rueda, L. (eds.) PSIVT 2007. LNCS, vol. 4872, Springer, Heidelberg (2007)CrossRefGoogle Scholar
  8. 8.
  9. 9.
    Liarokapis, F.: Augmented Reality Scenarios for Guitar Learning. In: Third International Conference on Eurographics UK Theory and Practice of Computer Graphics, Canterbury, UK (2005)Google Scholar
  10. 10.
    Mistry, P., Maes, P., Chang, L.: WUW - wear Ur world: a wearable gestural interface. In: Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems (CHI 2009), ACM, New York (2009)Google Scholar
  11. 11.
    Moog PianoBar, (last visited March 24, 2011)
  12. 12.
    Motokawa, Y., Saito, H.: Support system for guitar playing using augmented reality display. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2006). IEEE Computer Society, Washington, DC USA (2006)Google Scholar
  13. 13.
    MusicPath: Networking People and Music,
  14. 14.
    Ng, K.: Interactive feedbacks with visualisation and sonification for technology-enhanced learning for music performance. In: Proceedings of the 26th Annual ACM International Conference on Design of Communication (SIGDOC 2008). ACM, New York (2008)Google Scholar
  15. 15.
    Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D., Willwacher, T.: RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors. In: ACM SIGGRAPH 2005 Courses (SIGGRAPH 2005). ACM, New York (2005)Google Scholar
  16. 16.
    Rosenthal, S., Kane, S.K., Wobbrock, J.O., Avrahami, D.: Augmenting on-screen instructions with micro-projected guides: when it works, and when it fails. In: Proceedings of the 12th ACM International Conference on Ubiquitous Computing (Ubicomp 2010). ACM, New York (2010)Google Scholar
  17. 17.
    Schöning, J., Rohs, M., Kratz, S., Löchtefeld, M., Krüger, A.: Map torchlight: a mobile augmented reality camera projector unit. In: Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems (CHI 2009). CM, New York (2009)Google Scholar
  18. 18.
    Wobbrock, J.O., Wilson, A.D., Li, Y.: Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (UIST 2007). ACM, New York (2007)Google Scholar
  19. 19.
    Xiao, X., Ishii, H.: MirrorFugue: communicating hand gesture in remote piano collaboration. In: Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction (TEI 2011), ACM, New York (2011)Google Scholar
  20. 20.
  21. 21.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Markus Löchtefeld
    • 1
  • Sven Gehring
    • 1
  • Ralf Jung
    • 1
  • Antonio Krüger
    • 1
  1. 1.German Research Center for Artificial Intelligence (DFKI)SaarbrückenGermany

Personalised recommendations