A Piano Lesson Method Where User Plays the Piano Laying His or Her Hands on the Image of a Model Performer’s Hands

  • Chika OshimaEmail author
  • Kimie Machishima
  • Katsuki Yamaguchi
  • Koichi Nakayama
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9745)


We aim that even elderly people with dementia become to live actively with a hobby which provides them a feeling of accomplishment. Playing a keyboard instrument has a high threshold for novice people. Therefore, we proposed a practice method where users can play the piano laying their hands on the image of a model performer’s hands. In this paper, we conducted an experiment that ten university students who had no experience or a little experience playing the piano played a musical piece along with the model performance by laying their hands on the CG performer’s hands in the mirror. Most students could play the musical piece correctly after playing it only five times. On the other hand, some students hit the wrong keys when the CG model performer hit the key with her mid or ring finger because the model performance was represented like a mirror.


Model Performance Ring Finger Musical Instrument Computer Graphic Musical Piece 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This work was supported by JSPS KAKENHI Grant Number 15H02883.


  1. 1.
    Kolanowski, A., Litaker, M., Buettner, L., Moeller, J., Costa Jr., P.T.: A randomized clinical trial of theory-based activities for the behavioral symptoms of dementia in nursing home residents. J. Am. Geriatr. Soc. 59(6), 1032–1041 (2011)CrossRefGoogle Scholar
  2. 2.
    Machishima, K., Ishii, Y., Oshima, C., Hosoi, N., Nakayama, K.: Personalization techniques of the occupational therapy for people with dementia using daycare, 42th SICE Symposium on Intelligent Systems, F-02 (2015). in JapaneseGoogle Scholar
  3. 3.
    Oshima, C., Machishima, K., Nakayama, K.: Toward a Piano lesson system that gives people with reduced cognitive functioning a sense of accomplishment. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2015. LNCS, vol. 9177, pp. 649–659. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  4. 4.
    Casio: Lighted Keys.
  5. 5.
    Takegawa, Y., Terada, T., Tsukamoto, M.: A piano learning support system considering rhythm. In: Proceedings of International Computer Music Conference, pp. 325–332 (2012)Google Scholar
  6. 6.
    Barakonyi, I., Schmalstieg, D.: Augmented reality agents in the development pipeline of computer entertainment. In: Kishino, F., Kitamura, Y., Kato, H., Nagata, N. (eds.) ICEC 2005. LNCS, vol. 3711, pp. 345–356. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  7. 7.
    SmileyApps: Piano Tutor in iPad.
  8. 8.
  9. 9.
    Oshima, C., Nishimoto, K., Hagita, N.: A piano duo support system for parents to lead children to practice musical performance. ACM Trans. Multimedia Comput. Commun. Appl. 3(2), 6 (2007). Article No. 9CrossRefGoogle Scholar
  10. 10.
    Oshima, C., Hikawa, N., Nishimoto, K., Inoue, N.: How a piano practice support system should present model performances a pilot study. In: 2006 Proceedings of Information Processing Society of Japan, vol. 72, pp. 71–78 (2006)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Chika Oshima
    • 1
    Email author
  • Kimie Machishima
    • 1
  • Katsuki Yamaguchi
    • 1
  • Koichi Nakayama
    • 1
  1. 1.Saga UniversitySagaJapan

Personalised recommendations