A Matching Method between Music Scores and Performance Data in a Realtime Person-Computer Ensemble System

  • Tetsuya Mizutani
  • Keita Nishiyama
  • Shigeru Igarashi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7002)


A person-computer ensemble system is one of time-concerned cooperative systems, which performs secondo (the second part) in an ensemble played by a computer-controlled piano cooperating with primo (the leading part) played by a person performer.

In the realtime performance, to determine which key is touched, or played, by the person performer, the matching algorithm between the score and the realtime input from the person performer is essential. Especially, if there are some mistouches (playing incorrectly) or other mistake, error, etc., the program does not determine which note is performed just now and which note of the secondo will be done just after now. Therefore, the matching method that corrects these mistouches is very important.

In this paper, a simple and efficient matching algorithm is proposed.


Artificial Intelligence Musical Informatics Ensemble System Correction of the Mistouching keys 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Curzon, P., Ruksenas, R., Blandford, A.: An Approach to Formal Verification of Human-Computer Interaction. Formal Aspect of Computing 19, 513–550 (2007)CrossRefzbMATHGoogle Scholar
  2. 2.
    Eto, Y. (ed.): Flute Famous Collections, vol. 31, p. 112. Doremi Music Publishing (1986)Google Scholar
  3. 3.
    Damm, W., Hungar, H., Olderog, E.-R.: Verification of Cooperating Traffic Agents. International Journal of Control 79, 395–421 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Dannenberg, R.B.: An On-Line Algorithm for Real-Time Accompaniment. In: Proceedings of the 1984 International Computer Music Conference, pp. 193–198 (1985)Google Scholar
  5. 5.
    Igarashi, S.: The ν-Conversion and an Analytic Semantics. In: Information Processing, vol. 83, pp. 769–774. Elsevier Sci. Publ. B.V., Amsterdam (1983)Google Scholar
  6. 6.
    Ikeda, Y., Mizutani, T., Shio, M.: Formal System and Semantics of NΣ-labeled Calculus. In: The 2009 International Conference on Artificial Intelligence and Computational Intelligence, pp. 270–274. IEEE, Los Alamitos (2009)CrossRefGoogle Scholar
  7. 7.
    Mizutani, T., Igarashi, S., Ikeda, Y., Shio, M.: Labeled @-Calculus: Formalism for Time-Concerned Human Factors. In: Calmet, J., Ida, T., Wang, D. (eds.) AISC 2006. LNCS (LNAI), vol. 4120, pp. 25–39. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  8. 8.
    Mizutani, T., Igarashi, S., Shio, M., Ikeda, Y.: Human Factors in Continuous Time-Concerned Cooperative Systems Represented by NΣ-labeled Calculus. Frontiers of Computer Science in China 2, 22–28 (2008)CrossRefGoogle Scholar
  9. 9.
    Mizutani, T., Suzuki, T., Shio, M., Ikeda, Y.: Formal Specification and Experiments of an Expressive Human-Computer Ensemble System with Rehearsal. In: The 3rd IEEE International Symposium on Theoretical Aspects of Software Engineering, TASE 2009, pp. 303–304 (2009)Google Scholar
  10. 10.
    Mizutani, T., Igarashi, S., Ikeda, Y., Shio, M.: Formal Analysis of an Airplane Accident in NΣ-labeled Calculus. In: Deng, H., Wang, L., Wang, F.L., Lei, J. (eds.) AICI 2009. LNCS (LNAI), vol. 5855, pp. 469–478. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  11. 11.
    Mizutani, T., Igarashi, S., Shio, M., Ikeda, Y.: Labeled Calculi Applied to Verification and Analysis of Time-Concerned Programs I. Tensor, N.S. 71, 172–186 (2009)MathSciNetzbMATHGoogle Scholar
  12. 12.
    Mizutani, T., Igarashi, S., Shio, M., Ikeda, Y.: Labeled Calculi Applied Verification and Analysis of Time-Concerned Programs II. Tensor, N.S. 71, 285–296 (2009)MathSciNetzbMATHGoogle Scholar
  13. 13.
    Mizutani, T., Igarashi, S., Suzuki, T., Ikeda, Y., Shio, M.: A Realtime Human-Computer Ensemble System: Formal Representation and Experiments for Expressive Performance. In: Wang, F.L., Deng, H., Gao, Y., Lei, J. (eds.) AICI 2010. LNCS (LNAI), vol. 6319, pp. 256–265. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  14. 14.
    Raphael, C.: Automated Rhythm Transcription. In: ISMIR 2001: International Symposium on Music Information Retrieval, pp. 99–107 (2001)Google Scholar
  15. 15.
    Suzuki, T.: Creation and Analysis of Expression on an Ensemble System, Master’s Thesis. Department of Computer Science, Graduate School of Systems and Information Engineering. University of Tsukuba (2009) (in Japanese)Google Scholar
  16. 16.
    Takeda, H., Nishimoto, T., Sagayama, S.: Joint Estimation of Rhythm and Tempo of Polyphonic MIDI Performance Using Tempo Curve and Hidden Markov Models. Journal of Information Processing 48, 237–247 (2007) (in Japanese)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Tetsuya Mizutani
    • 1
  • Keita Nishiyama
    • 2
  • Shigeru Igarashi
    • 1
  1. 1.Department of Computer ScienceUniversity of TsukubaTsukubaJapan
  2. 2.College of Information ScienceUniversity of TsukubaTsukubaJapan

Personalised recommendations