Online Music Search by Tapping

  • Geoffrey Peters
  • Diana Cukierman
  • Caroline Anthony
  • Michael Schwartz
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3864)


Query by Tapping is an emerging paradigm for content-based music retrieval, which we have explored through our web-based music search system. Based on the results obtained from our system we argue that searching for music by tapping the rhythm of a song’s melody is intuitive and effective. In this paper we describe two novel algorithms to analyze tapping input. We present results indicating good accuracy rates among a broad spectrum of both trained and untrained users. Query by tapping has an important potential as a form of human-computer communication. We indicate how our algorithms to analyze tapping might be used in other areas such as music education and user authentication.


Edit Distance Ambient Intelligence Approximate String Match Musical Ability Expert Musician 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aarts, E.: Ambient Intelligence: A Multimedia Perspective. Multimedia, IEEE 11(1), 12–19 (2004)CrossRefGoogle Scholar
  2. 2.
    Bainbridge, D., Nevill-Manning, C., Witten, I., Smith, L., McNab, R.: Towards a Digital Library of Popular Music. In: Proceedings of the Fourth ACM Conference on Digital Libraries. ACM Press, New York (1999)Google Scholar
  3. 3.
    Chklovski, T., Gil, Y.: Towards Managing Knowledge Collection from Volunteer Contributors. In: Proceedings of AAAI Spring Symposium on Knowledge Collection from Volunteer Contributors (KCVC 2005) (2005)Google Scholar
  4. 4.
    Chklovski, T.: 1001 Paraphrases: Incenting Responsible Contributions in Collecting Paraphrases from Volunteers. In: Proceedings of AAAI Spring Symposium on Knowledge Collection from Volunteer Contributors (KCVC 2005) (2005)Google Scholar
  5. 5.
    Doraisamy, S., Ruger, S.: An Approach Towards a Polyphonic Music Retrieval System. In: Proceedings of the Second Annual International Symposium on Music Information Retrieval: ISMIR 2001 (2001)Google Scholar
  6. 6.
    Eisenberg, G., Batke, J.-M., Sikora, T.: BeatBank - An MPEG-7 Compliant Query by Tapping System. In: 116th AES Convention, Berlin (2004)Google Scholar
  7. 7.
    Feigenbaum, E.: Some Challenges and Grand Challenges for Computational Intelligence. Journal of the ACM (JACM) 50(1), 32–40 (2003)MathSciNetCrossRefMATHGoogle Scholar
  8. 8.
    Ghias, A., Logan, J., Chamberlin, D.: Query by Humming - Musical Information Retrieval in an Audio Database. In: ACM Mulitmedia 1995 - Electronic Proceedings (1995)Google Scholar
  9. 9.
    Gomez, E., Klapuri, A., Meudic, B.: Melody Description and Extraction in the Context of Music Content Processing. Journal of New Music Research 32(1), 23–40 (2003)CrossRefGoogle Scholar
  10. 10.
    Haitsma, J., Kalker, T.: A Highly Robust Audio Fingerprinting System. In: International Symposium on Musical Information Retrieval (ISMIR 2002), pp. 144–148 (2002)Google Scholar
  11. 11.
    Harb, H., Chen, L.: A Query by Example Music Retrieval Algorithm. In: 4th European Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2003), pp. 122–128 (2003)Google Scholar
  12. 12.
    Kline, R., Glinert, E.: Approximate Matching Algorithms for Music Information Retrieval Using Vocal Input. In: Proceedings of the Eleventh ACM International Conference on Multimedia. ACM Press, New York (2003)Google Scholar
  13. 13.
    Kosugi, N., Nishihara, Y., Sakata, T., Yamamuro, M., Kushima, K.: A Practical Query-by-Humming System for a Large Music Database. In: Proceedings of the Eighth ACM International Conference on Multimedia, pp. 333–342 (2000)Google Scholar
  14. 14.
    Kosugi, N., Nagata, H., Nakanishi, T.: Query-by-Humming on Internet. In: Mařík, V., Štěpánková, O., Retschitzegger, W. (eds.) DEXA 2003. LNCS, vol. 2736, pp. 589–600. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  15. 15.
    Levenshtein, V.I.: Binary codes capable of correcting deletions, insertions, and reversals. Sov. Phys. Dokl, 707–710 (February 1966)Google Scholar
  16. 16.
    Luger, G.: Artificial Intelligence: Structures and Strategies for Complex Problem Solving, ch. 1, 5th edn. Addison-Wesley, Reading (2005)Google Scholar
  17. 17.
    Melucci, M., Orio, N.: Musical Information Retrieval Using Melodic Surface. In: Proceedings of the Fourth ACM conference on Digital Libraries, pp. 152–160 (1999)Google Scholar
  18. 18.
    The Open Music Encyclopedia. Online Resource (2005),
  19. 19.
    Parsons, D.: The Directory of Tunes and Musical Themes. Spencer Brown (1975)Google Scholar
  20. 20.
    Peters, G., Anthony, C., Schwartz, M.: Song Search and Retrieval by Tapping. In: Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI 2005), pp. 1696–1697 (2005)Google Scholar
  21. 21.
    Peters, G., Anthony, C., Schwartz, M.: The Song Tapper. Online Resource (2005),
  22. 22.
    Phillips-Silver, J., Trainor, L.: Feeling the Beat: Movement Influences Infant Rhythm Perception. Science 308, 1430 (2005)CrossRefGoogle Scholar
  23. 23.
    Jyh-Shing, R., Hong-Ru, L., Chia-Hui, Y.: Query by Tapping: A New Paradigm for Content-Based Music Retrieval from Acoustic Input. In: Shum, H.-Y., Liao, M., Chang, S.-F. (eds.) PCM 2001. LNCS, vol. 2195, pp. 590–597. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  24. 24.
    Shmulevich, I., Yli-Harja, O., Coyle, E., Povel, D.-J., Lemstrom, K.: Perceptual Issues in Music Pattern Recognition - Complexity of Rhythm and Key Finding. In: Proceedings of the AISB 1999 Symposium on Musical Creativity, pp. 64–69 (1999)Google Scholar
  25. 25.
    Sun, W., Manber, U.: Fast Text Searching: Allowing Errors. Communication of the ACM 35(10), 83–91 (1992)CrossRefGoogle Scholar
  26. 26.
    Tseng, Y.: Content-based Retrieval for Music Collections. In: Proceedings of the 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM Press, New York (1999)Google Scholar
  27. 27.
    Uitdenbogerd, A., Zobel, J.: Manipulation of Music For Melody Matching. ACM Multimedia 1998, 235–240 (1998)Google Scholar
  28. 28.
    Von Ahn, L., Dabbish, L.: Labeling Images with a Computer Game. ACM CHI (2004)Google Scholar
  29. 29.
    Wang, Y., Kan, M., Nwe, T., Shenoy, A., Yin, J.: LyricAlly: Automatic Synchronization of Acoustic Musical Signals and Textual Lyrics. In: Proceedings of the 12th Annual ACM International Conference on Multimedia, ACM Press. New York (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Geoffrey Peters
    • 1
  • Diana Cukierman
    • 1
  • Caroline Anthony
    • 1
  • Michael Schwartz
    • 1
  1. 1.Simon Fraser UniversityBurnabyCanada

Personalised recommendations