Development of auditory feedback system for violin playing robot

Abstract

This paper introduces the development of auditory feedback system that evaluates the sounds of violin played by a robot and then decides how to operate generating a better sound automatically by mimicking a mechanism of how people learn to play an instrument. In order to verify the importance of auditory feedback when playing a violin, the performance result of three experiments is compared to the frequency of G-string. The experiment results confirm that the desired level of play is difficult even if an expert violinist is played without the auditory feedback. Bowing speed, bowing force, and sound point are three factors that determine the sound quality of violin. In the proposed auditory feedback system, the bowing speed is estimated by the control command of robot arm, where the bowing force and the sound point are recognized by using the two-axis load cell and the photo interrupter, respectively. Through the framework of the proposed auditory feedback system, the improvement in the performance quality is confirmed in actual experiment by accordingly changing the bowing speed, bowing force, and sound point.

This is a preview of subscription content, access via your institution.

References

  1. 1.

    Ayres, R. and Miller, S., “The Impact of Industrial Robots,” The Robotics Institute, CMU-R1-TR-81–7, 1981. http://wwwdticmil/dtic/tr/fulltext/u2/a126382pdf (Accessed 23 MAR 2016)

    Google Scholar 

  2. 2.

    Fujita, M. and Kitano, H., “Development of an Autonomous Quadruped Robot for Robot Entertainment,” Autonomous Robots, Vol. 5, No. 1, pp. 7–18, 1998.

    Article  Google Scholar 

  3. 3.

    Yates, A. J., “Delayed Auditory Feedback,” Psychological Bulletin, Vol. 60, No. 3, pp. 213–232, 1963.

    Article  Google Scholar 

  4. 4.

    Solis, J., Takanishi, A., and Hashimoto, K., “Development of an Anthropomorphic Saxophone-Playing Robot,” in: Adcances in Intelligent and Soft Computing, Kacprzyk, J., (Ed.), Springer, pp. 175–186, 2010.

    Google Scholar 

  5. 5.

    Solis, J., Chida, K., Suefuji, K., and Takanishi, A., “The Development of the Anthropomorphic Flutist Robot at Waseda University,” International Journal of Humanoid Robotics, Vol. 3, No. 2, pp. 127–151, 2006.

    Article  Google Scholar 

  6. 6.

    Sanders, D., and Kusuda, Y., “Toyota's Violin-Playing Robot,” Industrial Robot: An International Journal, Vol. 35, No. 6, pp. 504–506, 2008.

    Article  Google Scholar 

  7. 7.

    Shibuya, K., Matsuda, S., and Takahara, A., “Toward Developing a Violin Playing Robot-Bowing by Anthropomorphic Robot Arm and Sound Analysis,” Proc. of the 16th IEEE International Symposium on Robot and Human Interactive Communication, pp. 763–768, 2007.

    Google Scholar 

  8. 8.

    Min, B.-C., Matson, E. T., An, J., and Kim, D., “Improvement of Violinist Robot using a Passive Damper Device,” Journal of Intelligent & Robotic Systems, Vol. 72, No. 3–4, pp. 343–355, 2013.

    Article  Google Scholar 

  9. 9.

    Schelleng, J. C., “The Bowed String and the Player,” The Journal of the Acoustical Society of America, Vol. 53, No. 1, pp. 26–41, 1973.

    Article  Google Scholar 

  10. 10.

    Bartlett, B., “Practical Recording Techniques: The Step-by-Step Approach to Professional Audio Recording,” Taylor & Francis, pp. 15–34, 2013.

    Google Scholar 

  11. 11.

    Jacobsen, E. and Lyons, R., “The Sliding DFT,” IEEE Signal Processing Magazine, Vol. 20, No. 2, pp. 74–80, 2003.

    Article  Google Scholar 

  12. 12.

    Jo, W., Hyeonjun, P., Bumjoo, L., and Kim, D., “A Study on Improving Sound Quality of Violin Playing Robot,” Proc. of 6th International Conference on Automation, Robotics and Applications (ICARA), pp. 185–191, 2015.

    Google Scholar 

  13. 13.

    Bader, R., “Computational Mechanics of the Classical Guitar,” Springer Science & Business Media, pp. 58–72, 2006.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Donghan Kim.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Jo, W., Lee, B. & Kim, D. Development of auditory feedback system for violin playing robot. Int. J. Precis. Eng. Manuf. 17, 717–724 (2016). https://doi.org/10.1007/s12541-016-0089-6

Download citation

Keywords

  • Violin playing robot
  • Auditory feedback
  • Force feedback
  • Human-robot interaction