This paper introduces the development of auditory feedback system that evaluates the sounds of violin played by a robot and then decides how to operate generating a better sound automatically by mimicking a mechanism of how people learn to play an instrument. In order to verify the importance of auditory feedback when playing a violin, the performance result of three experiments is compared to the frequency of G-string. The experiment results confirm that the desired level of play is difficult even if an expert violinist is played without the auditory feedback. Bowing speed, bowing force, and sound point are three factors that determine the sound quality of violin. In the proposed auditory feedback system, the bowing speed is estimated by the control command of robot arm, where the bowing force and the sound point are recognized by using the two-axis load cell and the photo interrupter, respectively. Through the framework of the proposed auditory feedback system, the improvement in the performance quality is confirmed in actual experiment by accordingly changing the bowing speed, bowing force, and sound point.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Ayres, R. and Miller, S., “The Impact of Industrial Robots,” The Robotics Institute, CMU-R1-TR-81–7, 1981. http://wwwdticmil/dtic/tr/fulltext/u2/a126382pdf (Accessed 23 MAR 2016)
Fujita, M. and Kitano, H., “Development of an Autonomous Quadruped Robot for Robot Entertainment,” Autonomous Robots, Vol. 5, No. 1, pp. 7–18, 1998.
Yates, A. J., “Delayed Auditory Feedback,” Psychological Bulletin, Vol. 60, No. 3, pp. 213–232, 1963.
Solis, J., Takanishi, A., and Hashimoto, K., “Development of an Anthropomorphic Saxophone-Playing Robot,” in: Adcances in Intelligent and Soft Computing, Kacprzyk, J., (Ed.), Springer, pp. 175–186, 2010.
Solis, J., Chida, K., Suefuji, K., and Takanishi, A., “The Development of the Anthropomorphic Flutist Robot at Waseda University,” International Journal of Humanoid Robotics, Vol. 3, No. 2, pp. 127–151, 2006.
Sanders, D., and Kusuda, Y., “Toyota's Violin-Playing Robot,” Industrial Robot: An International Journal, Vol. 35, No. 6, pp. 504–506, 2008.
Shibuya, K., Matsuda, S., and Takahara, A., “Toward Developing a Violin Playing Robot-Bowing by Anthropomorphic Robot Arm and Sound Analysis,” Proc. of the 16th IEEE International Symposium on Robot and Human Interactive Communication, pp. 763–768, 2007.
Min, B.-C., Matson, E. T., An, J., and Kim, D., “Improvement of Violinist Robot using a Passive Damper Device,” Journal of Intelligent & Robotic Systems, Vol. 72, No. 3–4, pp. 343–355, 2013.
Schelleng, J. C., “The Bowed String and the Player,” The Journal of the Acoustical Society of America, Vol. 53, No. 1, pp. 26–41, 1973.
Bartlett, B., “Practical Recording Techniques: The Step-by-Step Approach to Professional Audio Recording,” Taylor & Francis, pp. 15–34, 2013.
Jacobsen, E. and Lyons, R., “The Sliding DFT,” IEEE Signal Processing Magazine, Vol. 20, No. 2, pp. 74–80, 2003.
Jo, W., Hyeonjun, P., Bumjoo, L., and Kim, D., “A Study on Improving Sound Quality of Violin Playing Robot,” Proc. of 6th International Conference on Automation, Robotics and Applications (ICARA), pp. 185–191, 2015.
Bader, R., “Computational Mechanics of the Classical Guitar,” Springer Science & Business Media, pp. 58–72, 2006.
About this article
Cite this article
Jo, W., Lee, B. & Kim, D. Development of auditory feedback system for violin playing robot. Int. J. Precis. Eng. Manuf. 17, 717–724 (2016). https://doi.org/10.1007/s12541-016-0089-6
- Violin playing robot
- Auditory feedback
- Force feedback
- Human-robot interaction