Abstract
In this paper, we describe a novel methodology for dance learning and evaluation using multi-sensor and 3D gaming technology. The learners are captured during dancing, while an avatar visualizes their motion using fused input from multiple sensors. Motion analysis and fuzzy-logic are employed for the evaluation of the learners’ performance against the performance of an expert. Specifically, a two level Fuzzy Inference System is proposed which uses as input low level skeletal data and high level motion recognition probabilities for the evaluation of dancer’s performance. Tests with real dancers, both learners and experts, dancing Tsamiko, a very popular traditional Greek dance, are presented showing the potential of the proposed method.
Chapter PDF
References
Essid, S., Alexiadis, D., Tournemenne, R., Gowing, M., Kelly, P., Monaghan, D., Daras, P., Drιmeau, A., O’connor, N.: An Advanced Virtual Dance Performance Evaluator. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2012), Kyoto, Japan, March 25-30 (2012)
Raptis, M., Kirovski, D., Hoppe, H.: Real-time classification of dance gestures from skeleton animation. In: Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Vancouver, British Columbia, Canada, August 5-7 (2011)
Dance central, http://www.dancecentral.com/
Drobny, D., Weiss, M., Borchers, J.: Saltate! - A Sensor-Based System to Support Dance Beginners. In: CHI 2009: Extended Abstracts on Human Factors in Computing Systems, pp. 3943–3948. ACM, New York (2009)
Aylward, R.: Sensemble: A Wireless Inertial Sensor System for InteractiveDance and Collective Motion Analysis. Masters of Science in Media Arts and Sciences, Massachusetts Institute of Technology (2006)
VR-Theater project, http://avrlab.iti.gr/HTML/Projects/current/VRTHEATER.htm
Drobny, D., Borchers, J.: Learning Basic Dance Choreographies with different Augmented Feedback Modalities. In: CHI 2010: Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York (2010)
Kinect for Windows | Voice, Movement & Gesture Recognition Technology (2013), http://www.microsoft.com/en-us/kinectforwindows/
Asus Xtion PRO, http://www.asus.com/Multimedia/Xtion_PRO/
Alexiadis, D., Kelly, P., Daras, P., O’Connor, N., Boubekeur, T., Moussa, M.: Evaluating a dancer’s performance using kinect-based skeleton tracking. In: Proceedings of the 19th ACM International Conference on Multimedia (MM 2011), pp. 659–662. ACM, New York (2011)
Kitsikidis, A., Dimitropoulos, K., Douka, S., Grammalidis, N.: Dance Analysis using Multiple Kinect Sensors. In: VISAPP 2014, Lisbon, Portugal, January 5-8 (2014)
Unity, http://unity3d.com
Besl, P., McKay, N.: A Method for Registration of 3-D Shapes. IEEE Trans. on Pattern Analysis and Machine Intelligence 14(2), 239–256 (1992)
Rusu, B., Cousins, S.: 3D is here: Point Cloud Library (PCL). In: 2011 IEEE International Conference on Robotics and Automation (ICRA), May 9-13, pp. 1–4 (2011)
Wang, S., Quattoni, A., Morency, L.-P., Demirdjian, D., Darrell, T.: Hidden Conditional Random Fields for Gesture Recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (June 2006)
Quattoni, A., Collins, M., Darrell, T.: Conditional Random Fields for Object Recognition. In: Neural Information Processing Systems (2004)
Mamdani, E.H., Assilian, S.: An experiment in linguistic synthesis with a fuzzy logic controller. International Journal of Man-Machine Studies 7(1), 1–13 (1975)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Kitsikidis, A., Dimitropoulos, K., Yilmaz, E., Douka, S., Grammalidis, N. (2014). Multi-sensor Technology and Fuzzy Logic for Dancer’s Motion Analysis and Performance Evaluation within a 3D Virtual Environment. In: Stephanidis, C., Antona, M. (eds) Universal Access in Human-Computer Interaction. Design and Development Methods for Universal Access. UAHCI 2014. Lecture Notes in Computer Science, vol 8513. Springer, Cham. https://doi.org/10.1007/978-3-319-07437-5_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-07437-5_36
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07436-8
Online ISBN: 978-3-319-07437-5
eBook Packages: Computer ScienceComputer Science (R0)