Multi-sensor Technology and Fuzzy Logic for Dancer’s Motion Analysis and Performance Evaluation within a 3D Virtual Environment

  • Alexandros Kitsikidis
  • Kosmas Dimitropoulos
  • Erdal Yilmaz
  • Stella Douka
  • Nikos Grammalidis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8513)

Abstract

In this paper, we describe a novel methodology for dance learning and evaluation using multi-sensor and 3D gaming technology. The learners are captured during dancing, while an avatar visualizes their motion using fused input from multiple sensors. Motion analysis and fuzzy-logic are employed for the evaluation of the learners’ performance against the performance of an expert. Specifically, a two level Fuzzy Inference System is proposed which uses as input low level skeletal data and high level motion recognition probabilities for the evaluation of dancer’s performance. Tests with real dancers, both learners and experts, dancing Tsamiko, a very popular traditional Greek dance, are presented showing the potential of the proposed method.

Keywords

Kinect fuzzy inference system dance performance evaluation Unity 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Essid, S., Alexiadis, D., Tournemenne, R., Gowing, M., Kelly, P., Monaghan, D., Daras, P., Drιmeau, A., O’connor, N.: An Advanced Virtual Dance Performance Evaluator. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2012), Kyoto, Japan, March 25-30 (2012)Google Scholar
  2. 2.
    Raptis, M., Kirovski, D., Hoppe, H.: Real-time classification of dance gestures from skeleton animation. In: Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Vancouver, British Columbia, Canada, August 5-7 (2011)Google Scholar
  3. 3.
  4. 4.
    Drobny, D., Weiss, M., Borchers, J.: Saltate! - A Sensor-Based System to Support Dance Beginners. In: CHI 2009: Extended Abstracts on Human Factors in Computing Systems, pp. 3943–3948. ACM, New York (2009)Google Scholar
  5. 5.
    Aylward, R.: Sensemble: A Wireless Inertial Sensor System for InteractiveDance and Collective Motion Analysis. Masters of Science in Media Arts and Sciences, Massachusetts Institute of Technology (2006)Google Scholar
  6. 6.
  7. 7.
    Drobny, D., Borchers, J.: Learning Basic Dance Choreographies with different Augmented Feedback Modalities. In: CHI 2010: Extended Abstracts on Human Factors in Computing Systems. ACM Press, New York (2010)Google Scholar
  8. 8.
    Kinect for Windows | Voice, Movement & Gesture Recognition Technology (2013), http://www.microsoft.com/en-us/kinectforwindows/
  9. 9.
  10. 10.
    Alexiadis, D., Kelly, P., Daras, P., O’Connor, N., Boubekeur, T., Moussa, M.: Evaluating a dancer’s performance using kinect-based skeleton tracking. In: Proceedings of the 19th ACM International Conference on Multimedia (MM 2011), pp. 659–662. ACM, New York (2011)CrossRefGoogle Scholar
  11. 11.
    Kitsikidis, A., Dimitropoulos, K., Douka, S., Grammalidis, N.: Dance Analysis using Multiple Kinect Sensors. In: VISAPP 2014, Lisbon, Portugal, January 5-8 (2014)Google Scholar
  12. 12.
  13. 13.
    Besl, P., McKay, N.: A Method for Registration of 3-D Shapes. IEEE Trans. on Pattern Analysis and Machine Intelligence 14(2), 239–256 (1992)CrossRefGoogle Scholar
  14. 14.
    Rusu, B., Cousins, S.: 3D is here: Point Cloud Library (PCL). In: 2011 IEEE International Conference on Robotics and Automation (ICRA), May 9-13, pp. 1–4 (2011)Google Scholar
  15. 15.
    Wang, S., Quattoni, A., Morency, L.-P., Demirdjian, D., Darrell, T.: Hidden Conditional Random Fields for Gesture Recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (June 2006)Google Scholar
  16. 16.
    Quattoni, A., Collins, M., Darrell, T.: Conditional Random Fields for Object Recognition. In: Neural Information Processing Systems (2004)Google Scholar
  17. 17.
    Mamdani, E.H., Assilian, S.: An experiment in linguistic synthesis with a fuzzy logic controller. International Journal of Man-Machine Studies 7(1), 1–13 (1975)CrossRefMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Alexandros Kitsikidis
    • 1
  • Kosmas Dimitropoulos
    • 1
  • Erdal Yilmaz
    • 2
  • Stella Douka
    • 3
  • Nikos Grammalidis
    • 1
  1. 1.Informatics and Telematics InstituteITI-CERTHThessalonikiGreece
  2. 2.KANAVA TechTurkey
  3. 3.Department of Physical Education and Sport ScienceAristotle University of ThessalonikiGreece

Personalised recommendations