Skip to main content
SpringerLink
Log in

A systematic survey of martial art using motion capture technologies: the importance of extrinsic feedback

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The number of research papers on Motion Capture technologies published in conferences and journals has been rapidly increasing due to the emerging of new technologies, software and hardware which create new challenges and opportunities for Martial Arts research. Current trend of the Martial Arts using Motion Capture technologies (MAMoCap) researches consists of phases of MoCap-Processing and Post-MoCap-Processing; contexts of algorithms, performance and system development; and feedbacks of intrinsic and extrinsic. The purpose of this paper is to study and explore the potential future trend of research and publications pertaining to MAMoCap researches. A systematic survey of research publications was conducted through the topic of Martial Art (MA) and Motion Capture (MoCap) in order to retrieve the scientific articles published in FOUR (4) established publishers including SPRINGERLINK, SCIENCEDIRECT, IEEE and ACM. Search refinements were done by the inclusions criteria of document types of academic journals and conference proceedings; and by the exceptions criteria of letters, editorials and book reviews. The findings show that only 27% of the publications have been selected while other 73% have been classified as irrelevant contents due to none significance and relevance to the MAMoCap researches. Analysis on the research phases, contexts and feedbacks has been conducted and discussed in detailed for pertaining knowledge gaps and future research agenda. Based on the preliminary study, a framework of EFs-Based Automated Evaluation System for the martial arts should be proposed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Abualkibash M, Gedney J, Kim Y, Lee J (2009) A Hierarchical Approach to Landmarks Detection in Taekwondo Poomsae Videos. 2nd International Conference on Computer Science and its Applications, 1–6

  2. Baker JF, Devitt BM, Moran R (2010) Anterior cruciate ligament rupture secondary to a ‘heel hook’: a dangerous martial arts technique. Knee Surg Sports Traumatol Arthrosc 18:115–116. https://doi.org/10.1007/s00167-009-0877-y

    Article  Google Scholar 

  3. Bandouch J, Jenkins OC, Beetz M (2012) A self-training approach for visual tracking and recognition of complex human activity patterns. Int J Comput Vis 99:166–189

    Article  MathSciNet  Google Scholar 

  4. Benitezsantiago AS, Using Video Feedback to Improve Martial-Arts Performance (2011). Graduate Theses and Dissertations. http://scholarcommons.usf.edu/etd/3006

  5. Chao S-P, Chiu C-Y, Chao J-H, Yang S-N, Lin TK (2004) Motion retrieval and its application to motion synthesis, 24th International Conference on Distributed Computing Systems Workshops, 254–259

  6. Chen XL, Mendhurwar K, Mudur S (2010) Thiruvengadam Radhakrishnan and Prabir Bhattacharya, Learning Human Action Sequence Style from Video for Transfer to 3D Game Characters, Motion in Games, MIG 2010, LNCS 6459, 422–433

  7. Chen W, Gao N, Wang H, Sun D (2011) Implementation of Tai Chi Chuan on humanoid robot, Proceedings of 2011 International Conference on Computer Science and Network Technology, 1128–1131

  8. Chiu C-Y, Chao S-P, Chao J-H, Chang W-Y, Lin H-C, Yang S-N (2003) Motion indexing and synthesis. Int Conf Multimed Expo. ICME '03

  9. Chiu C-Y, Chao S-P, Wu M-Y, Yang S-N, Lin H-C (2004) Content-based retrieval for human motion data. J Vis Commun Image Represent 15(3):446–466

    Article  Google Scholar 

  10. Chiu C-Y, Wu C-C, Wu Y-C, Wu M-Y, Chao S-P, Yang S-N (2006) Retrieval and constraint-based human posture reconstruction from a single image. J Vis Commun Image Represent 17(4):892–915

    Article  Google Scholar 

  11. Choi C-H, Joo H-J (2015) Motion recognition technology based remote taekwondo Poomsae evaluation system. Multimed Tools Appl:1–14

  12. Choi W, Mukaida S, Sekiguchi H, Hachimura K (2008) Quantitative analysis of Iaido proficiency by using motion data, 2008 19th International Conference on Pattern Recognition

  13. Chye C, Sakamoto M, Nakajima T (2014) An Exergame for Encouraging Martial Arts, Human-Computer Interaction. Applications and Services

  14. Cynarski WJ, Wajs W, VencesBrito A (2014) Improving the movements of basic karate techniques with the use of motion capture and mathematical modeling. The concept of a research project IDO MOVEMENT FOR CULTURE. J Martial Arts Anthropol 14(1):39–53

    Google Scholar 

  15. Draxler T, Ostermann H, Honekamp W (2011) Relationship between Asian martial arts and health-related quality of life in Germany. J Public Health 19:57–64. https://doi.org/10.1007/s10389-010-0343-9

    Article  Google Scholar 

  16. Endres D, Christensen A, Omlor L, Giese MA (2011) Emulating human observers with bayesian binning: segmentation of action streams. ACM Trans Appl Percept 8(3):16:1–16:12 Article 16

    Article  Google Scholar 

  17. Endres D, Christensen A, Omlor L, Giese MA (2011) Segmentation of Action Streams: Human Observers vs. Bayesian Binning, KI 2011: Advances in Artificial Intelligence, LNAI 7006, 75–86

  18. Endres D, Chiovetto E, Giese MA (2016) Bayesian Approaches for Learning of Primitive-Based Compact Representations of Complex Human Activities, Dance Notations and Robot Motion

  19. Fernandes FM, Wichi RB, Silva VF, Ladeira APX, Ervilha UF (2011) Biomechanical methods applied in martial arts studies. J Morphol Sci 28(3):141–144

    Google Scholar 

  20. Flagg M, Nakazawa S, Zhang Q, Kang SB, Ryu YK, Essa I, Rehg JM (2009) Human Video Textures, Proceedings of the 2009 Symposium on Interactive 3D Graphics and Games 199–206

  21. Hachaj T, Ogiela MR (2013) Computer Karate Trainer in Tasks of Personal and Homeland Security Defense, Security Engineering and Intelligence Informatics

  22. Hass CJ, Gregor RJ, Waddell DE, Oliver A, Smith DW, Fleming RP, Wolf SL (2004) The influence of tai chi training on the center of pressure trajectory during gait initiation in older adults1. Arch Phys Med Rehabil 85(10):1593–1598

    Article  Google Scholar 

  23. Hegarini E, Mutiara AB, Suhendra A, Iqbal M, Wardijono BA (2016) Similarity analysis of motion based on motion capture technology. International Conference on Informatics and Computing (ICIC), 389–393

  24. Ilg W, Giese M (2002) Modeling of Movement Sequences Based on Hierarchical Spatial-Temporal Correspondence of Movement Primitives, Biologically Motivated Computer Vision

  25. Ilg W, Mezger J, Giese M (2003) Estimation of Skill Levels in Sports Based on Hierarchical Spatio-Temporal Correspondences, Pattern Recognition

  26. Ismail AM (2002) Penerapan jati diri melalui ilmu bela diri: Pendekatan Seni Silat Cekak Malaysia, Prosiding Persidangan Kebangsaan Kerja Sosial 2002: Belia & NGO dalam kerja sosial: Isu peranan dan strategi. Hotel Legend, Kuala Lumpur

    Google Scholar 

  27. Iwaanaguchi T, Shinya M, Nakajima S, Shiraishi M (2015) Cyber Tai Chi - CG-based Video Materials for Tai Chi Chuan Self-Study. Int Conf Cyberworlds (CW) 365–368

  28. Kolykhalova K, Camurri A, Volpe G, Sanguineti M, Puppo E, Niewiadomski R (2015) A multimodal dataset for the analysis of movement qualities in karate martial art, 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN), 74–78

  29. Komura T, Lam B, Lau RWH, Leung H (2006) e-Learning Martial Arts. In: Liu W., Li Q., W.H.R. Lau (eds) Advances in Web Based Learning – ICWL 2006. ICWL 2006. Lecture Notes in Computer Science, vol 4181. Springer, Berlin

  30. Kovavisaruch L, Wisanmongkol J, Sanpachuda T, Chaiwongyen A, Wisadsud S, Wongsatho T, Tangkamcharoen B, Nagarachinda B, Khiawchaum C (2011) Conserving and Promoting Thai Sword Dancing Traditions with Motion Capture and the Nintendo Wii, IEEE Conference Publications, Proceeding of PICMET’ 11, Technology Management in the Energy Smart World (PICMET), 1–5

  31. Lee W, Bang Y-B, Lee K-M, Shin B-H, Paik JK, Kim I-S (2010) Motion teaching method for complex robot links using motor current. Int J Control Autom Syst 8(5):1072–1081

    Article  Google Scholar 

  32. Li Y (2012) Model Analysis of the Impact on Physical Fitness of Taichiquan. Proc Int Conf Inform Eng Appl (IEA)

  33. Liang X, Zhang S, Zhang X, Geng W (2009) Motion-Based Perceptual User Interface, Third International Symposium on Intelligent Information Technology Application 247–251

  34. Liu Y, Ye G, Wang Y, Dai Q, Theobalt C (2014) Human Performance Capture Using Multiple Handheld Kinects, Computer Vision and Machine Learning with RGB-D Sensors

  35. Majoe D, Widmer L, Gutknecht J (2009) Enhanced motion interaction for multimedia applications, Proceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia 13–19

  36. Mariconda M, Cozzolino A, Di Pietto F, Ribas M, Bellotti V, Soldati A (2014) Radiographic findings of femoroacetabular impingement in capoeira players. Knee Surg Sports Traumatol Arthrosc 22:874–881. https://doi.org/10.1007/s00167-014-2850-7

    Article  Google Scholar 

  37. McPherson M, Pickett W (2010) Characteristics of martial art injuries in a defined Canadian population: a descriptive epidemiological study. McPherson Pickett BMC Public Health 10:795 http://www.biomedcentral.com/1471-2458/10/795

    Article  Google Scholar 

  38. Menache A (2011) Understanding motion capture for computer animation, Second edn. Morgan Kaufmann, USA

    Google Scholar 

  39. Mezger J, Ilg W, Giese MA (2005) Trajectory Synthesis by Hierarchical Spatio-temporal Correspondence: Comparison of Different Methods, Proceedings of the 2nd Symposium on Applied Perception in Graphics and Visualization 25–32

  40. Morel M, Achard C, Kulpa R, Dubuisson S (2017) Automatic evaluation of sports motion: a generic computation of spatial and temporal errors. Image Vis Comput 64:67–78

    Article  Google Scholar 

  41. Mustapha G, Zakaria M, Sulaiman WRW, Mahmud J (2014) The mechanical aspects of martial arts: Total time of execution and kinematics of Kaedah A, Proceeding of the International Colloqium on Sports, Science, Exercise, Eng Technol (ICoSSEET 2014), 3–12

  42. Mustapha G, Mahmud J, Zakaria M, Sulaiman WRW (2015) Biomechanics research on martial arts – the importance of defensive study. Archives Budo: Sci Martial Arts 11:187–195

    Google Scholar 

  43. Petri K, Witte K, Bandow N, Emmermacher P, Masik S, Dannenberg M, Salb S, Zhang L, Brunnett G (2017) Development of an Autonomous Character in Karate Kumite, Proceedings of the 11th International Symposium on Computer Science in Sport (IACSS), 124–135

  44. Ramachandran AK, Rosengren KS, Yang Y, Hsiao-Wecksler ET (2007) Effect of tai chi on gait and obstacle crossing behaviors in middle-aged adults. Gait Posture 26(2):248–255

    Article  Google Scholar 

  45. Saponara S (2017) Wearable biometric performance measurement system for combat sports. IEEE Trans Instrum Meas 66(10):2545–2555

    Article  Google Scholar 

  46. Sun B, Yang C, Wang L, Wu G, Wang X, Liu L, Lu L, Wang D, Ye M, Gao C (2012 ) Web3D-based online military boxing learning system. Int Sympos Inform Technol Med Educ 26–30

  47. Tanaka Y, Kosuge K (2014) Dynamic attack motion prediction for kendo agent, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2187–2193

  48. Torres EB (2011) Two classes of movements in motor control. Exp Brain Res 215

  49. Torres Ruiz A, Manrique Fernández JM, Ardila Jiménez S (2014) Biomechanical Characterization of Five Sporting Gestures of Taekwondo, VI Latin American Congress on Biomedical Engineering CLAIB 2014, Paraná, Volume 49 of the series IFMBE Proceedings, 285–288

  50. Wan B, Shan G (2016) Biomechanical modeling as a practical tool for predicting injury risk related to repetitive muscle lengthening during learning and training of human complex motor skills, SpringerPlus, 5,(441)

  51. Wu M-Y, Wu Y-C, Chiu C-Y, Chao S-P, Yang S-N (2004) HUMOR: a HUman MOtion Retrieval system with multi-modal queries. IEEE International Conference on Multimedia and Expo (ICME) 315–316

  52. Ye G, Liu Y, Hasler N, Ji X, Dai Q, Theobalt C (2012) Performance Capture of Interacting Characters with Handheld Kinects, Computer Vision ECCV 2012, ECCV 2012, Part II, LNCS 7573. 828–841

  53. Yu, H., Evaluation model of fuzzy data and neural network in Martial art competition, Journal of Theoretical and Applied Information Technology, Volume 48, Issue 3, 2013, Pages 1458-1465, Scopus

  54. Zago M, Mapelli A, Shirai YF, Ciprandi D, Lovecchio N, Galvani C, Sforza C (2015) Dynamic balance in elite karateka. J Electromyogr Kinesiol 25(6):894–900

    Article  Google Scholar 

  55. Zhang S, Li Q, Yu T, Shen XJ, Geng W, Wang P (2006) Implementation of a Notation-Based Motion Choreography System. Interact Technol Sociotech Syst

  56. Zhang W, Liu Z, Zhou L, Leung H, Chan AB (2017) Martial arts, dancing and sports dataset: a challenging stereo and multi-view dataset for 3D human pose estimation. Image Vis Comput 61:22–39

    Article  Google Scholar 

  57. Zheng G, Li M, Lan X, Yan X, Lin Q, Chen L, Tao J, Zheng X, Li J, Chen B, Fang Q (2013) The effect of Baduanjin exercise for physical and psychological wellbeing of college students: study protocol for a randomized controlled trial, Trials, 14(1)

Download references

Acknowledgements

The authors gratefully acknowledge the Ministry of Higher Education (MoHE) and Universiti Sultan Zainal Abidin (UniSZA) for the financial support through RAGS Project No. RAGS/1/2015/ICT04/UNISZA/03/1. Thanks to Multimedia University (MMU) for providing facilities and technical assistance for this research.

Author information

Authors and Affiliations

  1. Faculty of Creative Multimedia, Multimedia University, Cyberjaya Campus, 63000, Cyberjaya, Selangor, Malaysia

    Wan Mohd Rizhan Wan Idris, Ahmad Rafi & Azman Bidin

  2. Faculty of Informatics and Computing, University of Sultan Zainal Abidin, Besut Campus, 22200, Besut, Terengganu, Malaysia

    Wan Mohd Rizhan Wan Idris, Azrul Amri Jamal & Syed Abdullah Fadzli

Authors
  1. Wan Mohd Rizhan Wan Idris
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ahmad Rafi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Azman Bidin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Azrul Amri Jamal
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Syed Abdullah Fadzli
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wan Mohd Rizhan Wan Idris.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wan Idris, W.M.R., Rafi, A., Bidin, A. et al. A systematic survey of martial art using motion capture technologies: the importance of extrinsic feedback. Multimed Tools Appl 78, 10113–10140 (2019). https://doi.org/10.1007/s11042-018-6624-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-6624-y

Keywords

Search

Navigation