Multimedia Tools and Applications

, Volume 76, Issue 6, pp 8109–8129 | Cite as

A practical computer based vision system for posture and movement sensing in occupational medicine

Article

Abstract

Back pain and upper extremities injuries due to overexertion account for over twenty percent of leave days from work in the US. This explains why a vast amount of initiatives have been, to this date, carried out aiming at reducing the occurrence of such type of injuries. However, although such type of lesions are among the most studied in occupational medicine, no automatic detection and prevention technologies are pervasively available, to this date, at workplaces. Such deficiency is ascribable to the absence of any flexible and cost-effective tectaphnology that may play such role. This work aims at filling such gap: the contribution of this paper is the design and implementation of a movement-posture computer-vision based system that, performing as a sensor, can detect overexertion movements, helping avoid the most common injuries that these cause. Such tasks are carried out with the use of a simple webcam, thus not requiring any expensive or specialized (e.g., Microsoft Kinect) hardware device. The proposed technology is, hence, easily affordable by any type of company and production plant throughout the world and easy adaptable to recognize and detect a wide set of movements and postures. The validity of such approach is demonstrated in realistic settings through a wide set of experiments.

Keywords

Multimedia Computer system Computer vision Occupational injury Injury risk detection technology Well being kinect 

References

  1. 1.
    Agustin HC (1992) Posture position sensor. U.S. Patent 5,168,264, issued December 1Google Scholar
  2. 2.
    Alexiadis DS, Kelly P, Daras P, O’Connor NE, Boubekeur T, Moussa MB (2011) Evaluating a dancer’s performance using kinect-based skeleton tracking. In: Proceedings of the 19th ACM international conference on Multimedia. ACM, p 659–662Google Scholar
  3. 3.
    Andreoni G, Mazzola M, Ciani O, Zambetti M, Romero M, Costa F, Preatoni E (2009) Method for movement and gesture assessment (MMGA) in ergonomics. International Conference on Digital Human Modeling, San Diego, CA, USA, p 591–598Google Scholar
  4. 4.
  5. 5.
    Available, online. http://structure.io/openni. Accessed 25 May 2015
  6. 6.
    Available, online. http://www.bls.gov/iif/oshcdnew.htm. Accessed 25 May 2015
  7. 7.
  8. 8.
    Available, online. http://www.lumobodytech.com/lumoback/. Accessed 5 May 2014
  9. 9.
    Bernard BP, Putz-Anderson V (1997) Musculoskeletal disorders and workplace factors: a critical review of epidemiologic evidence for work-related disorders of the neck, upper extremities, and low back. DHHS (NIOSH) Publication No. 97B141Google Scholar
  10. 10.
    Bernmark E, Wiktorin CCPS (2002) A triaxial accelerometer for measuring arm movements. Appl Ergon 33:541–547CrossRefGoogle Scholar
  11. 11.
    Como JJ, Smith CE, & Grabinsky A (2012) Trauma epidemiology, mechanisms of injury. Essent Trauma Anesth 1Google Scholar
  12. 12.
    Côté JN, Raymond D, Mathieu PA, Feldman AG, Levin MF (2005) Differences in multi-joint kinematic patterns of repetitive hammering in healthy, fatigued and shoulder-injured individuals. Clin Biomech 20(6):581–590CrossRefGoogle Scholar
  13. 13.
    da Costa BR, Vieira ER (2010) Risk factors for work-related musculoskeletal disorders: a systematic review of recent longitudinal studies. Am J Ind Med 53(3):285–323Google Scholar
  14. 14.
    Da Gama A, Chaves T, Figueiredo L, Teichrieb V (2012) Poster: improving motor rehabilitation process through a natural interaction based system using kinect sensor. In: 3D User Interfaces (3DUI), 2012 I.E. Symposium on IEEE, p 145–146Google Scholar
  15. 15.
    David GC (2005) Ergonomic methods for assessing exposure to risk factors for work-related musculoskeletal disorders. Occup Med 55:190–199CrossRefGoogle Scholar
  16. 16.
    Fimland MS, Vasseljen O, Gismervik S, Rise MB, Halsteinli V, Jacobsen HB, Borchgrevink PC, Tenggren H, Johnsen R (2014) Occupational rehabilitation programs for musculoskeletal pain and common mental health disorders: study protocol of a randomized controlled trial. BMC Public Health 14(1):368CrossRefGoogle Scholar
  17. 17.
    Freivalds A, Kong Y, You H, Park S (2000) A comprehensive risk assessment model for work-related musculoskeletal disorders of the upper extremities. Proc Hum Factors Ergon Soc Annu Meet 44(31):5–728CrossRefGoogle Scholar
  18. 18.
    Gatchel RJ, Kishino ND, Strizak AM (2014). Occupational musculoskeletal pain and disability disorders: An overview. In: Handbook of Musculoskeletal Pain and Disability Disorders in the Workplace. Springer, New York, p 3–17Google Scholar
  19. 19.
    Gatchel RJ, Schultz IZ (2014) Future research directions for preventing and treating occupational musculoskeletal disorders. In: Handbook of Musculoskeletal Pain and Disability Disorders in the Workplace. Springer, New York, p 485–498Google Scholar
  20. 20.
    Gerr F, Fethke N, Merlino L, Anton D, Rosecrance J, Jones MP, Marcus M, and Meyers A (2013) A prospective study of musculoskeletal outcomes among manufacturing workers I. Effects of physical risk factors. Human Factors J Human Factors Ergon Soc 0018720813491114Google Scholar
  21. 21.
    González-Ortega D, Díaz-Pernas FJ, Martínez-Zarzuela M, Antón-Rodríguez M (2014) A kinect-based system for cognitive rehabilitation exercises monitoring. Comput Methods Prog Biomed 113(2):620–631CrossRefGoogle Scholar
  22. 22.
    Herrin GD, Jaraiedi M, Anderson CK (1986) Prediction of overexertion injuries using biomechanical and psychophysical models. Am Ind Hyg Assoc J 47(6):322–330CrossRefGoogle Scholar
  23. 23.
    Hollerbach JM, Flash T (1982) Dynamic interactions between limb segments during planar arm movement. Biol Cybern 44(1):67–77CrossRefGoogle Scholar
  24. 24.
    Kar A (2010) Skeletal tracking using microsoft kinect. Methodology 1:1–11Google Scholar
  25. 25.
    Knauf MT, Schultz IZ, Stewart AM, Gatchel RJ (2014) Models of return to work for musculoskeletal disorders: advances in conceptualization and research. In: Handbook of Musculoskeletal Pain and Disability Disorders in the Workplace. Springer, New York, p 431–452Google Scholar
  26. 26.
    Machado S, Osório R, Silva N, Magini M (2010) Biomechanical analysis of the muscular power of martial arts athletes. Med Biol Eng Comput 48(6):573–577CrossRefGoogle Scholar
  27. 27.
    Marfia G, Roccetti M, Matteucci G, Marcomini A (2012) Technoculture of handcraft: fine gesture recognition for haute couture skills preservation and transfer in Italy. ACM SIGGRAPH 2012 Posters. ACM, p 81Google Scholar
  28. 28.
    Massey T, Marfia G, Stoelting A, Tomasi R, Spirito M, Sarrafzadeh M, Pau G (2011) Leveraging social system networks in ubiquitous high-data-rate health systems. IEEE Trans Inf Technol Biomed 15(3):491–498CrossRefGoogle Scholar
  29. 29.
    McAtamney L, Corlett EN (1993) RULA e a survey method for the investigation of work-related upper limb disorders. Appl Ergon 24:91–99CrossRefGoogle Scholar
  30. 30.
    Miedema HS, Molen HF, Kuijer PPFM, Koes BW, Burdorf A (2014) Incidence of low back pain related occupational diseases in the Netherlands. Eur J Pain 18(6):873–882CrossRefGoogle Scholar
  31. 31.
    Mullineaux DR, Underwood SM, Shapiro R, Hall JW (2012) Real-time biomechanical biofeedback effects on top-level rifle shooters. Appl Ergon 43:109–114CrossRefGoogle Scholar
  32. 32.
    Mustard CA, Chambers A, Ibrahim S, Etches J, Smith P (2014). Time trends in musculoskeletal disorders attributed to work exposures in Ontario using three independent data sources, 2004–2011. Occup. Environ. Med oemed-2014Google Scholar
  33. 33.
    Ni B, Pei Y, Liang Z, Lin L, Moulin P (2013). Integrating multi-stage depth-induced contextual information for human action recognition and localization. In: Automatic Face and Gesture Recognition (FG), 2013 10th IEEE International Conference and Workshops on IEEE, p 1–8Google Scholar
  34. 34.
    Nordander C, Ohlsson K, Åkesson I, Arvidsson I, Balogh I, Hansson G, Stromberg U, Rittner R, Skerfving S (2009) Risk of musculoskeletal disorders among females and males in repetitive/constrained work. Ergonomics 52(10):1226–1239CrossRefGoogle Scholar
  35. 35.
    Osborne A, Blake C, Fullen BM, Meredith D, Phelan J, McNamara J, Cunningham C (2012) Prevalence of musculoskeletal disorders among farmers: a systematic review. Am J Ind Med 55(2):143–158CrossRefGoogle Scholar
  36. 36.
    Radwin RG, Lin ML (1993) An analytical method for characterizing repetitive motion and postural stress using spectral-analysis. Ergonomics 36:379–389CrossRefGoogle Scholar
  37. 37.
    Rainville J, Smeets RJ, Bendix T, Tveito TH, Poiraudeau S, Indahl AJ (2011) Fear-avoidance beliefs and pain avoidance in low back pain—translating research into clinical practice. Spine J 11(9):895–903CrossRefGoogle Scholar
  38. 38.
    Raja R, Kingsbury SR, Wise E, Conaghan PG (2014). Primary care approaches to musculoskeletal multiple-site joint pain pharmacological therapy: a survey of general practitioners. Prim Health Care Res Dev 1–6Google Scholar
  39. 39.
    Ray SJ, Teizer J (2012) Real-time construction worker posture analysis for ergonomics training. Adv Eng Inform 26(2):439–455CrossRefGoogle Scholar
  40. 40.
    Roccetti M, Marfia G, Semeraro A (2012) Playing into the wild: a gesture-based interface for gaming in public spaces. J Vis Commun Image Represent 23(3):426–440CrossRefGoogle Scholar
  41. 41.
    Spyropoulos E, Chroni E, Katsakiori P, Athanassiou G (2013) A quantitative approach to assess upper limb fatigue in the work field. Occup Ergon 11(1):45–57Google Scholar
  42. 42.
    van den Bogert AJ, Geijtenbeek T, Even-Zohar O, Steenbrink F, Hardin EC (2013) A real-time system for biomechanical analysis of human movement and muscle function. Med Biol Eng Comput 51(10):1069–1077CrossRefGoogle Scholar
  43. 43.
    Vignais N, Miezal M, Bleser G, Mura K, Gorecky D, Marin F (2013) Innovative system for real-time ergonomic feedback in industrial manufacturing. Appl Ergon 44:566–574CrossRefGoogle Scholar
  44. 44.
    Wang K, Wang X, Lin L, Wang M, Zuo W (2014) 3D human activity recognition with reconfigurable convolutional neural networks. In: Proceedings of the ACM International Conference on Multimedia. ACM, p 97–106Google Scholar
  45. 45.
    Yoon J, Shiekhzadeh A, Nordin M (2012) The effect of load weight vs. pace on muscle recruitment during lifting. Appl Ergon 43(6):1044–1050CrossRefGoogle Scholar
  46. 46.
    Yu W, Yu I, Li Z, Wang X, Sun T, Lin H, Xie S (2012) Work-related injuries and musculoskeletal disorders among factory workers in a major city of China. Accid Anal Prev 48:457–463CrossRefGoogle Scholar
  47. 47.
    Zhang S, Hu H, Zhou H (2008) An interactive internet-based system for tracking upper limb motion in home-based rehabilitation. Med Biol Eng Comput 46(3):241–249CrossRefGoogle Scholar
  48. 48.
    Zheng H, Black ND, Harris ND (2005) Position-sensing technologies for movement analysis in stroke rehabilitation. Med Biol Eng Comput 43(4):413–420CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.University of BolognaBolognaItaly

Personalised recommendations