Abstract
Manual handling involves transporting of load by hand through lifting or lowering and operators on the manufacturing shop floor are daily faced with constant lifting and lowering operations which leads to Work-Related Musculoskeletal Disorders. The trend in data collection on the Shop floor for ergonomic evaluation during manual handling activities has revealed a gap in gesture detection as gesture triggered data collection could facilitate more accurate ergonomic data capture and analysis. This paper presents an application developed to detect gestures towards triggering real-time human motion data capture on the shop floor for ergonomic evaluations and risk assessment using the Microsoft Kinect. The machine learning technology known as the discrete indicator—precisely the AdaBoost Trigger indicator was employed to train the gestures. Our results show that the Kinect can be trained to detect gestures towards real-time ergonomic analysis and possibly offering intelligent automation assistance during human posture detrimental tasks.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Batish, A., Singh, T.P.: MHAC—an assessment tool for analyzing manual material handling tasks. Int. J. Occup. Safety Ergon. 14(2), 223–235 (2008)
Santos-Reyes, J.R., Burciaga-Ortega, A.R.: Manual handling operations risk assessment. In: European Safety and Reliability Annual Conference, 1897–1903. Reliability, Risk and Safety: Back to the Future. ESREL 2010, Rhodes, Greece (2010)
Burciaga-Ortega, A., Santos-Reyes, J.: Manual handling risk assessment: the case of lifting and carrying operations in the construction industry. In: 10th International Conference on Probabilistic Safety Assessment and Management, vol. 2, pp. 1722–1729. Seattle, United States (2010)
Okimoto, M.L.L.R., Teixeira, E.R.: Proposed procedures for measuring the lifting task variables required by the revised NIOSH lifting equation—a case study. Int. J. Ind. Ergon. 39(1), 15–22 (2009)
Diego-Mas, J.A., Alcaide-Marzal, J.: Using Kinect™ sensor in observational methods for assessing postures at work. Appl. Ergon. 45(4), 976–985 (2014)
Plantard, P., Auvinet, E., Pierres, A.S.L., Multon, F.: Pose estimation with a Kinect for ergonomic studies: evaluation of the accuracy using a virtual Mannequin. Sensors 15(1), 1785–1803 (2015)
Duncan, G.: Kinect 1 vs. Kinect 2, a Quick Side-by-Side Reference, Channel 9, https://channel9.msdn.com/coding4fun/kinect/Kinect-1-vs-Kinect-2-a-side-by-side-reference (2014)
Martin, C.C., Burkert, D.C., Choi, K.R., Wieczorek, N.B., McGregor, P.M., Herrmann, R.A., Beling, P.A.: A real-time ergonomic monitoring system using the Microsoft Kinect. In: 2012 IEEE Systems and Information Engineering Design Symposium, SIEDS 2012, pp. 50–55. Charlottesville, VA, United States (2012)
Deros, B.M., Khamis, N.K., Mohamad, D., Kabilmiharbi, N., Daruis, D.D.I.: Investigation of oil palm harvesters’ postures using RULA analysis. In: 3rd IEEE Conference on Biomedical Engineering and Sciences: “Miri, Where Engineering in Medicine and Biology and Humanity Meet”, pp. 287–290. Kuala Lumpur, Malaysia (2015)
Hernan, U.J., Paola, R.M.: Assessment and strategic approach for ergonomic issues in critical jobs in the oil and gas workforce. In: SPE/APPEA International Conference on Health, Safety, and Environment in Oil and Gas Exploration and Production. Perth, Australia (2012)
Singh, S., Kumar, R., Kumar, U.: Applying human factor analysis tools to a railway brake and wheel maintenance facility. J. Qual. Maintenance Eng. 21(1), 89–99 (2015)
Mukhopadhyay, P., Jhodkar, D., Kumar, P.: Ergonomic risk factors in bicycle repairing units at Jabalpur. Work 51(2), 245–254 (2015)
Peppoloni, L., Filippeschi, A., Ruffaldi, E., Avizzano, C.A.: A novel wearable system for the online assessment of risk for biomechanical load in repetitive efforts. Int. J. Ind. Ergon. 52, 1–11 (2016)
Prabhu, V.A., Tiwari, A., Hutabarat, W., Turner, C.: Monitoring and Digitising Human-Workpiece Interactions During a Manual Manufacturing Assembly Operation using Kinect. 572, 609–612 (2014)
Paliyawan, P., Nukoolkit, C., Mongkolnam, P.: Office workers syndrome monitoring using Kinect. In: Proceedings of the 20th Asia-Pacific Conference on Communication, pp. 58–63 (2015)
Uribe-Quevedo, A., Perez-Gutierrez, B., Guerrero-Rincon, C.: Seated tracking for correcting computer work postures. In: Proceedings—29th Southern Biomedical Engineering Conference, p. 169 (2013)
Clark, R.A., Pua, Y., Fortin, K., Ritchie, C., Webster, K.E., Denehy, L., Bryant, A.L.: Validity of the Microsoft Kinect for assessment of postural control. Gait & Posture 36(3), 372–377 (2012)
Delpresto, J., Duan, C., Layiktez, L.M., Moju-Igbene, E.G., Wood, M.B., Beling, P.A.: Safe lifting: an adaptive training system for factory workers using the Microsoft Kinect. In: IEEE Systems and Information Engineering Design Symposium, SIEDS 2013, pp. 64–69 (2013)
Daphalapurkar, C.P.: Development of KinectTR Applications for Assembly Simulation and Ergonomic Analysis. Masters Theses. Paper 7287 (2012)
Nguyen, D., Kleinsorge, M., Postawa, A., Wolf, K., Scheumann, R., Krüger, J., Seliger, G.: Human centric automation: using marker-less motion capturing for ergonomics analysis and work assistance in manufacturing processes. In: 11th Global Conference on Sustainable Manufacturing, pp. 586–592 (2013)
Lower, B.: Custom Gesture End to End with Kinect and Visual Gesture Builder. Video Tutorial, Channel 9, https://channel9.msdn.com/Blogs/k4wdev/Custom-Gestures-End-to-End-with-Kinect-and-Visual-Gesture-Builder (2014)
Visual Gesture Builder: A Data-Driven Solution to Gesture Detection. Microsoft (2013)
Acknowledgments
The authors would like to acknowledge the Petroleum Technology Development Fund, PTDF Nigeria for supporting this work by sponsoring the PhD of one of the authors.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Mgbemena, C.E. et al. (2016). Gesture Detection Towards Real-Time Ergonomic Analysis for Intelligent Automation Assistance. In: Schlick, C., Trzcieliński, S. (eds) Advances in Ergonomics of Manufacturing: Managing the Enterprise of the Future. Advances in Intelligent Systems and Computing, vol 490. Springer, Cham. https://doi.org/10.1007/978-3-319-41697-7_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-41697-7_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-41696-0
Online ISBN: 978-3-319-41697-7
eBook Packages: EngineeringEngineering (R0)