Inferential Motion Reconstruction of Fall Accident Based on LSTM Neural Network

  • Yao-Chung Chang
  • Ying Hsun Lai
  • Tien-Chi Huang
Original Article


With the rapid development of wearable technology, wearable medical devices have gradually garnered a significant amount of research interest. Motion reconstruction can accurately reproduce the posture of the user at the time of the accident, which provides medical personnel with necessary reference information. However, because of the vast range of human body activities, motion reconstruction needs high-frequency sampling data to avoid the occurrence of errors. Moreover, the fact that movements resulting from an accident can be irregular, the difficulties arising from unexpected training samples. This study attempts to establish a real-time human body inferential motion reconstruction system on fall accident. The data of human motion is recorded by using tri-axis accelerometers and tri-axis gyroscopes. The angles and tracks of the human limbs computed, and the next action occurrence point deduced using long short-term memory. Then the postural trajectory is corrected using feedback inference of gravity data from the end of a fall accident. Through the correction mechanism of bidirectional feedback, the error diffusion caused can reduce efficiency. In this study, using a parameter adjustment strategy under data sampling rate of 0.01 s, the average normal-m reconstruction rate, as well as the fall-motion reconstruction rate, can be determined. The overall posture is reproduced through the 3D video to ambulance personnel as a reference.


Motion reconstruction Long short-term memory Wearable medical 



Funding was provided by Ministry of Science and Technology, Taiwan (Grant Number 106-2511-S-025-003-MY3).


  1. 1.
    Fonad, E., Wahlin, T. B., Winblad, B., Emami, A., & Sandmark, H. (2008). Falls and fall risk among nursing home residents. Journal of Clinical Nursing, 17(1), 126–134.CrossRefGoogle Scholar
  2. 2.
    Laessoe, U., Hoeck, H. C., Simonsen, O., Sinkjaer, T., & Voigt, M. (2007). Fall risk in an active elderly population-can it be assessed? Jounal of Negative Results in Biomedicine, 6, 2–13.CrossRefGoogle Scholar
  3. 3.
    Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems 25.Google Scholar
  4. 4.
    Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780.CrossRefGoogle Scholar
  5. 5.
    Sposaro, F., & Tyson, G. (2009). iFall: An android application for fall monitoring and response. In Proceeding of annual international conference of the IEEE engineering in medicine and biology society, Minneapolis, USAGoogle Scholar
  6. 6.
    Nyana, M. N., Taya, Francis E. H., & Murugasuc, E. (2008). A wearable system for pre-impact fall detection. Journal of Biomechanics, 41(16), 3475481.Google Scholar
  7. 7.
    Dai, J., Bai, X., Yang, Z., Shen, Z., & Xuan, D. (2010). PerFallD: A pervasive fall detection system using mobile phones. In Proceeding of 8th IEEE international conference on pervasive computing and communications workshops, Mannheim Germany.Google Scholar
  8. 8.
    Lin, C. S., Hsu, H. C., Chiu, C. C., Lin, S. L., & Chao, C. S. (2006). A PDA based wearable system for real-time monitoring of human falls. IETE Journal of Research, 52(6), 403–416.CrossRefGoogle Scholar
  9. 9.
    Lindemann, U., Hock, A., & Stuber, M. (2005). Evaluation of a fall detector based on accelerometers: A pilot study. Medical & Biological Engineering & Computing, 43(5), 548–551.CrossRefGoogle Scholar
  10. 10.
    Yang, C. C., & Hsu, Y. L. (2006). Development of a portable system for physical activity assessment in a home environment. In Proceeding of international computer symposium (pp. 1339–1344), Taipei, Taiwan.Google Scholar
  11. 11.
    Wang, C. C., Chiang, C. Y., Lin, P. Y., Chou, Y. C., Kuo, I.-T., Huang, C. N., & Chan, C. T. (2008) Development of a fall detecting system for the elderly residents. In Proceeding of the 2nd international conference on bioinformatics and biomedical engineering (pp. 1359–1362), Shanghai, ChinaGoogle Scholar
  12. 12.
    Delahoz, Y. S., & Labrador, M. A. (2014). Survey on fall detection and fall prevention using wearable and external sensors. Sensors, 14(10), 19806–19842.CrossRefGoogle Scholar
  13. 13.
    Shi, Y., Shi, Y. C., & Wang, X. (2012). Fall detection on mobile phones using features from a five-phase model. In Proceeding of 9th International Conference on Ubiquitous Intelligence and Computing and Autonomic and Trusted Computing (pp. 951–956), Fukuoka, JapanGoogle Scholar
  14. 14.
    Sengto, A., & Leauhatong, T. (2012). Human falling detection algorithm using back propagation neural network. In Proceeding of 5th Biomedical Engineering International Conference (pp. 1–5). Thailand: Ubon Ratchathani.Google Scholar
  15. 15.
    Zhang, C., Lai, C. F., Lai, Y. H., Wu, Z. W., & Chao, H. C. (2017). An inferential real-time falling posture reconstruction for Internet of healthcare things. Journal of Network and Computer Applications, 89, 86–95.CrossRefGoogle Scholar
  16. 16.
    Chiang, J. C. (2009). Adaptive collaborative multi-sensor devices to detect body position. Master’s Thesis of Department of Engineering Sciences, National Cheng Kung University.Google Scholar
  17. 17.
    Graves, A., & Schmidhuber, J. (2009). Offline handwriting recognition with multidimensional recurrent neural networks. In Advances in neural information processing systems (pp. 1–8)Google Scholar
  18. 18.
    Graves, A., Mohamed, A.-R., & Hinton, G. (2013). Speech recognition with deep recurrent neural networks. In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 6645–6649), Vancouver, BC, Canada, May 2013.Google Scholar
  19. 19.
    Zhou, C., Sun, C., Liu, Z., & Lau, F. (2015). A C-LSTM neural network for text classification. arXiv:1511.08630v2
  20. 20.
    Chen, Y., Cheng, B., & Cheng, X. (2016). Food safety document classification using LSTM-based ensemble learning. Revista Técnica de la Facultad de Ingeniería Universidad del Zulia, 39(10), 172–178.MathSciNetGoogle Scholar
  21. 21.
    Rubinstein, R. Y., & Kroese, D. P. (2004). The cross-entropy method: A unified approach to combinatorial optimization, Monte-Carlo simulation, and machine learning. New York: Springer.CrossRefzbMATHGoogle Scholar
  22. 22.
    Bottou, L. (2010). Large-scale machine learning with stochastic gradient descent. In Proceedings of COMPSTAT’2010 (pp. 177–186). New York: Springer.Google Scholar
  23. 23.
    Ruder, S. (2016). An overview of gradient descent optimization algorithms. CoRR arXiv:1609.04747
  24. 24.
    Riedmiller, M., Braun, H. (1992). RPROP-A fast adaptive learning algorithm. In Proceedings of the ISCIS VII, Universitat.Google Scholar
  25. 25.
    Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15(1), 1929–1958.MathSciNetzbMATHGoogle Scholar
  26. 26.
    Jian G., & Stephen G. (2016). Depth Dropout: Efficient Training of Residual Convolutional Neural Networks. In Proceeding of 2016 International Conference on Digital Image Computing: Techniques and Applications (pp. 1–7). Gold Coast, QLD, Australia, Dec.Google Scholar
  27. 27.
    Hecht-Nielsen, R. (1988). Theory of the backpropagation neural network. Neural Networks, 1, 445.CrossRefGoogle Scholar

Copyright information

© Taiwanese Society of Biomedical Engineering 2018

Authors and Affiliations

  • Yao-Chung Chang
    • 1
  • Ying Hsun Lai
    • 1
  • Tien-Chi Huang
    • 2
  1. 1.Department of Computer Science and Information EngineeringNational Taitung UniversityTaitungTaiwan, ROC
  2. 2.Department of Information ManagementNational Taichung University of Science and TechnologyTaichungTaiwan, ROC

Personalised recommendations