Human Fall Detection Using Temporal Templates and Convolutional Neural Networks

  • Earnest Paul IjjinaEmail author
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1090)


The emerging areas of smart homes and smart cities need efficient approaches to monitor human behavior in order to assist them in their activities of daily living. The rapid growth in technology led to the use of depth information for privacy-preserving video surveillance, thereby making depth-based automatic video surveillance, a major area of research in academic and industrial communities. In this work, a temporal template representation of depth video is used for human action recognition using convolutional neural networks. A new temporal template representation capturing the spatial occupancy of the subject for a given time-period is proposed to recognize human actions. The ConvNet features extracted from these temporal templates that capture the local discriminative features of these actions are used for action detection. The efficacy of the proposed approach is demonstrated on SDUFall dataset.


Human action Recognition Temporal template Convolution Neural network 


  1. 1.
    Wang, J., Y. Chen, S. Hao, X. Peng, and L. Hu. 2018. Deep Learning for Sensor-Based Activity Recognition: A Survey. Pattern Recognition Letters.Google Scholar
  2. 2.
    Cheena, M. 2016. Fall Detection Using Smartphone Audio Features. IEEE Journal of Biomedical and Health Informatics 20(4): 1073–1080.Google Scholar
  3. 3.
    Kau, L.J., and C.S. Chen. 2015. A Smart Phone-Based Pocket Fall Accident Detection, Positioning, and Rescue System. IEEE Journal of Biomedical and Health Informatics 19(1): 44–56.Google Scholar
  4. 4.
    Cheng, J., X. Chen, and M. Shen. 2013. A Framework For Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals. IEEE Journal of Biomedical and Health Informatics 17(1): 38–45.Google Scholar
  5. 5.
    Cheng, W.C., and D.M. Jhan. 2013. Triaxial Accelerometer-Based Fall Detection Method Using A Self-Constructing Cascade-AdaBoost-SVM Classifier. IEEE Journal of Biomedical and Health Informatics 17(2): 411–419.Google Scholar
  6. 6.
    Garripoli, C., M. Mercuri, P. Karsmakers, P.J. Soh, G. Crupi, G.A.E. Vandenbosch, C. Pace, P. Leroux, and D. Schreurs. 2015. Embedded DSP-Based Telehealth Radar System for Remote in-Door Fall Detection. IEEE Journal of Biomedical and Health Informatics 19(1): 92–101.Google Scholar
  7. 7.
    Aguilar, P.A.C., J. Boudy, D. Istrate, B. Dorizzi, and J.C.M. Mota. 2014. A Dynamic Evidential Network for Fall Detection. IEEE Journal of Biomedical and Health Informatics 18(4): 1103–1113.Google Scholar
  8. 8.
    Lai, C.F., M. Chen, J.S. Pan, C.H. Youn, and H.C. Chao. 2014. A Collaborative Computing Framework of Cloud Network and WBSN Applied to Fall Detection and 3-D Motion Reconstruction. IEEE Journal of Biomedical and Health Informatics 18(2): 457–466.Google Scholar
  9. 9.
    Lo, G., S. Gonzlez-Valenzuela, and V.C.M. Leung. 2013. Wireless Body Area Network Node Localization Using Small-Scale Spatial Information. IEEE Journal of Biomedical and Health Informatics 17(3): 715–726.Google Scholar
  10. 10.
    Mousse, Mikael A., C. Motamed, and E.C Ezin. 2017. Percentage of Human-Occupied Areas for Fall Detection from Two Views. The Visual Computer 33(12): 1529–1540.Google Scholar
  11. 11.
    Bian, Z.P., J. Hou, L.P. Chau, and N. Magnenat-Thalmann. 2015. Fall Detection Based on Body Part Tracking Using a Depth Camera. IEEE Journal of Biomedical and Health Informatics 19(2): 430–439.Google Scholar
  12. 12.
    Stone, E.E., and M. Skubic. 2015. Fall Detection in Homes of Older Adults Using the Microsoft Kinect. IEEE Journal of Biomedical and Health Informatics 19(1): 290–301.Google Scholar
  13. 13.
    Ma, X., H. Wang, B. Xue, M. Zhou, B. Ji, and Y. Li. 2014. Depth-Based Human Fall Detection Via Shape Features and Improved Extreme Learning Machine. IEEE Journal of Biomedical and Health Informatics 18(6): 1915–1922.Google Scholar
  14. 14.
    Yu, M., Y. Yu, A. Rhuma, S.M.R. Naqvi, L. Wang, and J.A. Chambers. 2013. An Online One Class Support Vector Machine-Based Person-Specific Fall Detection System for Monitoring an Elderly Individual in A Room Environment. IEEE Journal of Biomedical and Health Informatics 17 (6): 1002–1014.CrossRefGoogle Scholar
  15. 15.
    Krizhevsky, A., I. Sutskever, and G.E. Hinton. 2012. Imagenet Classification With Deep Convolutional Neural Networks. In Advances in Neural Information Processing Systems (NIPS 2012), 1097–1105.Google Scholar
  16. 16.
    Cortes, C., and V. Vapnik. 1995. Support Vector Networks. Machine Learning 20 (3): 273–297.zbMATHGoogle Scholar
  17. 17.
    Lecun, Y., L. Bottou, Y. Bengio, and P. Haner. 1998. Gradient-Based Learning Applied to Document Recognition. In Proceedings of IEEE 86(11): 2278–2324.Google Scholar
  18. 18.
    Huang, G. B., Q. Zhu, and C. Siew. 2006. Extreme Learning Machine: Theory and Applications. Neurocomputing 70 (13): 489–501.Google Scholar
  19. 19.
    Aslan, M., A. Sengur, Y. Xiao, H. Wang, M.C. Ince, and X. Ma. 2015. Shape Feature Encoding Via Fisher Vector for Efficient Fall Detection in Depth-Videos. Applied Soft Computing 37: 1023–1028.CrossRefGoogle Scholar
  20. 20.
    Aslan, M., O.F. Alin, A. Sengr, and M.C. Ince. 2015. Fall Detection With Depth-Videos. In Proceedings of IEEE Signal Processing and Communications Applications Conference (SIU), 443–446.Google Scholar
  21. 21.
    Akagunduz, E., M. Aslan, A. Sengur, H. Wang, and M. Ince. 2016. Silhouette Orientation Volumes for Efficient Fall Detection in Depth Videos. IEEE Journal of Biomedical and Health Informatics 99: 1–8.Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringNational Institute of Technology WarangalWarangalIndia

Personalised recommendations