Abstract
When suddenly falling to the ground, elderly people can get seriously injured. This paper presents a vision-based fall detection approach by using a low-cost depth camera. The approach is based on a novel combination of three feature types: curvature scale space (CSS), morphological, and temporal features. CSS and morphological features capture different properties of human silhouette during the falling procedure. All the two collected feature vectors are clustered to generate occurrence histogram as fall representations. Meanwhile, the trajectory of a skeleton point that depicts the temporal property of fall action is used as a complimentary representation. For each individual feature, ELM classifier is trained separately for fall prediction. Finally, their prediction scores are fused together to decide whether fall happens or not. For evaluating the approach, we built a depth dataset by capturing 6 daily actions (falling, bending, sitting, squatting, walking, and lying) from 20 subjects. Extensive experiments show that the proposed approach achieves an average 85.89% fall detection accuracy, which apparently outperforms using each feature type individually.
This work was supported in part by the National High Technology Research and Development Program of China under Grant No. 2015AA042307, Shandong Province Science and Technology Development Foundation under Grant No. 2014GGE27572, Shandong Province Independent Innovation and Achievement Transformation Special Fund under Grant No. 2014ZZCX04302, the Fundamental Research Funds of Shandong University under Grant No. 2015JC027, 2015JC051.
Chapter PDF
Similar content being viewed by others
References
Shany, T., Redmond, S., Narayanan, M., Lovell, N.: Sensors-based wearable systems for monitoring of human movement and falls. IEEE Sensors Journal 12(3), 658–670 (2012)
Doukas, C., Maglogiannis, I.: Emergency fall incidents detection in assisted living environments utilizing motion, sound, and visual perceptual components. IEEE Transactions on Information Technology in Biomedicine 15(2), 277–289 (2011)
Popoola, O., Wang, K.: Video-based abnormal human behavior recognition-a review. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 42(6), 865–878 (2012)
Yu, M., Naqvi, S., Rhuma, A., Chambers, J.: One class boundary method classifiers for application in a video-based fall detection system. IET Computer Vision 6(2), 90–100 (2012)
Auvinet, E., Multon, F., Saint-Arnaud, A., Rousseau, J., Meunier, J.: Fall detection with multiple cameras: An occlusion-resistant method based on 3-d silhouette vertical distribution. IEEE Transactions on Information Technology in Biomedicine 15(2), 290–300 (2011)
Planinc, R., Kampel, M.: Introducing the use of depth data for fall detection. Personal and Ubiquitous Computing 17(6), 1063–1072 (2013)
Nghiem, A.T., Auvinet, E., Meunier, J.: Head detection using kinect camera and its application to fall detection. In: Proceedings of the 11th International Conference on Information Science, Signal Processing and their Applications, pp. 164–169 (2012)
Parra-Dominguez, G., Taati, B., Mihailidis, A.: 3D human motion analysis to detect abnormal events on stairs. In: Proceedings of the Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, pp. 97–103 (2012)
Ma, X., Wang, H., Xue, B., Zhou, M., Ji, B., Li, Y.: Depth-based human fall detection via shape features and improved extreme learning machine. IEEE Journal of Biomedical and Health Informatics 18(6), 1915–1922 (2014)
Mirmahboub, B., Samavi, S., Karimi, N., Shirani, S.: Automatic monocular system for human fall detection based on variations in silhouette area. IEEE Transactions on Biomedical Engineering 60(2), 427–436 (2013)
Mokhtarian, F.: Silhouette-based isolated object recognition through curvature scale space. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(5), 539–544 (1995)
Huang, G.-B., Zhu, Q.-Y., Siew, C.-K.: Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of IEEE International Joint Conference on Neural Networks, vol. 2, pp. 985–990 (2004)
Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2 (1999)
Ding, L., Goshtasby, A.: On the canny edge detector. Pattern Recognition 34(3), 721–725 (2001)
Mokhtarian, F., Mackworth, A.K.: A theory of multiscale, curvature-based shape representation for planar curves. IEEE Transactions on Pattern Analysis and Machine Intelligence 14(8), 789–805 (1992)
Fei-Fei, L., Perona, P.: A bayesian hierarchical model for learning natural scene categories. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 524–531 (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ma, X., Wang, H., Xue, B., Li, Y. (2015). Spatial-Temporal Feature Fusion for Human Fall Detection. In: Zha, H., Chen, X., Wang, L., Miao, Q. (eds) Computer Vision. CCCV 2015. Communications in Computer and Information Science, vol 546. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-48558-3_44
Download citation
DOI: https://doi.org/10.1007/978-3-662-48558-3_44
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-662-48557-6
Online ISBN: 978-3-662-48558-3
eBook Packages: Computer ScienceComputer Science (R0)
