Skip to main content
SpringerLink
Log in

Potential escalator-related injury identification and prevention based on multi-module integrated system for public health

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Escalator-related injuries threaten public health with the widespread use of escalators. The existing studies tend to focus on after-the-fact statistics, reflecting on the original design and use of defects to reduce the impact of escalator-related injuries, but few attention has been paid to ongoing and impending injuries. In this study, a multi-module escalator safety monitoring system based on computer vision is designed and proposed to simultaneously monitor and deal with three major injury triggers, including losing balance, not holding on to handrails and carrying large items. The escalator identification module is utilized to determine the escalator region, namely the region of interest. The passenger monitoring module is leveraged to estimate the passengers’ pose to recognize unsafe behaviors on the escalator. The dangerous object detection module detects large items that may enter the escalator and raises alarms. The processing results of the above three modules are summarized in the safety assessment module as the basis for the intelligent decision of the system. The experimental results demonstrate that the proposed system has good performance and great application potential.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Al-Kodmany, K.: Tall buildings and elevators: a review of recent technological advances. Buildings 5(3), 1070–1104 (2015)

    Article  Google Scholar 

  2. Ayres, T.J.: Video data for escalator accidents. In: Proceedings of the human factors and ergonomics society annual meeting, pp. 1839–1843. SAGE Publications Sage CA: Los Angeles, CA (2019)

  3. Bochkovskiy, A., Wang, C.Y., Liao, H.Y.M.: Yolov4: Optimal speed and accuracy of object detection. arXiv preprint arXiv:2004.10934 (2020)

  4. Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., Sheikh, Y.: Openpose: realtime multi-person 2d pose estimation using part affinity fields. IEEE Trans. Pattern Anal. Mach. Intell. 43(1), 172–186 (2019)

    Article  Google Scholar 

  5. Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., Xu, J., Zhang, Z., Cheng, D., Zhu, C., Cheng, T., Zhao, Q., Li, B., Lu, X., Zhu, R., Wu, Y., Dai, J., Wang, J., Shi, J., Ouyang, W., Loy, C.C., Lin, D.: MMDetection: Open mmlab detection toolbox and benchmark. arXiv preprint arXiv:1906.07155 (2019)

  6. Chen, Z., Xian, J.: 609 Eescalator-related injuries against preschoolers: an in-depth investigation in Guangdong Province, China (2016)

  7. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, pp. 248–255. Ieee (2009)

  8. Fang, H.S., Xie, S., Tai, Y.W., Lu, C.: RMPE: Regional multi-person pose estimation. In: ICCV (2017)

  9. Ghafoorian, M., Nugteren, C., Baka, N., Booij, O., Hofmann, M.: El-gan: Embedding loss driven generative adversarial networks for lane detection. In: Proceedings of the European conference on computer vision (ECCV), pp. 0–0 (2018)

  10. Hou, Y., Ma, Z., Liu, C., Loy, C.C.: Learning lightweight lane detection cnns by self attention distillation. In: Proceedings of the IEEE international conference on computer vision, pp. 1013–1021 (2019)

  11. Huo, M., Li, X., Wei, G., Zhao, C.: Application research of escalators status monitor and forecast based on vibration analysis. In: International conference on electrical and information technologies for rail transportation, pp. 419–428. Springer (2019)

  12. Jaderberg, M., Simonyan, K., Zisserman, A., et al.: Spatial transformer networks. Adv. Neural Inf. Process. Syst. 28, 2017–2025 (2015)

    Google Scholar 

  13. Kim, B.S., Park, P.: A study on the safety management plan to prevent safety accident escalator user. J. Korea Saf. Manag. Sci. 22(1), 45–50 (2020)

  14. Lee, C., Moon, J.H.: Robust lane detection and tracking for real-time applications. IEEE Trans. Intell. Transp. Syst. 19(12), 4043–4048 (2018)

    Article  Google Scholar 

  15. Li, G., Yang, J., Kang, Z.: Pedestrian detection algorithm based on improved yolov3_tiny. In: Proceedings of 2021 Chinese intelligent automation conference, pp. 98–106. Springer (2022)

  16. Li, J., Wang, C., Zhu, H., Mao, Y., Fang, H.S., Lu, C.: Crowdpose: Efficient crowded scenes pose estimation and a new benchmark. arXiv preprint arXiv:1812.00324 (2018)

  17. Li, Z., Ma, H., Xu, P., Peng, Q., Huang, G., Liu, Y.: Prediction model and experimental study on braking distance under emergency braking with heavy load of escalator. Math. Prob. Eng. (2020). https://doi.org/10.1155/2020/7141237

    Article  Google Scholar 

  18. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 2117–2125 (2017)

  19. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., Zitnick, C.L.: Microsoft coco: Common objects in context. In: European conference on computer vision, pp. 740–755. Springer (2014)

  20. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., Berg, A.C.: Ssd: Single shot multibox detector. In: European conference on computer vision, pp. 21–37. Springer (2016)

  21. Liu, Z., Xie, Y., Zhang, H.: Simulation of passenger behavior and crowd stampede risk on escalator. J. Intell. Fuzzy Syst. 37(3), 3525–3533 (2019)

    Article  Google Scholar 

  22. Mays, C.: Going up: riding the risk escalator with Ortwin. J. Risk Res. 24, 47 (2020)

    Article  Google Scholar 

  23. Narote, S.P., Bhujbal, P.N., Narote, A.S., Dhane, D.M.: A review of recent advances in lane detection and departure warning system. Pattern Recogn. 73, 216–234 (2018)

    Article  Google Scholar 

  24. Neven, D., De Brabandere, B., Georgoulis, S., Proesmans, M., Van Gool, L.: Towards end-to-end lane detection: an instance segmentation approach. In: 2018 IEEE intelligent vehicles symposium (IV), pp. 286–291. IEEE (2018)

  25. Newell, A., Yang, K., Deng, J.: Stacked hourglass networks for human pose estimation. In: European conference on computer vision, pp. 483–499. Springer (2016)

  26. Platt, S.L., Fine, J.S., Foltin, G.L.: Escalator-related injuries in children. Pediatrics 100(2), e2–e2 (1997)

    Article  Google Scholar 

  27. Qin, Z., Wang, H., Li, X.: Ultra fast structure-aware deep lane detection. arXiv preprint arXiv:2004.11757 (2020)

  28. Ren, F., Song, Y., Liang, X.: Failure analysis of escalator step. MS&E 423(1), 012125 (2018)

    Google Scholar 

  29. Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2016)

    Article  Google Scholar 

  30. Wang, Z., Bhamra, R.S., Wang, M., Xie, H., Yang, L.: Critical hazards identification and prevention of cascading escalator accidents at metro rail transit stations. Int. J. Environ. Res. Public Health 17(10), 3400 (2020)

    Article  Google Scholar 

  31. Wu, Y., Kirillov, A., Massa, F., Lo, W.Y., Girshick, R.: Detectron2. https://github.com/facebookresearch/detectron2 (2019)

  32. Xie, K., Liu, Z.: Factors influencing escalator-related incidents in china: a systematic analysis using ism-dematel method. Int. J. Environ. Res. Public Health 16(14), 2478 (2019)

    Article  Google Scholar 

  33. Xing, Y., Chen, S., Zhu, S., Lu, J.: Analysis factors that influence escalator-related injuries in metro stations based on bayesian networks: a case study in china. Int. J. Environ. Res. Public Health 17(2), 481 (2020)

  34. Xing, Y., Dissanayake, S., Lu, J., Long, S., Lou, Y.: An analysis of escalator-related injuries in metro stations in China, 2013–2015. Accid. Anal. Prev. 122, 332–341 (2019)

  35. Xiu, Y., Li, J., Wang, H., Fang, Y., Lu, C.: Pose Flow: Efficient online pose tracking. In: BMVC (2018)

  36. Zhang, X.: Large-scale escalator risk assessment technology coupling model. DEStech Trans. Comput. Sci. Eng. (2018)

  37. Zhou, Z., Zi, Y., Chen, J., An, T.: Hazard analysis for escalator emergency braking system via system safety analysis method based on stamp. Appl. Sci. 9(21), 4530 (2019)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the financial support from GDAS’ Project of Science and Technology Development (Grant Nos. 2020GDASYL-20200302015, 2021GDASYL-20210103090) and Key-Area Research and Development Program of Guangdong Province (Grant No. 2018B010108006).

Author information

Authors and Affiliations

  1. Institute of Intelligent Manufacturing, Guangdong Academy of Sciences, Guangzhou, China

    Zeyu Jiao, Huan Lei & Zhenyu Zhong

  2. China Aerospace Academy of Systems Science and Engineering, Beijing, China

    Hengshan Zong

  3. Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China

    Yingjie Cai

Authors
  1. Zeyu Jiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Huan Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hengshan Zong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yingjie Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhenyu Zhong
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yingjie Cai.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jiao, Z., Lei, H., Zong, H. et al. Potential escalator-related injury identification and prevention based on multi-module integrated system for public health. Machine Vision and Applications 33, 29 (2022). https://doi.org/10.1007/s00138-022-01273-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00138-022-01273-2

Keywords

Search

Navigation