Detection of early dangerous state in deep water of indoor swimming pool based on surveillance video

Abstract

This paper presents a method for early detection of dangerous condition in the deep-water zone of swimming pool based on video surveillance. We propose feature extraction, feature expression and assessment criteria, including a method for evaluating normal swimming speed based on the time series of swimmers, a method for assessing an upright state that is not limited by the camera angle, and the rules for assessing dangerous state. We have collected real-life data from the swimming pool and conducted related experiments. Our method can easily and efficiently detect the swimmer who is in danger at an early stage and provide necessary rescue reminders to lifeguards.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig.10
Fig. 11
Fig. 12
Fig. 13

References

  1. 1.

    Delgado-Gonzalo, R., et al.: Real-time monitoring of swimming performance. In: 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 4743–4746, (2016) https://doi.org/10.1109/EMBC.2016.7591787

  2. 2.

    Kulkarni, A., Lakhani, K., Lokhande S.: A sensor based low cost drowning detection system for human life safety. In: 2016 5th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO), pp. 301–306, (2016) https://doi.org/10.1109/ICRITO.2016.7784970

  3. 3.

    Kharrat, M., Wakuda, Y., Koshizuka, N., Sakamura K.: Near drowning pattern detection using neural network and pressure information measured at swimmer’s head level. In: Proceedings of the Seventh ACM International Conference on Underwater Networks and Systems - WUWNet ’12, Los Angeles, California, p. 1, (2012) https://doi.org/10.1145/2398936.2398994

  4. 4.

    Hariharan, B., Das, R.N., Arjun, S.: WiEyeTNB: a wireless sensor based drowning detection system for enhanced parental care. Wirel. Internet 98, 511–520 (2012). https://doi.org/10.1007/978-3-642-30493-4_49

    Article  Google Scholar 

  5. 5.

    Lu, W., Tan, Y-P.: A camera-based system for early detection of drowning incidents. In: Proceedings. International Conference on Image Processing, Toronto, Ont., Canada, vol. 1, p. III-445–III-448, (2003) https://doi.org/10.1109/ICIP.2002.1039001

  6. 6.

    Lu, W., Tan, Y-P.: Swimmer motion analysis with application to drowning detection. In: 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353), vol. 2, p. II–II, (2002) https://doi.org/10.1109/ISCAS.2002.1011439

  7. 7.

    Eng, H.L., Toh, K., Wang, J., Yau, W.Y.: An automatic drowning detection surveillance system for challenging outdoor pool environments. In: Proceedings Ninth IEEE International Conference on Computer Vision, vol.1, pp. 532–539, (2003) https://doi.org/10.1109/ICCV.2003.1238393

  8. 8.

    Eng, H., Toh, K., Yau, W., Wang, J.: DEWS: a live visual surveillance system for early drowning detection at pool. IEEE Trans. Circuits Syst. Video Technol. 18(2), 196–210 (2008). https://doi.org/10.1109/TCSVT.2007.913960

    Article  Google Scholar 

  9. 9.

    Liu, Y., Cheng, M.-M., Hu, X., Wang, K., Bai, X.: Richer convolutional features for edge detection. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, pp. 5872–5881, (2017). https://doi.org/10.1109/CVPR.2017.622

  10. 10.

    Girshick, R.: Fast R-CNN. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 1440–1448, (2015). https://doi.org/10.1109/ICCV.2015.169

  11. 11.

    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017). https://doi.org/10.1109/TPAMI.2016.2577031

    Article  Google Scholar 

  12. 12.

    Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779–788 (2016). https://doi.org/10.1109/CVPR.2016.91

  13. 13.

    Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, pp. 6517–6525, (2017) https://doi.org/10.1109/CVPR.2017.690.

  14. 14.

    Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement. arXiv e-prints, (2018)

  15. 15.

    Liu, W., et al.: SSD: single shot multibox detector. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) Computer Vision – ECCV 2016, vol. 9905, pp. 21–37. Springer International Publishing, Cham (2016)

    Chapter  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Weidong Zhang.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wang, F., Ai, Y. & Zhang, W. Detection of early dangerous state in deep water of indoor swimming pool based on surveillance video. SIViP (2021). https://doi.org/10.1007/s11760-021-01953-y

Download citation

Keywords

  • Surveillance video
  • Dangerous state detection
  • Swimming pool