A Robust Video-Based Algorithm for Detecting Snow Movement in Traffic Scenes

Abstract

Video-based Automatic Incident Detection (AID) systems are widely deployed in many cities for detecting traffic incidents to provide smoother, safer and congestion free traffic flow. However, the accuracy of an AID system operating in an outdoor environment suffers from high false alarm rates due to environmental factors. These factors include snow movement, static shadow and static glare on the roads. In this paper, a robust real-time algorithm is proposed to detect snow movement in video streams to improve the rate of detection. This is done by having the AID system reducing its sensitivity in the areas that have snow movements. The feasibility of the proposed algorithm has been evaluated using traffic videos captured from several cameras at the City of Calgary.

This is a preview of subscription content, log in to check access.

Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20

References

  1. 1.

    Transport Canada (1999). An Intelligent Transportation Systems (ITS) Plan For Canada: En Route To Intelligent Mobility, Technical Report, Nov. 1999.

  2. 2.

    Transport Canada (2005). Evaluation of a system for automatically detecting incidents by processing video images from existing cameras monitoring highways, May 13, 2005.

  3. 3.

    Garg, K., & Nayer, S. K. (2004). Detection and removal of rain from videos. In 2004 IEEE computer society conference on computer vision and pattern recognition (CVPR 2004) (Vol. 1, pp. 528–535). Washington, DC, USA, June 27–July 2, 2004.

  4. 4.

    Cheung, S.-C. S., & Kamath, C. (2005). Robust background subtraction with foreground validation for urban traffic video. EURASIP Journal on Applied Signal Processing, 2005(14), 2330–2340.

    MATH  Article  Google Scholar 

  5. 5.

    Cheung, S.-C. S., & Kamath, C. (2004). Robust techniques for background subtraction in urban traffic video. In video communications and image processing, SPIE electronic imaging (pp. 881–892). San Jose, USA, January 2004.

  6. 6.

    Mahmassain, H. S., Haas, C., Zhou, S., & Peterman, J. (1998). Evaluation for incident detection methodologies. Centre for Transportation Research, University of Texas at Austin, Oct. 1998.

  7. 7.

    Parkany, E., & Xie, C. (2005). A complete review of incident detection algorithms & Their deployment: What works and what doesn’t. New England Transport Consortium, Feb. 7, 2005.

  8. 8.

    Huertas, A., Matthies, L., & Rankin, A. (2005). Stereo-based tree traversability analysis for autonomous off-road navigation. In 7th IEEE workshop on applications of computer vision/IEEE workshop on motion and video computing (WACV/MOTION 2005) (Vol. 1, pp. 210–217). Breckenridge, Colourado, USA, January 5–7, 2005.

  9. 9.

    Salvador, E., Cavallaro, A., & Ebrahimi, T. (2004). Cast shadow segmentation using invariant colour features. Computer Vision and Image Understanding, 95(2), 238–259 (Aug).

    Article  Google Scholar 

  10. 10.

    Cucchiara, R., Grana, C., Piccardi, M., & Prati, A. (2003). Detecting moving objects, ghosts, and shadows in video streams. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10), 1337–1342 (Oct).

    Article  Google Scholar 

  11. 11.

    Cavallaro, A., Salvador, E., & Ebrahimi, T. (2004). Detecting shadows in image sequences. 1st European Conference on Visual Media Production (CVMP) (pp. 165–174). London, UK, March 15–16, 2004.

  12. 12.

    Gupte, S., Masoud, O., Martin, R. F. K., & Papanikolopoulos, N. P. (2002). Detection and classification of vehicles. IEEE Transactions on Intelligent Transportation Systems, 3(1), 37–47 (March).

    Article  Google Scholar 

  13. 13.

    Stander, O., Mech, R., & Ostermann, J. (1999). Detection of moving cast shadows for object segmentation. IEEE Transactions on Multimedia, 1(1), 65–76 (March).

    Article  Google Scholar 

  14. 14.

    Sato, I., Sato, Y., & Ikeuchi, K. (2003). Illumination from shadows. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(3), 290–300 (March).

    Article  Google Scholar 

  15. 15.

    Rosin, P. L., & Ellis, T. (1995). Image difference threshold strategies and shadow detection. Proceedings of the 1995 British conference on Machine vision (Vol. 1, pp. 347–356). Birmingham, United Kingdom, September 11–14, 1995.

  16. 16.

    Cucchiara, R., Grana, C., Piccardi, M., Prati, A., & Sirotti, S. (2001). Improving shadow suppression in moving object detection with HSV colour information. The 4th international IEEE conference on intelligent transportation systems (ITSC 2001) (pp. 334–339). Oakland, California, USA, August 25–29, 2001.

  17. 17.

    Mikic, I., Cosman, P. C., Kogut, G. T., Trivedi, M. M. (2000) Moving shadow and object detection in traffic scenes. 15th international conference on pattern recognition (ICPR 2000) (Vol. 1, pp. 321–324). Barcelona, Spain, Sept. 3–7, 2000.

  18. 18.

    Siala, K., Chakchouk, M., Chaieb, F., & Besbes, O. (2004). Moving shadow detection with support vector domain description in the colour ratios space. Proceedings of the 17th international conference on pattern recognition 2004 (ICPR 2004) (Vol. 4, pp. 384–387). Cambridge, United Kingdom, Aug. 23–26, 2004.

  19. 19.

    Andrade, L. C. G., Campos, W. F. M., & Carceroni, R. L. (2004). A video-based support system for nighttime navigation in semi-structured environments. 17th Brazilian symposium on computer graphics and image processing 2004 (pp. 178–185). Curitiba, PR, Brazil, October 17–20, 2004.

  20. 20.

    Eng, H. L., Toh, K. A., Kam, A. H., Wang, J., & Yau, W. Y. (2003). An automatic drowning detection surveillance system for challenging outdoor pool environments. Ninth IEEE international conference on computer vision 2003 (Vol. 1, pp. 532–539). Nice, France, October 13–16.

  21. 21.

    Coltuc, D., & Bolon, P. (2000). Colour image watermarking in HSI space. IEEE international conference on image processing (ICIP 2000) (Vol. 3, pp. 698–701). Vancouver, BC, Canada, Sept. 10–13, 2000.

  22. 22.

    Cucchiara, R., Grana, C., Piccardi, M., & Prati, A. (2001). Detecting objects, shadows and ghosts in video streams by exploiting colour and motion information. IEEE 11th international conference on image analysis and processing 2001 (pp. 360–365). Palermo, Italy, Sept. 26–28, 2001.

  23. 23.

    Theodoridis, S., & Koutroumbas, K. (1999). Pattern recognition. New York: Academic.

    Google Scholar 

  24. 24.

    James, M. (1988). Pattern recognition. New York: Wiley.

    Google Scholar 

  25. 25.

    Lewis, J. P. (1995). Fast template matching. Vision Interface (pp. 120–123).

  26. 26.

    Gonzalez, R. C., & Woods, R. E. (2002). Digital image processing (2nd ed.). Upper Saddle River: Prentice Hall.

    Google Scholar 

  27. 27.

    Castleman, K. R. (1996). Digital image processing. Englewood Cliffs: Prentice Hall.

    Google Scholar 

  28. 28.

    Cai, J., Pervez, M., Shehata, M., Johannesson, R., Badawy, W., & Radmanesh, A. (2006). On the identification of snow movements on roads. IEEE workshop on signal processing systems (SiPS 2006) (pp. 360–364). Banff, Alberta, Canada, October 2–4, 2006.

  29. 29.

    Cai, J., Shehata, M., Badawy, W., & Radmanesh, A. (2007). Improving accuracy of AID systems: Lessons learned over 2 years in Canadian environment. ITS Canada ACGM (Annual conference and general meeting) 2007. Niagara Falls, Ontario, Canada, April 29–May 1, 2007.

  30. 30.

    Shehata, M., Badawy, W., Radmanesh, A., Cai, J., Pervez, M., & Burr, T. (2006). Robust video-based automatic incident detection: Research, issues, and opportunities. ITS Canada ACGM (Annual conference and general meeting) 2006. Whistler, Ontario, Canada, June 4–6, 2006.

  31. 31.

    Shehata, M., Pervez, M., Burr, T., Cai, J., Badawy, W., & Radmanesh, A. (2006). On eliminating static shadow false alarms in automatic incident detection systems. The 9th International IEEE conference on intelligent transportation Systems (IEEE ITSC 2006) (pp. 759–764). September 17–20, 2006, Toronto, Canada.

Download references

Acknowledgments

We would like to thank Transport Canada (Transport Canada has provided co-funding to this project, through Canada’s Strategic Highway Infrastructure Program), Alberta Infrastructure and Transportation, The City of Calgary, The University of Calgary, Schulich School of Engineering, and Department of Electrical and Computer Engineering, for their financial and technical support they are providing to us during the period of this research project.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Mohamed Shehata.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Cai, J., Shehata, M. & Badawy, W. A Robust Video-Based Algorithm for Detecting Snow Movement in Traffic Scenes. J Sign Process Syst Sign Image Video Technol 56, 307–326 (2009). https://doi.org/10.1007/s11265-008-0241-3

Download citation

Keywords

  • Snow movement detection
  • Intelligent transportation systems (ITS)
  • Automatic incident detection (AID)
  • False alarms