Machine Vision and Applications

, Volume 25, Issue 3, pp 547–559 | Cite as

Event classification for vehicle navigation system by regional optical flow analysis

  • Min-Kook Choi
  • Joonseok Park
  • Sang-Chul LeeEmail author
Special Issue Paper


We address the problem of event classification for intelligent vehicle navigation system from video sequences acquired by a front mounted camera in complex urban scenes. Although in normal driving condition, large variety of events could be found and be preferably attached to an alerting system in a vehicle, there have been relatively narrow research activities on driving scene analysis, for example, finding local information such as lanes, pedestrians, traffic signs or light detections. Yet, the above-mentioned methods only provide limited performance due to many challenges in normal urban driving conditions, i.e. complex background, inhomogeneous illumination, occlusion, etc. In this paper, we tackle the problem of classification of various events by learning regional optical flows to detect some important events (very frequent occurring and involving riskiness on driving) using low cost front mounted camera equipment. We approached the problem as follows: First, we present an optical flow-based event detection method by regional significance analysis with the introduction of a novel significance map based on regional histograms of flow vectors; Second, we present a global and a local method to robustly detect ego-motion-based events and target-motion-based events. In our experiments, we achieved classification accuracy about 91% on average tested with two classifiers (Bayesian and SVM). We also show the performance of the method in terms of computational complexity achieving about 14.3 fps on a laptop computer with Intel Pentium 1.2 Ghz.


Urban traffic scene Vehicle navigation system Optical flow estimation Event classification Ego-motion analysis 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Supplementary material

ESM 1 (AVI 7282 kb)


  1. 1.
    Loy, C.C., Xiang, T., Gong, S.: From local temporal correlation to global anomaly detection. In: Proceedings of Workshop on ICCV (2008)Google Scholar
  2. 2.
    Georg, M., Pless, R.: Fitting parametric road models to spatio-temporal derivatives. In: Proceedings of Workshop on ICCV, pp. 421–427 (2009)Google Scholar
  3. 3.
    Saleemi, I., Hartung, L., Shah, M.: Scene understanding by statistical modeling of motion patterns. In: Proceedings of CVPR (2010) 2069–2076Google Scholar
  4. 4.
    Gandhi, T., Trivedi, M.M.: Pedestrian protection system: issue, survey, and challenges. In: IEEE Transaction on Intelligent Transportation System, pp. 413–430 (2007)Google Scholar
  5. 5.
    Gavrila, D.M., Munder, S.: Multi-cue pedestrian detection and tracking from a moving vehicle. Int. J. Comput. Vis. 73 (2006)Google Scholar
  6. 6.
    Escalera, S., Pujol, O., Radeva, P.: Traffic sign recognition system with β-correction. Vis. Appl. (2010)Google Scholar
  7. 7.
    Ruta, A., Li, Y., Liu, X.: Towards real-time traffic sign recognition by class-specific fiscriminative features. In: Proceedings of BMVC (2007)Google Scholar
  8. 8.
    Gavrila, D.: Pedestrian detection from a moving vehicle. In: Proceedings of ECCV, pp. 37–49 (2000)Google Scholar
  9. 9.
    Danescu, R., Nedevschi, S.: Probabilistic lane tracking in difficult road scenarios using stereovision. In: Proceedings of Intelligent Vehicles Symp. (2009)Google Scholar
  10. 10.
    Kruger, W., Enkelmann, W., Rossle, S.: Real-time estimation and tracking of optical flow vector for obstacle detection. In: Proceedings of Intelligent Vehicles Symp., pp. 729–734 (1995)Google Scholar
  11. 11.
    Gern, A., Moebus, R., Franke, U.: Vision-based lane recognition under adverse weather condition using optical flow. In: Proceedings of Intelligent Vehicles Symp., pp. 652–657 (2002)Google Scholar
  12. 12.
    Roberts, R., Potthast, C., Dellaert, F.: Learning general optical flow subspaces for egomotion estimation and detection of motion anomalies. In: Proceedings of CVPR (2009)Google Scholar
  13. 13.
    Geiger, A., Kitt, B.: Objectflow: a descriptor for classifying traffic motion. In: Proceedings of Intelligent Vehicles Symp (2010)Google Scholar
  14. 14.
    Ess, A., Muller, T., Grabner, H., Van Gool, L.J: Segmentation-based urban traffic scene understanding. In: Proceedings of BMVC (2009)Google Scholar
  15. 15.
    Roth, S., Black, M.J.: On the spatial statistics of optical flow. Int. J. Comput. Vis. 74(1) (2007)Google Scholar
  16. 16.
    Roth, S., Black, M.J.: Fields of expert: a framework for learning image priors. In: Proceedings of CVPR (2005)Google Scholar
  17. 17.
    Wall, M.E., Rechtsteiner, A., Rocha, L.M.: Singular value decomposision and principal component anlaysis. In: A Practical Approach to Microarray Data Analysis, pp. 91–109 (2003)Google Scholar
  18. 18.
    Horn, B., Schunck, B.: Determining optical flow. In: Proceedings of Artificial Intelligence, pp. 185–203 (1981)Google Scholar
  19. 19.
    Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vistion. In: Proceedings of Artificial Intelligence, pp. 674–679 (1981)Google Scholar
  20. 20.
    Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Proceedings of ECCV, pp. 25–36 (2004)Google Scholar
  21. 21.
    Black, M.J., Anandan, P.: The robust estimation of multiple motion: parametric and piecewise-smooth flow fields. In: CVIU, pp. 972–986 (1996)Google Scholar
  22. 22.
    Wedel, A., Pock, T., Cremers, D.: Structure- and motion-adaptive regularization for tv-l1 optic flow. In: Proceedings of ICCV (2009)Google Scholar
  23. 23.
    Bruhn, A., Weickert, W., Schnorr, C.: Lucas/kanade meets horn/schunck: combining local and global optical flow methods. Int. J. Comput. Vis. 211–231 (2005)Google Scholar
  24. 24.
    Sun, D., Roth, S., Black, M.J.: Secretes of optical flow estimation and their principles. In: Proceedings of CVPR (2010)Google Scholar
  25. 25.
    Lei, C., Yang, Y.H.: Optical flow estimation on coarse-to-fine region-trees using discrete optimization. In: Proceedings of ICCV (2009)Google Scholar
  26. 26.
    Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. In: Proceedings of ICCV (2007)Google Scholar
  27. 27.
    Barron J.L., Fleet D.J., Beauchemin S.S.: Performance of optical flow techniques. Int. J. Comput. Vis. 12, 43–77 (1994)CrossRefGoogle Scholar
  28. 28.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. Wiley-Interscience. ISBN 0471056693 (2000)Google Scholar
  29. 29.
    Cortes, C., Vapnik, V.: Support-vector networks. In: Machine Learning, pp. 273–297 (1995)Google Scholar
  30. 30.
    Chang, C.C., Lin, C.J.: Software available at (2001)
  31. 31.
    Werlberger, M., Trobin, W., Pock, T., Wedel, A., Cremers, D., Bischof, H.: Anisotropic huber-l1 optical flow. In: Proceedings of BMVC (2009)Google Scholar

Copyright information

© Springer-Verlag 2011

Authors and Affiliations

  1. 1.School of Computer and Information EngineeringInha UniversityIncheonKorea

Personalised recommendations