Skip to main content
SpringerLink
Log in

Road environment modeling using robust perspective analysis and recursive Bayesian segmentation

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Recently, vision-based advanced driver-assistance systems (ADAS) have received a new increased interest to enhance driving safety. In particular, due to its high performance–cost ratio, mono-camera systems are arising as the main focus of this field of work. In this paper we present a novel on-board road modeling and vehicle detection system, which is a part of the result of the European I-WAY project. The system relies on a robust estimation of the perspective of the scene, which adapts to the dynamics of the vehicle and generates a stabilized rectified image of the road plane. This rectified plane is used by a recursive Bayesian classifier, which classifies pixels as belonging to different classes corresponding to the elements of interest of the scenario. This stage works as an intermediate layer that isolates subsequent modules since it absorbs the inherent variability of the scene. The system has been tested on-road, in different scenarios, including varied illumination and adverse weather conditions, and the results have been proved to be remarkable even for such complex scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Sun, Z., Bebis, G., Miller, R.: On-road Vehicle Detection Using Optical Sensors: A review. In: IEEE Proc. Int. Conf. on Intelligent Transportation Systems, pp. 585–590 (2004)

  2. Bertozzi M., Broggi A.: GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Trans. Image Process. 7(1), 62–81 (1998)

    Article  Google Scholar 

  3. Nedevschi, S., Schmidt, R., Graf, T., Danescu, R., Frentiu, D., Marita, T., Oniga, F., Pocol, C.: 3D Lane Detection System Based on Stereovision. In: IEEE Proc. Intelligent Transportation Systems Conference, pp. 161–166 (2004)

  4. Nedevschi, S., Oniga, F., Danescu, R.: Increased Accuracy Stereo Approach for 3D Lane Detection. In: IEEE Proc. Intelligent Vehicles Symposium, pp. 42–49 (2006)

  5. Danescu, R., Nedevschi, S., Meinecke, M.-M., To, T.-B.: A Stereovision-Based Probabilistic Lane Tracker for Difficult Road Scenarios. In: IEEE Proc. Intelligent Vehicles Symposium, pp. 536–541 (2008)

  6. Broggi, A., Bertozzi, M., Fascioli, A.: Self-calibration of a Stereo Vision System for Automotive Applications. In: IEEE Proc. Int. Conf. on Robotics and Automation, vol. 4, pp. 3698–3703 (2001)

  7. Chang, P., Hirvonen, D., Camus, T., Southall, B.: Stereo-Based Object Detection, Classification, and Quantitative Evaluation with Automotive Applications. In: IEEE Proc Computer Vision and Pattern Recognition, vol. 3, pp. 62–68 (2005)

  8. Simond, N., Rives, P.: Homography from a vanishing point in urban scenes. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, vol. 1, pp. 1005–1010 (2003)

  9. Stein, G.P., Mano, O., Shashua, A.: A Robust Method for Computing Vehicle Ego-motion. In: IEEE Proc. Intelligent Vehicles Symposium, pp. 362–368 (2000)

  10. Zhou, J., Li, B.: Homography-based Ground Detection for A Mobile Robot Platform Using a Single Camera. In: IEEE International Conference on Robotics and Automation, pp. 4100–4105 (2006)

  11. McCall J.C., Trivedi M.M.: Video-based lane estimation and tracking for driver assistance: Survey, system, and evaluation. IEEE Trans. Intell. Transport. Syst. 7(1), 20–37 (2006)

    Article  Google Scholar 

  12. Corridori, C., Zanin, M.: High curvature Two-Clothoid Road Model Estimation. In: IEEE Intelligent Transportation Systems Conference, pp. 630–636 (2004)

  13. Wang Y., Teoh E.K., Shen D.: Lane detection, tracking using B-snakes. Image Vision Comput. 22, 269–289 (2004)

    Article  Google Scholar 

  14. Chen, Y., Das, M., Bajpai, D.: Vehicle Tracking and Distance Estimation Based on Multiple Image Features. In: IEEE Proc. Canadian Conf. on Computer and Robot Vision, pp. 371–378 (2007)

  15. Goecke, R., Pettersson, N., Petersson, L.: Towards Detection and Tracking of On-Road Objects. In: IEEE Proc. Intelligent Vehicles Symposium, pp. 416–421 (2007)

  16. ten Kate, T.K., et al.: Mid-range and Distant Vehicle Detection with a Mobile Camera. In: IEEE Proc. Intelligent Vehicle Symposium, pp. 72–77 (2004)

  17. Hoffmann, C., Dang, T., Stiller, C.: Vehicle detection fusing 2D visual features. In: IEEE Proc. Intelligent Vehicle Symposium, pp. 280–285 (2004)

  18. Jiang, G.Y.: Lane and Obstacle Detection Based on Fast Inverse per spective mapping algorithm. In: IEEE Proc. Int. Conf. on Systems, Man, and Cybernetics, vol. 4, pp. 2969–2974 (2004)

  19. Shu, Y., Tan, Z.: Vision Based Lane Detection in Autonomous Vehicle, In: Proc. 5 World Congress on Intelligent Control and Automation, pp. 5258–5260 (2004)

  20. Nieto, M., Salgado, L., Jaureguizar, F., Cabrera, J.: Stabilization of Inverse Perspective Mapping Images based on Robust Vanishing Point Estimation. In: IEEE Proc. Intelligent Vehicles Symposium, pp. 315–320 (2007)

  21. Mallot H., Bulthoff H., Little J., Bohrer S.: Inverse perspective mapping simplifies optical flow computation and obstacle detection. Biol. Cybern. 64(3), 177–185 (1991)

    Article  MATH  Google Scholar 

  22. Hartley R.I., Zisserman A.: Multiple View Geometry in Computer Vision, Second. Cambridge University Press, Cambridge (2004)

    Book  Google Scholar 

  23. Macek, K., Williams, B., Kolski, S., Siegwart, R.: A Lane Detection Vision Module for Driver Assistance. In: IEEE Proc. Conf. on Mech. and Robotics, pp. 77–82 (2004)

  24. Bilmes, J.A.: A Gentle Tutorial on the EM Algorithm and its Application to Parameter Estimation for Gaussian Mixture and Hidden Markov Models. http://citeseer.ist.psu.edu/bilmes98gentle.html, technical report, Univ. of California, Berkeley (1998)

  25. Kang D.-J., Jung M.-H.: Road lane segmentation using dynamic programming for active safety vehicles. Pattern Recognit. Lett. 24(16), 3177–3185 (2006)

    Article  Google Scholar 

  26. Kaliyaperumal K., Lakshmanan S., Kluge K.: An algorithm for detecting roads and obstacles in radar images. IEEE Trans. Vehicular Technol. 50(1), 170–182 (2001)

    Article  Google Scholar 

  27. Kluge, K., Lakshmanan, S.: A deformable-template approach to lane detection. In: IEEE Proc. Intelligent Vehicles Symposium, pp. 54–59 (1995)

  28. Bertozzi M., Broggi A., Fascioli A., Fascioli R.: Stereo inverse perspective mapping: theory and applications, image and vision. Comput. J. 8, 585–590 (1998)

    Google Scholar 

  29. Arróspide, J., Salgado, L., Nieto, M., Jaureguizar, F.: Real-Time Vehicle Detection and Tracking Based on Perspective and Non-Perspective Space Cooperation. In: IST/SPIE Proc. Int. Conf. on Real-Time Image and Video Processing, vol. 7244, pp. 72440H-1-12 (2009)

  30. Cerri, P., Grisleri, P.: Free Space Detection on Highways using Time Correlation between Stabilized Sub-pixel precision IPM Images. In: IEEE Proc. Int. Conf. on Robotics and Automation, pp. 2223–2228 (2005)

  31. Muad, A.M., Hussain, A., Samad, S.A., Mustaffa, M.M., Majlis, B.Y.: Implementation of Inverse Perspective Mapping Algorithm for the Development of an Automatic Lane Tracking System. In: IEEE Proc. Region 10 Conference (TENCON), vol. 1, pp. 207–211 (2004)

Download references

Author information

Authors and Affiliations

  1. Grupo de Tratamiento de Imágenes, Universidad Politécnica de Madrid, Ciudad Universitaria s/n, ETSIT C-306, 28040, Madrid, Spain

    Marcos Nieto, Jon Arróspide Laborda & Luis Salgado

Authors
  1. Marcos Nieto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jon Arróspide Laborda
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Luis Salgado
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marcos Nieto.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nieto, M., Arróspide Laborda, J. & Salgado, L. Road environment modeling using robust perspective analysis and recursive Bayesian segmentation. Machine Vision and Applications 22, 927–945 (2011). https://doi.org/10.1007/s00138-010-0287-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-010-0287-7

Keywords

Search

Navigation