Skip to main content
SpringerLink
Log in

Real-time lane tracking using Rao-Blackwellized particle filter

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

A novel approach to real-time lane modeling using a single camera is proposed. The proposed method is based on an efficient design and implementation of a particle filter which applies the concepts of the Rao-Blackwellized particle filter (RBPF) by separating the state into linear and non-linear parts. As a result the dimensionality of the problem is reduced, which allows the system to perform in real-time in embedded systems. The method is used to determine the position of the vehicle inside its own lane and the curvature of the road ahead to enhance the performance of advanced driver assistance systems. The effectiveness of the method has been demonstrated implementing a prototype and testing its performance empirically on road sequences with different illumination conditions (day and nightime), pavement types, traffic density, etc. Results show that our proposal is capable of accurately determining if the vehicle is approaching the lane markings (Lane Departure Warning), and the curvature of the road ahead, achieving processing times below 2 ms per frame for laptop CPUs, and 12 ms for embedded CPUs.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/nonGaussian Bayesian tracking. IEEE. Trans. Signal. Process. 50(2), 174–188 (2002)

    Article  Google Scholar 

  2. Borkar, A., Hayes, M., Smith, M.T.: Lane detection and tracking using a layered approach. In: Proceedings of Advanced Concepts for Intelligent Vision Systems, pp. 474–484. (2009)

  3. Borkar, A., Hayes, M., Smith, M.T.: A new multi-camera approach for lane departure warning. In: Proceedings of Advanced Concepts for Intelligent Vision Systems, pp. 59–69. (2011)

  4. Chiu, C.-C., Chung, M.-L., Chen, W.-C.: Real-time front vehicle detection algorithm for an asynchronous binocular system. J. Inf. Sci. Eng. 26(3), 735–752 (2010)

    Google Scholar 

  5. Corridori, C., Zanin, M.: High curvature two-clothoid road model estimation. In: IEEE Proceedings of Intelligent Transportation Systems Conference, pp. 630–636. (2004)

  6. Danescu, R., Nedevschi, S., Meinecke, M.-M., To, T.-B.: A stereovision-based probabilistic lane tracker for difficult road scenarios. In: IEEE Proceedings of Intelligent Vehicles Symposium, pp. 536–541. (2008)

  7. del Blanco, C.R., Jaureguizar, F., García, N.: An advanced Bayesian model for the visual tracking of multiple interacting objects. EURASIP J. Adv. Signal Process. 130 (2011)

  8. Dickmanns, E.D., Graefe, V.: Dynamic monocular machine vision. MachineVision Appl. 1(4), 223–240 (1988)

    Google Scholar 

  9. Doucet, A., Gordon, N.J., Krishnamurthy, V.: Particle filters for state estimation of jump Markov linear systems. IEEE Trans. Signal Process. 49(3), 613–624 (2001)

    Article  Google Scholar 

  10. Khan, Z., Balch, T., Dellaert, F.: MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Trans. Pattern Anal. Mach. Intell. 27(11), 1805–1819 (2005)

    Article  Google Scholar 

  11. Kim, Z.: Robust lane detection and tracking in challenging scenarios. IEEE. Trans. Intell. Transp. Syst. 9(1), 16–26 (2008)

    Article  Google Scholar 

  12. McCall, J.C., Trivedi, M.M.: Video-based lane estimation and tracking for driver assistance: survey, system and evaluation. IEEE. Trans. Intell. Transp. Syst. 7(1), 20–37 (2006)

    Article  Google Scholar 

  13. Nieto, M., Arróspide, J., Salgado, L.: Road environment modeling using robust perspective analysis and recursive Bayesian segmentation. Mach. Vis. Appl. 22(6), 927–945 (2011)

    Article  Google Scholar 

  14. Smal, I., Niessen, W., Meijering, E.: Advanced particle filtering for multiple object tracking in dynamic fluorescence microscopy images. In: IEEE Proceedings of International Symposium on Biomedical Imaging, pp. 1048–1051. (2007)

  15. Southall, B., Taylor, C.J.: Stochastic road shape estimation. In: Proceedings of International Conference on Computer Vision, vol. 1, pp. 205–212. (2001)

  16. Wang, Y., Teoh, E.K., Shen, D.: Lane detection and tracking using B-snakes. Image. Vis. Comput. 22, 269–289 (2004)

    Article  Google Scholar 

Download references

Acknowledgments

This work has been partially supported by the program ETORGAI 2011-2013 of the Basque Government under project IEB11. This work has been possible thanks to the cooperation with Datik–Irizar Group for their support in the installation, integration and testing stages of the project.

Author information

Author notes

  1. Luis Salgado

    Present address: Video Processing and Understanding Lab, Universidad Autónoma de Madrid, Madrid, Spain

Authors and Affiliations

  1. Vicomtech-ik4, Paseo Mikeletegi 57, Donostia–San Sebastián, Spain

    Marcos Nieto, Andoni Cortés & Oihana Otaegui

  2. Grupo de Tratamiento de Imágenes, Universidad Politécnica de Madrid, Madrid, Spain

    Jon Arróspide & Luis Salgado

Authors
  1. Marcos Nieto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andoni Cortés
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Oihana Otaegui
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jon Arróspide
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Luis Salgado
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marcos Nieto.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nieto, M., Cortés, A., Otaegui, O. et al. Real-time lane tracking using Rao-Blackwellized particle filter. J Real-Time Image Proc 11, 179–191 (2016). https://doi.org/10.1007/s11554-012-0315-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-012-0315-0

Keywords

Search

Navigation