Skip to main content

Road Detection and Tracking

  • Chapter

Part of the book series: Advances in Computer Vision and Pattern Recognition ((ACVPR))

Abstract

In this chapter, we introduce the state-of-the-art of road detection and tracking which are important tasks in intelligent transportation systems and intelligent vehicle applications. We review the related work on road detection and tracking first. Moreover, we introduce two types of road recognizing approaches, one is for structured roads, and the other is for unstructured roads. For structured road, we build a lane shape model and then present a new Adaptive Random Hough Transform (ARHT) to detect the lane, which combines the advantages of both the AHT and RHT. The experiment results show that this approach is robust and efficient for structured lane detection and has some advantages over a genetic algorithm. For unstructured roads, we use Mean Shift (MS) algorithms to recognize road and non-road areas based on color and texture features. Also we introduce the basic mean shift algorithm and its applications. Based on particle filtering, we formulate lane tracking to be the estimation of lane’s parameters and vehicle’s state. We present a particle filtering algorithm and build lane and dynamic system models. Then the CONDENSATION algorithm is used to estimate the shape of the road ahead of the vehicle.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://www.smarteye.se.

  2. 2.

    http://vasc.ri.cmu.edu/idb/html/road/index.html.

  3. 3.

    http://www.vision.caltech.edu/bouguetj/calib_doc/.

  4. 4.

    http://vasc.ri.cmu.edu/idb/html/road/index.html.

References

  1. Apostoloff, N., Zelinsky, A.: Robust vision based lane tracking using multiple cues and particle filtering. In: Proc. of the IEEE Intelligent Vehicles Symposium (2003)

    Google Scholar 

  2. Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process., 50(2), 174–188 (2002)

    Article  Google Scholar 

  3. Ballard, D.H.: Generalizing the Hough transform to detect arbitrary shapes. Pattern Recognit., 13(2), 111–122 (1981)

    Article  MATH  Google Scholar 

  4. Bertozzi, M., Broggi, A.: GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Trans. Image Process., 7(1), 62–81 (1998)

    Article  Google Scholar 

  5. Bertozzi, M., Broggi, A.: GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Trans. Image Process., 7(1), 62–81 (2002)

    Article  Google Scholar 

  6. Beucher, S., Bilodeau, M.: Road segmentation and obstacle detection by a fast watershed transformation. In: Proc. of the IEEE Intelligent Vehicles Symposium (1994)

    Google Scholar 

  7. Bishop, C.M.: Pattern Recognition and Machine Learning, vol. 4. Springer, New York (2006)

    MATH  Google Scholar 

  8. Broggi, A.: Automatic Vehicle Guidance: The Experience of the ARGO Autonomous Vehicle. World Scientific, Singapore (1999)

    Book  MATH  Google Scholar 

  9. Cheng, H., Zheng, N., Zhang, X., Qin, J., Van de Wetering, H.: Interactive road situation analysis for driver assistance and safety warning systems: framework and algorithms. IEEE Trans. Intell. Transp. Syst., 8(1), 157–167 (2007)

    Article  Google Scholar 

  10. Cheng, Y.: Mean shift, mode seeking, and clustering. IEEE Trans. Pattern Anal. Mach. Intell., 17(8), 790–799 (1995)

    Article  Google Scholar 

  11. Collins, R.T.: Mean-shift blob tracking through scale space. In: Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2003)

    Google Scholar 

  12. Comaniciu, D., Meer, P.: Mean shift analysis and applications. In: Proc. of the IEEE International Conference on Computer Vision (2002)

    Google Scholar 

  13. Comaniciu, D., Ramesh, V., Meer, P.: The variable bandwidth mean shift and data-driven scale selection. In: Proc. of the IEEE International Conference on Computer Vision (2002)

    Google Scholar 

  14. Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell., 25(5), 564–575 (2003)

    Article  Google Scholar 

  15. Doucet, A., De Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, Berlin (2001)

    Book  MATH  Google Scholar 

  16. Ecabert, O., Thiran, J.P.: Adaptive Hough transform for the detection of natural shapes under weak affine transformations. Pattern Recognit. Lett., 25(12), 1411–1419 (2004)

    Article  Google Scholar 

  17. Fardi, B., Wanielik, G.: Hough transformation based approach for road border detection in infrared images. In: IEEE Intelligent Vehicles Symposium (2004)

    Google Scholar 

  18. Fashing, M., Tomasi, C.: Mean shift is a bound optimization. IEEE Trans. Pattern Anal. Mach. Intell., 27(3), 471–474 (2005)

    Article  Google Scholar 

  19. Forsyth, D.A., Ponce, J.: Computer Vision: A Modern Approach (2002). Prentice Hall Professional Technical Reference

    Google Scholar 

  20. Fukunaga, K., Hostetler, L.D.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory, 21(1), 32–40 (1975)

    Article  MathSciNet  MATH  Google Scholar 

  21. Gern, A., Moebus, R., Franke, U.: Vision-based lane recognition under adverse weather conditions using optical flow. In: IEEE Intelligent Vehicle Symposium (2002)

    Google Scholar 

  22. Hashimoto, K., Nakayama, S., Saito, T., Ishida, S., Unuora, K., Ishii, J., Oono, N., Okada, Y.: An image processing architecture and a motion control method for an autonomous vehicle. In: Proc. of the Intelligent Vehicles Symposium. IEEE, New York (2002)

    Google Scholar 

  23. Heikkila, J., Silven, O.: A four-step camera calibration procedure with implicit image correction. In: IEEE Conference on Computer Vision and Pattern Recognition (1997)

    Google Scholar 

  24. Herman, M., Raviv, D., Schneiderman, H., Nashman, M.: Visual road following without 3D reconstruction. In: Proceedings of SPIE (1994)

    Google Scholar 

  25. Ieng, S.S., Tarel, J.P., Labayrade, R.: On the design of a single lane-markings detectors regardless the on-board camera’s position. In: Proc. of the IEEE Intelligent Vehicles Symposium (2003)

    Google Scholar 

  26. Inglebert, C.: Road line tracking: an approach based on spatio-temporal surface. In: Proc. of the IAPR International Conference on Pattern Recognition. IEEE, New York (2002)

    Google Scholar 

  27. Isard, M., Blake, A.: Condensation—conditional density propagation for visual tracking. Int. J. Comput. Vis., 29(1), 5–28 (1998)

    Article  Google Scholar 

  28. Kluge, K.: Extracting road curvature and orientation from image edge points without perceptual grouping into features. In: Proc. of the Intelligent Vehicles Symposium. IEEE, New York (2002)

    Google Scholar 

  29. Li, Q., Zheng, N., Cheng, H.: An adaptive approach to lane markings detection. In: Proc. of the IEEE Intelligent Transportation Systems (2005)

    Google Scholar 

  30. Liu, T., Zheng, N., Cheng, H., Xing, Z.: A novel approach of road recognition based on deformable template and genetic algorithm. In: Proc. of the IEEE International Conference on Intelligent Transportation Systems, pp. 1251–1256 (2003)

    Google Scholar 

  31. Luong, Q.T., Weber, J., Koller, D., Malik, J.: An integrated stereo-based approach to automatic vehicle guidance. In: Proc. of the IEEE International Conference on Computer Vision (2002)

    Google Scholar 

  32. McCall, J.C., Trivedi, M.M.: An integrated, robust approach to lane marking detection and lane tracking. In: IEEE Intelligent Vehicles Symposium (2004)

    Google Scholar 

  33. McCall, J.C., Trivedi, M.M.: Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. IEEE Trans. Intell. Transp. Syst., 7(1), 20–37 (2006)

    Article  Google Scholar 

  34. McDonald, J.: Detecting and tracking road markings using the Hough transform. In: Proc. of the Irish Machine Vision and Image Processing Conference (2001)

    Google Scholar 

  35. Nedevschi, S., Schmidt, R., Graf, T., Danescu, R., Frentiu, D., Marita, T., Oniga, F., Pocol, C.: 3D lane detection system based on stereovision. In: Proc. of the IEEE International Conference on Intelligent Transportation Systems (2004)

    Google Scholar 

  36. Nedevschi, S., Schmidt, R., Graf, T., Danescu, R., Frentiu, D., Marita, T., Oniga, F., Pocol, C.: 3D lane detection system based on stereovision. In: Proc. of the IEEE Conference on Intelligent Transportation Systems (2005)

    Google Scholar 

  37. Paetzold, F., Franke, U., Von Seelen, W.: Lane recognition in urban environment using optimal control theory. In: Proc. of the IEEE Intelligent Vehicles Symposium (2000)

    Google Scholar 

  38. Peterson, K., Ziglar, J., Rybski, P.E.: Fast feature detection and stochastic parameter estimation of road shape using multiple LIDAR. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (2008)

    Google Scholar 

  39. Pomerleau, D.A.: Progress in neural network-based vision for autonomous robot driving. In: Proc. of the Intelligent Vehicles’ 92 Symposium (1992)

    Google Scholar 

  40. Pomerleau, D.: RALPH: rapidly adapting lateral position handler. In: Proc. of the IEEE Intelligent Vehicles Symposium (1995)

    Google Scholar 

  41. Redmill, K.A., Upadhya, S., Krishnamurthy, A., Ozguner, U.: A lane tracking system for intelligent vehicle applications. In: Proc. of the IEEE International Conference on Intelligent Transportation Systems (2001)

    Google Scholar 

  42. Reynolds, D.A., Quatieri, T.F., Dunn, R.B.: Speaker verification using adapted Gaussian mixture models. Digit. Signal Process., 10(1–3), 19–41 (2000)

    Article  Google Scholar 

  43. Southall, B., Taylor, C.: Stochastic road shape estimation. In: Proc. of the IEEE International Conference on Computer Vision (2002)

    Google Scholar 

  44. Wang, J., Thiesson, B., Xu, Y., Cohen, M.: Image and video segmentation by anisotropic kernel mean shift. In: ECCV 2004, pp. 238–249 (2004)

    Chapter  Google Scholar 

  45. Wang, Y., Teoh, E.K., Shen, D.: Lane detection and tracking using B-Snake. Image Vis. Comput., 22(4), 269–280 (2004)

    Article  Google Scholar 

  46. Youchun, X., Rongben, W., Shouwen, J.: A vision navigation algorithm based on linear lane model. In: Proc. of the IEEE Intelligent Vehicles Symposium (2002)

    Google Scholar 

  47. Yu, B., Jain, A.K.: Lane boundary detection using a multiresolution Hough transform. In: Proc. of the IEEE International Conference on Image Processing (2002)

    Google Scholar 

  48. Zhang, Z.: Flexible camera calibration by viewing a plane from unknown orientations. In: Proc. of the IEEE International Conference on Computer Vision (1999)

    Google Scholar 

  49. Zheng, N.N., Tang, S., Cheng, H., Li, Q., Lai, G., Wang, F.W.: Toward intelligent driver-assistance and safety warning system. IEEE Intell. Syst., 19(2), 8–11 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hong Cheng .

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Cheng, H. (2011). Road Detection and Tracking. In: Autonomous Intelligent Vehicles. Advances in Computer Vision and Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-4471-2280-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2280-7_4

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2279-1

  • Online ISBN: 978-1-4471-2280-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics