Skip to main content

Advertisement

SpringerLink
Log in

Finding multiple lanes in urban road networks with vision and lidar

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

This paper describes a system for detecting and estimating the properties of multiple travel lanes in an urban road network from calibrated video imagery and laser range data acquired by a moving vehicle. The system operates in real-time in several stages on multiple processors, fusing detected road markings, obstacles, and curbs into a stable non-parametric estimate of nearby travel lanes. The system incorporates elements of a provided piecewise-linear road network as a weak prior.

Our method is notable in several respects: it detects and estimates multiple travel lanes; it fuses asynchronous, heterogeneous sensor streams; it handles high-curvature roads; and it makes no assumption about the position or orientation of the vehicle with respect to the road.

We analyze the system’s performance in the context of the 2007 DARPA Urban Challenge. With five cameras and thirteen lidars, our method was incorporated into a closed-loop controller to successfully guide an autonomous vehicle through a 90 km urban course at speeds up to 40 km/h amidst moving traffic.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Apostoloff, N., & Zelinsky, A. (2004). Vision in and out of vehicles: Integrated driver and road scene monitoring. International Journal of Robotics Research, 23(4–5), 513–538.

    Google Scholar 

  • Baluja, S. (1996). Evolution of an artificial neural network based autonomous land vehicle controller. IEEE Transactions on Systems, Man and Cybernetics, Part B, 26(3), 450–463.

    Article  Google Scholar 

  • Bartels, R. H., & Beatty, J. C. (1987). An introduction to splines for use in computer graphics and geometric modeling. Los Altos: Morgan Kaufmann.

    MATH  Google Scholar 

  • Bertozzi, M., & Broggi, A. (1998). GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection. IEEE Transactions on Image Processing, 7(1), 62–80.

    Article  Google Scholar 

  • Bertozzi, M., Broggi, A., & Fascioli, A. (2000). Vision-based intelligent vehicles: State of the art and perspectives. Robotics and Autonomous Systems, 1, 1–16.

    Article  Google Scholar 

  • CNN (2008). Doh! Man follows GPS onto train tracks—when train coming. http://www.cnn.com/2008/US/01/03/gps.traincrash.ap/index.html, Jan. 2008.

  • Dahlkamp, H., Kaehler, A., Stavens, D., Thrun, S., & Bradski, G. (2006). Self-supervised monocular road detection in desert terrain. In Proceedings of robotics: science and systems. Philadelphia.

  • Dickmanns, E., & Mysliwetz, B. (1992). Recursive 3-d road and ego-state recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2), 199–213.

    Article  Google Scholar 

  • Leonard, J. (2008). A perception-driven autonomous vehicle. Journal of Field Robotics, 25(10), 727–774.

    Article  Google Scholar 

  • Fischler, M. A., & Bolles, R. C. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6), 381–395.

    Article  MathSciNet  Google Scholar 

  • Fletcher, L., & Zelinsky, A. (2006). Context sensitive driver assistance based on gaze–road scene correlation. In Int. symposium on experimental robotics (pp. 287–296), Rio De Janeiro, Brazil, Jul. 2006.

  • Hartley, R. I., & Zisserman, A. (2001). Multiple view geometry in computer vision. Cambridge: Cambridge University Press. ISBN: 0521623049.

    Google Scholar 

  • Iteris, Inc. (2009). http://www.iteris.com.

  • Kang, D.-J., & Jung, M.-H. (2003). Road lane segmentation using dynamic programming for active safety vehicles. Pattern Recognition Letters, 24(16), 3177–3185.

    Article  Google Scholar 

  • Kim, Z. (2008). Robust lane detection and tracking in challenging scenarios. IEEE Transactions on Intelligent Transportation Systems, 9(1), 16–26.

    Article  Google Scholar 

  • Kreucher, C., & Lakshmanan, S. (1999). LANA: A lane extraction algorithm that uses frequency domain features. IEEE Transactions on Robotics and Automation, 15(2), 343–350.

    Article  Google Scholar 

  • Kreucher, C., Lakshmanan, S., & Kluge, K. (1998). A driver warning system based on the LOIS lane detection algorithm. In The Proceedings of the IEEE international conference on intelligent vehicles (Vol. 1, pp. 17–22), Oct. 1998.

  • Lyall, S. (2007). Turn back. Exit village. Truck shortcut hitting barrier, New York Times. http://www.nytimes.com/2007/12/04/world/europe/04gps.html, Dec. 2007.

  • Lee, J. W. (2002). A machine vision system for lane-departure detection. Computer Vision and Image Understanding, 86(1), 52–78.

    Article  MATH  Google Scholar 

  • Lee, J. W., & Yi, U. K. (2005). A lane-departure identification based on LBPE, Hough transform, and linear regression. Computer Vision and Image Understanding, 99(3), 359–383.

    Article  Google Scholar 

  • McCall, J. C., & Trivedi, M. M. (2006). Video-based lane estimation and tracking for driver assistance: Survey, system, and evaluation. IEEE Transactions on Intelligent Transport Systems, 7(1), 20–37.

    Article  Google Scholar 

  • Miller, T. R. (1993). Benefit-cost analysis of lane marking. Public Roads, 56(4), 153–163.

    Google Scholar 

  • Mobileye (2009). Mobileye camera based system for: collision warning, lane departure, headway monitoring. http://www.mobileye.com.

  • Moore, D., Huang, A. S., Walter, M., Olson, E., Fletcher, L., Leonard, J., & Teller, S. (2009). Simultaneous local and global state estimation for robotic navigation. In Proc. IEEE int. conf. robotics and automation, May 2009.

  • US Department of Transportation, Federal Highway Administration, Office of Information Management (2005). Highway Statistics 2005. US Government Printing Office, Washington, DC, 2005.

  • Pomerleau, D. (1995). Neural network vision for robot driving. In M. Arbib (Ed.), The handbook of brain theory and neural networks. Cambridge: MIT Press.

    Google Scholar 

  • Pomerleau, D., & Jochem, T. (1996). Rapidly adapting machine vision for automated vehicle steering. IEEE Expert: Special Issue on Intelligent System and their Applications, 11(2), 19–27. See also IEEE Intelligent Systems.

    Google Scholar 

  • Rasmussen, C. (2008). RoadCompass: following rural roads with vision + ladar using vanishing point tracking. Autonomous Robots, 25(3), 205–229.

    Article  Google Scholar 

  • Route network definition file (RNDF) and mission data file (MDF) formats. Defense Advanced Research Projects Agency, Mar. 2007.

  • Taylor, C. J., Kosecká, J., Blasi, R., & Malik, J. (1999). A comparative study of vision-based lateral control strategies for autonomous highway driving. International Journal of Robotics Research, 18(5), 442–453.

    Google Scholar 

  • Thorpe, C., Hebert, M., Kanade, T., & Shafer, S. (1988). Vision and navigation for the Carnegie-Mellon Navlab. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI, 10(3), 362–373.

    Article  Google Scholar 

  • Zhang, W.-B. (1991). A roadway information system for vehicle guidance/control. In Vehicle navigation and information systems (Vol. 2, pp. 1111–1116), Oct. 1991.

Download references

Author information

Authors and Affiliations

  1. Massachusetts Institute of Technology, Cambridge, MA, USA

    Albert S. Huang, David Moore, Matthew Antone, Edwin Olson & Seth Teller

Authors
  1. Albert S. Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David Moore
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matthew Antone
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Edwin Olson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Seth Teller
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Albert S. Huang.

Additional information

This research was sponsored by DARPA, Program: Urban Challenge, ARPA Order No. W369/00, Program Code: DIRO, issued by DARPA/CMO under Contract No. HR0011-06-C-0149.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Huang, A.S., Moore, D., Antone, M. et al. Finding multiple lanes in urban road networks with vision and lidar. Auton Robot 26, 103–122 (2009). https://doi.org/10.1007/s10514-009-9113-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-009-9113-3

Keywords

Search

Navigation