Skip to main content
SpringerLink
Log in

LSD-based adaptive lane detection and tracking for ADAS in structured road environment

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Lane recognition is important for safe driving in structured road environment; it is becoming an indispensable part of the advanced driver-assistance system (ADAS) for active security control. This paper proposes a novel lane detection and tracking approach for ADAS by using the line segment detector (LSD), adaptive angle filter and dual Kalman filter. In the lane detection process, the region of interest (ROI) within the inputted image is transformed into grayscale image, which is further preprocessed with median filtering, histogram equalization, image thresholding and perspective mapping. Then, the fast and robust LSD algorithm is applied on the ROI with the proposed adaptive angle filter to eliminate incorrect line segments more efficiently. In addition, a new three-level classifier based on the color, length and quantity of detected line segments is designed for lane classification. Finally, two Kalman filters are applied to track the detected lane and predict the following ROIs to improve the robustness and processing speed. The experimental results on four datasets show that the proposed method has robust performance in complex environments with the presence of shadows or other artifacts. It has average correct rate of lane detection higher than 94%, while the processing time is reduced by about 50% compared with a state-of-the-art method, and the average success rate of lane classification is above 85%.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17

Similar content being viewed by others

References

  • Abualigah LM (2019) Feature selection and enhanced krill herd algorithm for text document clustering. In: Studies in computational intelligence, Springer, Berlin.

  • Abualigah LMQ, Hanandeh ES (2015) Applying genetic algorithms to information retrieval using vector space model. Int J Comput Sci Eng Appl 5(1):19–28

    Google Scholar 

  • Abualigah LM, Khader AT (2017) Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering. J Supercomput 73(11):4773–4795

    Article  Google Scholar 

  • Abualigah LM, Khader AT, Hanandeh ES (2018a) A new feature selection method to improve the document clustering using particle swarm optimization algorithm. J Comput Sci 25:456–466

    Article  Google Scholar 

  • Abualigah LM, Khader AT, Hanandeh ES (2018b) Hybrid clustering analysis using improved krill herd algorithm. Appl Intell 48(11):4047–4071

    Article  Google Scholar 

  • Abualigah LM, Khader AT, Hanandeh ES (2018c) A combination of objective functions and hybrid Krill herd algorithm for text document clustering analysis. Eng Appl Artif Intell 73:111–125

    Article  Google Scholar 

  • Chen C, Zhang B, Gao S (2014) A lane detection algorithm based on hyperbola model. In: International conference on computer engineering and networking, proceedings, pp 609–616

  • Ding D, Yoo J, Jung J, Jin S, Kwon S (2015) Various lane marking detection and classification for vision-based navigation system. In: IEEE international conference on consumer electronics, proceedings, pp 491–492

  • Dou Y, Yan F, Feng D (2016). Lane changing prediction at highway lane drops using support vector machine and artificial neural network classifiers. In: IEEE international conference on advanced intelligent mechatronics, proceedings, pp901–906

  • Goleijani S, Ameli MT (2019) An agent-based approach to power system dynamic state estimation through dual unscented kalman filter and artificial neural network. Soft Comput 23(23):12585–12606

    Article  Google Scholar 

  • Huang Z, Fan B, Song X (2018) Robust lane detection and tracking using multiple visual cues under stochastic lane shape conditions. J Electron Imag 27(2):023025

    Google Scholar 

  • Kodeeswari M, Philemon D (2018) Survey on various lane and driver detection techniques based on image processing for hilly terrain. IET Image Process 12(9):1511–1520

    Article  Google Scholar 

  • Lee M, Han KY, Yu J, Lee YS (2019) A new lane following method based on deep learning for automated vehicles using surround view images. J Ambient Intell Humaniz Comput Online. https://doi.org/10.1007/s12652-019-01496-8

    Article  Google Scholar 

  • Li J, Mei X, Prokhorov D (2016) Deep neural networks for structural prediction and lane detection in traffic scene. IEEE Trans Neural Netw Learn Syst 28(3):690–703

    Article  Google Scholar 

  • Li W, Qu F, Wang Y, Wang L, Chen Y (2018) A robust lane detection method based on hyperbolic model. Soft Comput Fusion Found Methodol Appl 2018:1–14

    Google Scholar 

  • Liu W, Li S (2013) An effective lane detection algorithm for structured road in urban. In: Intelligent science and intelligent data engineering, Springer, Berlin, Heidelberg

  • Liu S, Lu L, Zhong X, Zeng J (2018) Effective road lane detection and tracking method using line segment detector. In: IEEE 37th Chinese control conference, proceedings, pp.5222–5227

  • Mammeri A, Boukerche A, Tang Z (2016) A real-time lane marking localization, tracking and communication system. Comput Commun 73(2):132–143

    Article  Google Scholar 

  • McCall J, Trivedi M (2006) Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation. IEEE Trans Intell Transp Syst 7(1):20–37

    Article  Google Scholar 

  • Miad S, Chung Z (2019) State estimation of nonlinear dynamic system using novel heuristic filter based on genetic algorithm. Soft Comput 23(14):5559–5570

    Article  Google Scholar 

  • Mu C, Ma X (2014) Lane detection based on object segmentation and piecewise fitting. Telkomnika Indones J Electr Eng 12(5):3491–3500

    Google Scholar 

  • Nan Z, Wei P, Xu L, Zheng N (2016) Efficient lane boundary detection with spatial-temporal knowledge filtering. Sensors 16(8):1276–1295

    Article  Google Scholar 

  • Narote SP, Bhujbal PN, Narote AS, Dhane DM (2018) A review of recent advances in lane detection and departure warning system. Pattern Recognit 73(2018):216–234

    Article  Google Scholar 

  • Niu J, Lu J, Xu M, Lv P, Zhao X (2016) Robust lane detection using two-stage feature extraction with curve fitting. Pattern Recognit 59:225–233

    Article  Google Scholar 

  • Paula M, Jung C (2015) Automatic detection and classification of road lane markings using onboard vehicular cameras. IEEE Trans Intell Transp Syst 16(6):3160–3169

    Article  Google Scholar 

  • Shin B, Xu Z, Klette R (2014) Visual lane analysis and high-order tasks: a concise review. Mach Vis Appl 25(6):1519–1547

    Article  Google Scholar 

  • Shin B, Tao J, Klette R (2015) A superparticle filter for lane detection. Pattern Recognit 48(11):3333–3345

    Article  Google Scholar 

  • Son J, Yoo H, Kim S, Sohn K (2015) Real-time illumination invariant lane detection for lane departure warning system. Expert Syst Appl 42(4):1816–1824

    Article  Google Scholar 

  • Song W, Yang Y, Fu M, Li Y, Wang M (2018) Lane detection and classification for forward collision warning system based on stereo vision. IEEE Sensors J 18(12):5151–5163

    Article  Google Scholar 

  • Toan H, Hyung H, Husan V, Kang P (2016) Road lane detection by discriminating dashed and solid road lanes using a visible light camera sensor. Sensors (Basel) 16(8):1313–1335

    Article  Google Scholar 

  • Von Gioi R, Jakubowicz J, Morel J, Randall G (2010) LSD: a fast line segment detector with a false detection control. IEEE Trans Pattern Anal Mach Intell 32(4):722–732

    Article  Google Scholar 

  • World Health Organization (2018) Global status report on road safety 2018. WHO, Geneva

    Google Scholar 

  • Wu PC, Chang CY, Lin CH (2014a) Lane-mark extraction for automobiles under complex conditions. Pattern Recognit 47(8):2756–2767

    Article  Google Scholar 

  • Wu P, Chang C, Lin C (2014b) Lane mark extraction for automobile under complex conditions. Pattern Recognit 47(8):2756–2767

    Article  Google Scholar 

  • Zhao K, Meuter M, Nunn C, Muller D, Pauli, J (2012) A novel multi-lane detection and tracking system. In: IEEE intelligent vehicles symposium (IV), proceedings, pp1084–1089

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (Grant Nos. 61703356 and 61305117) and the Fundamental Research Funds for the Central Universities (Grant No. 20720190129).

Author information

Authors and Affiliations

  1. School of Aerospace Engineering, Xiamen University, Xiamen, China

    Jun Tian, Shiwang Liu, Xunyu Zhong & Jianping Zeng

  2. Zongmu Technology Co. Ltd, Shanghai, China

    Shiwang Liu

Authors
  1. Jun Tian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shiwang Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xunyu Zhong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jianping Zeng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xunyu Zhong.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Human and animal rights

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tian, J., Liu, S., Zhong, X. et al. LSD-based adaptive lane detection and tracking for ADAS in structured road environment. Soft Comput 25, 5709–5722 (2021). https://doi.org/10.1007/s00500-020-05566-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-020-05566-4

Keywords

Search

Navigation