Skip to main content
SpringerLink
Log in

Lane detection in intelligent vehicle system using optimal 2- tier deep convolutional neural network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In Advanced Driver Assistance Systems(ADAS) and autonomous vehicles, lane detection is an important module. Most lane detection methods focused on detecting lanes from a single image and the results from unsatisfactory performance under extremely bad climatic changes and attain high accuracy is challenging. In this research work, a novel two-tier deep learning based lane detection framework is introduced for multi images at different weather conditions. In both the tiers, the Local Vector Pattern (LVP) based texture features are extracted and an Optimized Deep Convolutional Neural Network (DCNN) is utilized to classify road and lane as well. The weight corresponding to the second convolutional layer of DCNN (both tiers) is fine-tuned by a novel technique called “Flight Straight of Moth Search (FS-MS) Algorithm” that is an enhanced version of the standard Moth search Algorithm, to create the detection more accurate (MS).With respect of particular metrics, the efficiency of the provided work is compared to that existing lane detecting models.Particularly, the computation time of the proposed model is 31.2%, 20.85%, 10.43%, and 4.53% higher than the existing MS + CNN, LA + CNN, GA + CNN, and PSO + CNN methods respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Ali A, Zhu Y, Zakarya M (2021) Exploiting dynamic spatio-temporal correlations for citywide traffic flow prediction using attention based neural networks. Inf Sci 577:852–870

    Article  Google Scholar 

  2. Ali A, Zhu Y, Zakarya M (2021) A data aggregation based approach to exploit dynamic spatio-temporal correlations for citywide crowd flows prediction in fog computing. Multimed Tools Appl 80(20):31401–31433

    Article  Google Scholar 

  3. Ali A, Zhu Y, Zakarya M (2022) Exploiting dynamic spatio-temporal graph convolutional neural networks for citywide traffic flows prediction. Neural Netw 145:233–247

    Article  Google Scholar 

  4. Asif MR, Qi C, Wang T, Fareed MS, Raza SA (2019) License plate detection for multi-national vehicles: An illumination invariant approach in multi-lane environment. Comput Electr Eng 78:132–147

    Article  Google Scholar 

  5. Bhagyalakshmi V, Ramchandra GD, Geeta D (2018) Arrhythmia classification using cat swarm optimization based support vector neural network. J Netw Commun Syst 1(1):28–35

  6. Cadena A, Ponguillo R (2016) Development of an autonomous underwater vehicle for census of Antarctic marine life. In: Proceedings of the World Congress on Engineering 2016 Vol I WCE 2016, June 29 - July 1, 2016, London

  7. Chao F, Yu-Pei S, Ya-Jie J (2019) Multi-lane detection based on deep convolutional neural network. IEEE Access 7:150833–150841

    Article  Google Scholar 

  8. Chen K, Franko K, Sang R (2021) "Structured model pruning of convolutional networks on tensor processing units" arXiv preprint arXiv:2107.0419

  9. Cheng W-C (2012) PSO algorithm particle filters for improving the performance of lane detection and tracking systems in difficult roads. Sensors 12(12):17168–17185

    Article  Google Scholar 

  10. Chiu K-Y, Lin S-F (2005) "Lane detection using color-based segmentation." In IEEE Proceedings. Intelligent Vehicles Symposium, 2005., pp. 706–711. IEEE

  11. Cristin R,Gladiss Merlin N.R,Ramanathan L,Vimala S, "Image forgery detection using Back propagation neural network model and particle swarm optimization algorithm", Multimedia Research, Vol.3,No.1, pp.21–32,2020.

  12. Daigavane PM, Bajaj PR (2010) "Road lane detection with improved canny edges using ant colony optimization." In 2010 3rd International Conference on Emerging Trends in Engineering and Technology, pp. 76–80. IEEE

  13. de Paula MB, Jung CR (2015) Automatic detection and classification of road lane markings using onboard Vehicular cameras. IEEE Trans Intell Transp Syst 16(6):3160–3169

    Article  Google Scholar 

  14. Deepak KD (2020) "Optimized Convolutional Neural Network for Road Detection with Structured Contour and Spatial Information", in communication

  15. Ding Y, Xu Z, Zhang Y, Sun K (2017) Fast lane detection based on bird’s eye view and improved random sample consensus algorithm. Multimed Tools Appl 76(21):22979–22998

    Article  Google Scholar 

  16. Eugenio F, Marcello J, Martin J (2015) High-resolution maps of bathymetry and benthic habitats in shallow-water environments using multispectral remote sensing imagery. IEEE Trans Geosci Remote Sens 53(7):3539–3549

  17. Fan KC, Hung TY (2014) A novel local pattern descriptor—local vector pattern in high-order derivative space for face recognition. IEEE Trans Image Process 23(7):2877–2891

  18. Fan R, Wang X, Hou Q, Liu H, Mu T-J (2019) SpinNet: Spinning convolutional network for lane boundary detection. Comput Vis Med 5:417–428

    Article  Google Scholar 

  19. Gadekallu TR, Rajput DS, Reddy MPK, Lakshmanna K, Bhattacharya S, Singh S, Jolfaei A, Alazab M (2020) "A novel PCA–whale optimization-based deep neural network model for classification of tomato plant diseases using GPU." J Real-Time Image Proc : 1–14

  20. Gadekallu TR, Alazab M, Kaluri R, Maddikunta PKR, Bhattacharya S, Lakshmanna K, Parimala M (2021) "Hand gesture classification using a novel CNN-crow search algorithm." Complex Intell Sys : 1–14

  21. Gupta A, Choudhary A (2018) A framework for camera-based real-time lane and road surface marking detection and recognition. IEEE Transactions on Intelligent Vehicles 3(4):476–485

    Article  Google Scholar 

  22. Jiuxiang G, Wang Z, Kuen J, Ma L, Shahroudy A, Shuai B, Liu T, Wang X, Wang G, Cai J, Chen T (2018) Recent advances in convolutional neural networks. Pattern Recogn 77:354–377

    Article  Google Scholar 

  23. Joshy N, Jose D (2014) Improved detection and tracking of lane marking using Hough transform. IJCSMC 3(8):507–513

    Google Scholar 

  24. Kuqi B, Elezaj E, Millaku B, Dreshaj A, Hung NT (2021) The impact of COVID-19 (SARS-CoV-2) in tourism industry: evidence of Kosovo during Q1, Q2 and Q3 period of 2020. J Sustain Finance Invest:1–12. https://doi.org/10.1080/20430795.2021.1883986

  25. Lee K, Li SE, Kum D (2018) Synthesis of robust lane keeping systems: impact of controller and design parameters on system performance. IEEE Trans Intell Transport Sys 20(8):3129–3141

    Article  Google Scholar 

  26. Li J, Mei X, Prokhorov D, Tao D (2016) Deep neural network for structural prediction and lane detection in traffic scene. IEEE Trans Neural Netw Learn Syst 28(3):690–703

  27. Li S, Xu J, Wei W, Qi H (2017) "Curve lane detection based on the binary particle swarm optimization." In 2017 29th Chinese Control And Decision Conference (CCDC), pp. 75–80. IEEE

  28. Liu J (2019) "Learning full-reference quality-guided discriminative gradient cues for lane detection based on neural networks", J Vis Commun Image Represent, vol.65

  29. Mammeri A, Boukerche A, Guangqian L (2014) "Lane detection and tracking system based on the MSER algorithm, hough transform and kalman filter." In Proceedings of the 17th ACM international conference on Modeling, analysis and simulation of wireless and mobile systems, pp. 259–266

  30. Narote SP, Bhujbal PN, Narote AS, Dhane DM (2018) A review of recent advances in lane detection and departure warning system. Pattern Recognit 73:216–234

    Article  Google Scholar 

  31. Neven D, De Brabandere B, Georgoulis S, Proesmans M, Van Gool L (2018) Towards end-to-end lane detection: an instance segmentation approach. In: 2018 IEEE intelligent vehicles symposium (IV). IEEE, pp 286–291

  32. Nguyen VQ, Kim H, Jun SC, Boo K (2018) A Study on Real-Time Detection Method of Lane and Vehicle for Lane Change Assistant System Using Vision System on Highway. Eng Sci Technol Int J 21(5):822–833

    Google Scholar 

  33. Ozgunalp U, Fan R, Ai X, Dahnoun N (2017) Multiple lane detection algorithm based on novel dense vanishing point estimation. IEEE Trans Intell Transp Syst 18(3):621–632

    Article  Google Scholar 

  34. Poluru RK, Lokesh Kumar R (2019) Enhancement of ATC by optimizing TCSC configuration using adaptive moth flame optimization algorithm. Journal of Computational Mechanics, Power System and Control 2(3):1–9

    Article  Google Scholar 

  35. Rajakumar BR (2013) Impact of Static and Adaptive Mutation Techniques on Genetic Algorithm. Int J Hybrid Intell Sys 10(1):11–22. https://doi.org/10.3233/HIS-120161

    Article  Google Scholar 

  36. Rajakumar BR (2013) Static and Adaptive Mutation Techniques for Genetic algorithm: A Systematic Comparative Analysis. Int J Comput Sci Eng 8(2):180–193. https://doi.org/10.1504/IJCSE.2013.053087

    Article  Google Scholar 

  37. B. R. Rajakumar, “Lion algorithm for standard and large scale bilinear system identification: A global optimization based on Lion's social behavior”, 2014 IEEE Congress on Evolutionary Computation, Beijing, China, 2014, pages: 2116–2123, https://doi.org/10.1109/CEC.2014.6900561

  38. Rajakumar BR (2018) Optimization using lion algorithm: a biological inspiration from lion’s social behavior. Evolutionary Intelligence, Special Issue on Nature inspired algorithms for high performance computing in computer vision 11(1–2):31–52. https://doi.org/10.1007/s12065-018-0168-y

    Article  Google Scholar 

  39. Rajakumar BR, George A (2013) APOGA: An adaptive population pool size based genetic algorithm. AASRI Procedia 4:288–296

  40. Roy RG, Ghoshal D (2019) "A novel adaptive second-order sliding mode controller for autonomous underwater vehicles." Adapt Behav: 1059712319882105.

  41. Rumelhart DE, Hinton GE, Williams RJ (1986) Learning representations by back-propagating errors. Nature 323(6088):533–536

    Article  MATH  Google Scholar 

  42. Shukla U, Mishra A, Jasmine SG, Vaidehi V, Ganesan S (2019) A deep neural network framework for road side analysis and lane detection. Procedia Computer Science 165:252–258

    Article  Google Scholar 

  43. Taghipour A, Frayret JM (2013) Coordination of operations planning in supply chains: a review. International Journal of Business Performance and Supply Chain Modelling 5(3):272–307

  44. Tian Y, Gelernter J, Wang X, Chen W, Gao J, Zhang Y, Li X (2018) Lane marking detection via deep convolutional neural network. Neurocomputing 280:46–55

  45. Vasan D, Alazab M, Wassan S, Naeem H, Safaei B, Zheng Q (2020) IMCFN: image-based malware classification using fine-tuned convolutional neural network architecture. Comput Netw 171:107138

    Article  Google Scholar 

  46. Venkatraman S, Alazab M (2018) Use of data visualisation for zero-day malware detection. Security and Communication Networks 2018:1–13

    Article  Google Scholar 

  47. Wang G-G (2018) Moth search algorithm: a bio-inspired metaheuristic algorithm for global optimization problems. Memet Comput 10(1):151–154

    Article  Google Scholar 

  48. Xiao J, Li S, Sun B (2016) "A Real-Time System for Lane Detection Based on FPGA and DSP", Sens Imaging, vol.17

  49. Xiao D, Yang X, Li J, Islam M (2020) "Attention deep neural network for lane marking detection", Knowl-Based Syst, in communication

  50. Xu Z, Shin B-S, Klette R (2014) Accurate and robust line segment extraction using minimum entropy with Hough transform. IEEE Trans Image Process 24(3):813–822

    MATH  Google Scholar 

  51. Yang W, Cheng Y, Chung P (2019) Improved lane detection with multilevel features in branch convolutional neural networks. IEEE Access 7:173148–173156

    Article  Google Scholar 

  52. Ying Z, Ge Li. (2016) Robust lane marking detection using boundary-based inverse perspective mapping. In: 2016 ieee international conference on acoustics, speech and signal processing (icassp). IEEE, pp 1921–1925

  53. Youjin T, Wei C, Xingguang L, Lei C (2018) A Robust Lane Detection Method Based on Vanishing Point Estimation. Procedia Comput Sci 131:354–360

    Article  Google Scholar 

  54. Yuan C, Chen H, Liu J, Zhu D, Xu Y (2018) Robust lane detection for complicated road environment based on Normal map. IEEE Access 6:49679–49689

    Article  Google Scholar 

  55. Zang J, Zhou W, Zhang G, Duan Z (2018) "Traffic lane detection using fully convolutional neural network." In 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), pp. 305–311. IEEE

  56. Zhang X, Zhu X (2019) Autonomous path tracking control of intelligent electric vehicles based on lane detection and optimal preview method. Expert Syst Appl 121:38–48

    Article  Google Scholar 

  57. Zhang A, Wang KC, Yang E, Li JQ, Chen C, Qiu Y (2018) Pavement lane marking detection using matched filter. Measurement 130:105–117

  58. Zhang G, Yan C, Wang J (2020) "Quality-guided lane detection by deeply modeling sophisticated traffic context", Signal Process Image Commun, vol.84

  59. Zou Q, Jiang H, Dai Q, Yue Y, Chen L, Wang Q (2019) "Robust lane detection from continuous driving scenes using deep neural networks", IEEE Trans Vehicular Technol

Download references

Acknowledgements

I would like to express my very great appreciation to the co-authors of this manuscript for their valuable and constructive suggestions during the planning and development of this research work.

Funding

This research did not receive any specific funding.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Siksha ‘O’ Anusandhan Deemed to be University, Bhubaneswar, Odisha, India

    Deepak Kumar Dewangan

  2. Department of Information Technology, National Institute of Technology, Raipur, Chhattisgarh, India

    Satya Prakash Sahu

Authors
  1. Deepak Kumar Dewangan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Satya Prakash Sahu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have made substantial contributions to conception and design, revising the manuscript, and the final approval of the version to be published. Also, all authors agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Corresponding author

Correspondence to Deepak Kumar Dewangan.

Ethics declarations

Conflict of interest

The authors declare no conflict of interest.

Informed consent

Not Applicable.

Ethical approval

Not Applicable.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dewangan, D.K., Sahu, S.P. Lane detection in intelligent vehicle system using optimal 2- tier deep convolutional neural network. Multimed Tools Appl 82, 7293–7317 (2023). https://doi.org/10.1007/s11042-022-13425-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13425-7

Keywords

Search

Navigation