Skip to main content
Log in

Bayesian curved lane estimation for autonomous driving

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Several pieces of research during the last decade in intelligent perception are focused on the development of algorithms allowing vehicles to move efficiently in complex environments. Most of existing approaches suffer from either processing time which do not meet real-time requirements, or inefficient in real complex environment, which also does not meet the full availability constraint of such a critical function. To improve the existing solutions, an algorithm based on curved lane detection by using a Bayesian framework for the estimation of multi-hyperbola parameters is proposed to detect curved lane under challenging conditions. The general idea is to divide a captured image into several parts. The trajectory is modeled by a hyperbola over each part, whose parameters are estimated using the proposed hierarchical Bayesian model. Compared to the existing works in the state of the art, experimental results prove that our approach is more efficient and more precise in road marking detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Notes

  1. \( {\text{TPR}} = \frac{{\# {\rm{detectedlanes}}}}{{\# {\text{targetlanes}}}} \) and \(FPR = \frac{\# {\text{false positive}}}{\# {\text{target lanes}}}\).

References

  • Aly M (2008) Real time detection of lane markers in urban streets. In: 2008 IEEE intelligent vehicles symposium, IEEE, pp 7–12

  • Andrieu C (1998) Methodes MCMC pour l’analyse bayesienne de modeles de regression parametrique non lineaire. Application a l’analyse de raies et a la deconvolution impulsionnelle. PhD thesis, Cergy-Pontoise

  • Antolovic D (2008) Review of the hough transform method, with an implementation of the fast hough variant for line detection. Department of Computer Science, Indiana University, Bloomington

    Google Scholar 

  • Anwary AR, Yu H, Vassallo M (2018) Optimal foot location for placing wearable imu sensors and automatic feature extraction for gait analysis. IEEE Sens J 18(6):2555–2567

    Article  Google Scholar 

  • Arcos-García Á, Álvarez-García JA, Soria-Morillo LM (2018) Deep neural network for traffic sign recognition systems: an analysis of spatial transformers and stochastic optimisation methods. Neural Netw 99:158–165

    Article  Google Scholar 

  • Botekar NP, Mahalakshmi M (2017) Development of road sign recognition for adas using opencv. In: 2017 international conference on intelligent computing and control (I2C2), IEEE, pp 1–4

  • Bottazzi VS, Borges PVK, Stantic B, Jo J (2014) Adaptive regions of interest based on HSV histograms for lane marks detection. In: Kim JH, Matson E, Myung H, Xu P, Karray F (eds) Robot intelligence technology and applications 2, vol 274. Springer, Cham, pp 677–687. https://doi.org/10.1007/978-3-319-05582-4_58

    Chapter  Google Scholar 

  • Bouguet JY (2001) Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corpor 5(1–10):4

    Google Scholar 

  • Bresson G, Alsayed Z, Yu L, Glaser S (2017) Simultaneous localization and mapping: a survey of current trends in autonomous driving. IEEE Trans Intell Vehicles 2(3):194–220

    Article  Google Scholar 

  • Broggi A, Cerri P, Medici P, Porta PP, Ghisio G (2007) Real time road signs recognition. In: 2007 IEEE intelligent vehicles symposium, IEEE, pp 981–986

  • Cela AF, Bergasa LM, Sanchez FL, Herrera MA (2013) Lanes detection based on unsupervised and adaptive classifier. In: 2013 fifth international conference on computational intelligence, communication systems and networks, IEEE, pp 228–233

  • Che G, Liu L, Yu Z (2019) An improved ant colony optimization algorithm based on particle swarm optimization algorithm for path planning of autonomous underwater vehicle. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-019-01531-8

    Article  Google Scholar 

  • Chen Q, Wang H (2006) A real-time lane detection algorithm based on a hyperbola-pair model. In: 2006 IEEE intelligent vehicles symposium, IEEE, pp 510–515

  • Chen Y, He M (2012) Sharp curve lane boundaries projective model and detection. In: IEEE 10th international conference on industrial informatics, IEEE, pp 1188–1193

  • Chengping Y, Lincheng S, Dianle Z, Daibing Z, Zhiwei Z (2014) A new calibration method for vision system using differential GPS. In: 2014 13th international conference on control automation robotics and vision (ICARCV), IEEE, pp 1514–1517

  • Chiu S-H, Wen C-Y, Lee J-H, Lin K-H, Chen H-M (2012) A fast randomized generalized hough transform for arbitrary shape detection. Int J Innov Comput Inf Control 8(2):1103–1116

    Google Scholar 

  • Cimurs R, Hwang J, Suh IH (2017) Bezier curve-based smoothing for path planner with curvature constraint. In: 2017 first IEEE international conference on robotic computing (IRC), IEEE, pp 241–248

  • Cowles MK, Carlin BP (1996) Markov chain monte carlo convergence diagnostics: a comparative review. J Am Stat Assoc 91(434):883–904

    Article  MathSciNet  Google Scholar 

  • Dagnino C, Lamberti P, Remogna S (2015) Curve network interpolation by c1 quadratic b-spline surfaces. Comput Aided Geometr Des 40:26–39

    Article  Google Scholar 

  • Faizal ERM, Mansor HMAH (2009) Virtual mid-line detection on curve road for user guidance using simulation model. 2009 Int Conf Comput Technol Dev IEEE 1:24–27

    Article  Google Scholar 

  • Fakhfakh M, Fakhfakh N, Chaari L (2018) Robust lane extraction using two-dimension declivity. In: International conference on artificial intelligence and soft computing, Springer, pp 14–24

  • Fan C, Jb Xu, Di S (2013) Lane detection based on machine learning algorithm. Telkomnika Indones J Electr Eng 12(2):1403–1409

    Google Scholar 

  • Guo SY, Kong YG, Tang Q, Zhang F (2008) Probabilistic hough transform for line detection utilizing surround suppression. 2008 Int Conf Mach Learn Cybern IEEE 5:2993–2998

    Article  Google Scholar 

  • Guo J, Wei Z, Miao D (2015) Lane detection method based on improved ransac algorithm. In: 2015 IEEE twelfth international symposium on autonomous decentralized systems, IEEE, pp 285–288

  • Hassanein AS, Mohammad S, Sameer M, Ragab ME (2015) A survey on hough transform, theory, techniques and applications. arXiv preprint arXiv:150202160

  • Ieng SS, Vrignon J, Gruyer D, Aubert D (2005) A new multi-lanes detection using multi-camera for robust vehicle location. In: IEEE proceedings. Intelligent vehicles symposium, IEEE, pp 700–705

  • Izadinia H, Sadeghi F, Ebadzadeh MM (2009) Fuzzy generalized hough transform invariant to rotation and scale in noisy environment. In: 2009 IEEE international conference on fuzzy systems, IEEE, pp 153–158

  • Jang HJ, Baek SH, Park SY (2014) Curved lane detection using robust feature extraction. In: The 2014 2nd international conference on systems and informatics (ICSAI 2014), IEEE, pp 109–112

  • Jung CR, Kelber CR (2005) Lane following and lane departure using a linear-parabolic model. 2005 Image Vis Comput 23:1192–1202

    Article  Google Scholar 

  • Khalifa OO, Khan IM, Assidiq AA, Abdulla AH, Khan S (2010) A hyperbola-pair based lane detection system for vehicle guidance. Proc World Congress Eng Comput Sci 1:978–988

    Google Scholar 

  • Kim H (2019) Multiple vehicle tracking and classification system with a convolutional neural network. J Ambient Intell Human Comput 1:1. https://doi.org/10.1007/s12652-019-01429-5

    Article  Google Scholar 

  • Kim J, Lee M (2014) Robust lane detection based on convolutional neural network and random sample consensus. In: International conference on neural information processing, Springer, pp 454–461

  • Kim J, Park C (2017a) End-to-end ego lane estimation based on sequential transfer learning for self-driving cars. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 30–38

  • Kim T, Park T (2017b) Calibration method between dual 3D lidar sensors for autonomous vehicles. In: 2017 56th annual conference of the Society of Instrument and Control Engineers of Japan (SICE), IEEE, pp 1075–1081

  • Kim J, Kim J, Jang GJ, Lee M (2017) Fast learning method for convolutional neural networks using extreme learning machine and its application to lane detection. Neural Netw 87:109–121

    Article  Google Scholar 

  • Kultanen P, Xu L, Oja E (1990) Randomized hough transform (RHT). [1990] Proc 10th Int Conf Pattern Recognit IEEE 1:631–635

    Article  Google Scholar 

  • Lee M, Han KY, Yu J, Lee YS (2019) A new lane following method based on deep learning for automated vehicles using surround view images. J Ambient Intell Human Comput 1:1. https://doi.org/10.1007/s12652-019-01496-8

    Article  Google Scholar 

  • Li J, Mei X, Prokhorov D, Tao D (2017a) Deep neural network for structural prediction and lane detection in traffic scene. IEEE Trans Neural Netw Learn Syst 28(3):690–703

    Article  Google Scholar 

  • Li S, Xu J, Wei W, Qi H (2017b) Curve lane detection based on the binary particle swarm optimization. In: 2017 29th Chinese control and decision conference (CCDC), IEEE, pp 75–80

  • Li M, Li Y, Jiang M (2018) Lane detection based on connection of various feature extraction methods. Adv Multimed 2018:8320207. https://doi.org/10.1155/2018/8320207

    Article  Google Scholar 

  • Lim KH, Seng KP, Ang L-M (2012) River flow lane detection and kalman filtering-based b-spline lane tracking. Int J Veh Technol 2012:465819. https://doi.org/10.1155/2012/465819

    Article  Google Scholar 

  • Lin Q, Han Y, Hahn H (2010) Real-time lane departure detection based on extended edge-linking algorithm. In: 2010 second international conference on computer research and development, IEEE, pp 725–730

  • Liu J, Lou L, Huang D, Zheng Y, Xia W (2018) Lane detection based on straight line model and k-means clustering. In: 2018 IEEE 7th data driven control and learning systems conference (DDCLS), IEEE, pp 527–532

  • Liu X, Wang G, Liao J, Li B, He Q, Meng MQH (2012) Detection of geometric shape for traffic lane and mark. In: 2012 IEEE international conference on information and automation, IEEE, pp 395–399

  • Lopez-Krahe J, Pousset P (1988) Transformée de hough discrete et bornée, applicationa la d’etection de droites paralleles et du réseau routier. Traitement du signal 5(4):281–290

    Google Scholar 

  • Merali RS, Barfoot TD (2013) Occupancy grid mapping with markov chain monte carlo gibbs sampling. In: 2013 IEEE international conference on robotics and automation, IEEE, pp 3183–3189

  • Mukhopadhyay P, Chaudhuri BB (2015) A survey of hough transform. Pattern Recognit 48(3):993–1010

    Article  Google Scholar 

  • Nguyen TT, Spehr J, Lin THH, Lipinski D (2015) Fused raised pavement marker detection using 2d-lidar and mono camera. In: IEEE 18th international conference on intelligent transportation systems, IEEE, pp 2346–2351

  • Parajuli A, Celenk M, Riley HB (2013) Robust lane detection in shadows and low illumination conditions using local gradient features. Open J Appl Sci 3(01):68

    Article  Google Scholar 

  • Roumeliotis SI, Bekey GA (2000) Bayesian estimation and kalman filtering: s unified framework for mobile robot localization. In: Proceedings 2000 ICRA. Millennium conference. IEEE international conference on robotics and sutomation. Symposia proceedings (Cat. No. 00CH37065), IEEE, vol 3, pp 2985–2992

  • Santana DDS, Furukawa CM, Maruyama N (2013) Sensor fusion with low-grade inertial sensors and odometer to estimate geodetic coordinates in environments without gps signal. IEEE Latin Am Trans 11(4):1015–1021

    Article  Google Scholar 

  • Saxena P, Gupta N, Laskar SY, Borah PP (2015) A study on automatic detection and recognition techniques for road signs. Int J Comput Eng Res 5(12):24–28

    Google Scholar 

  • Shenoy MV, Karuppiah A, Manjarekar N (2019) A lightweight ann based robust localization technique for rapid deployment of autonomous systems. J Ambient Intell Human Comput 1:1. https://doi.org/10.1007/s12652-019-01331-0

    Article  Google Scholar 

  • Shiffrin RM, Lee MD, Kim W, Wagenmakers EJ (2008) A survey of model evaluation approaches with a tutorial on hierarchical bayesian methods. Cognit Sci 32(8):1248–1284

    Article  Google Scholar 

  • Song W, Yang Y, Fu M, Li Y, Wang M (2018) Lane detection and classification for forward collision warning system based on stereo vision. IEEE Sens J 18(12):5151–5163

    Article  Google Scholar 

  • Tan H, Zhou Y, Zhu Y, Yao D, Li K (2014) A novel curve lane detection based on improved river flow and ransa. In: 17th international IEEE conference on intelligent transportation systems (ITSC), IEEE, pp 133–138

  • Tan H, Zhou Y, Zhu Y, Yao D, Wang J (2015) Improved river flow and random sample consensus for curve lane detection. Adv Mech Eng 7(7):1687814015593866

    Article  Google Scholar 

  • Thomas AD (1992) Compressing the parameter space of the generalised hough transform. Pattern Recognit Lett 13(2):107–112

    Article  Google Scholar 

  • Timar Y, Alagoz F (2010) Lane detection for intelligent vehicles in challenging scenarios. In: 2010 2nd international conference on computational intelligence, communication systems and networks, IEEE, pp 37–43

  • Veit T, Tarel JP, Nicolle P, Charbonnier P (2008) Evaluation of road marking feature extraction. In: 2008 11th international IEEE conference on intelligent transportation systems, IEEE, pp 174–181

  • Wang J, An X (2010) A multi-step curved lane detection algorithm based on hyperbola-pair model. In: 2010 IEEE international conference on automation and logistics, IEEE, pp 132–137

  • Wang Y, Teoh EK, Shen D (1999) Lane detection using b-snake. In: Proceedings 1999 international conference on information intelligence and systems (Cat. No. PR00446), IEEE, pp 438–443

  • Wang Y, Bai L, Fairhurst M (2008) Robust road modeling and tracking using condensation. IEEE Trans Intell Transp Syst 9(4):570

    Article  Google Scholar 

  • Wu Y, Chen Z (2016) A detection method of road traffic sign based on inverse perspective transform. In: 2016 IEEE international conference of online analysis and computing science (ICOACS), IEEE, pp 293–296

  • Xu L, Oja E, Kultanen P (1990) A new curve detection method: randomized hough transform (rht). Pattern Recognit Lett 11(5):331–338

    Article  Google Scholar 

  • Zhou Y, Dong Z (2017) A vision-based autonomous detection scheme for obstacles on the runway. In: 2017 Chinese automation congress (CAC), IEEE, pp 832–838

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohamed Fakhfakh.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fakhfakh, M., Chaari, L. & Fakhfakh, N. Bayesian curved lane estimation for autonomous driving. J Ambient Intell Human Comput 11, 4133–4143 (2020). https://doi.org/10.1007/s12652-020-01688-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-020-01688-7

Keywords

Navigation