Advertisement

Polynomial Regression Network for Variable-Number Lane Detection

Conference paper
  • 488 Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 12363)

Abstract

Lane detection is a fundamental yet challenging task in autonomous driving and intelligent traffic systems due to perspective projection and occlusion. Most of previous methods utilize semantic segmentation to identify the regions of traffic lanes in an image, and then adopt some curve-fitting method to reconstruct the lanes. In this work, we propose to use polynomial curves to represent traffic lanes and then propose a novel polynomial regression network (PRNet) to directly predict them, where semantic segmentation is not involved. Specifically, PRNet consists of one major branch and two auxiliary branches: (1) polynomial regression to estimate the polynomial coefficients of lanes, (2) initialization classification to detect the initial retrieval point of each lane, and (3) height regression to determine the ending point of each lane. Through the cooperation of three branches, PRNet can detect variable-number of lanes and is highly effective and efficient. We experimentally evaluate the proposed PRNet on two popular benchmark datasets: TuSimple and CULane. The results show that our method significantly outperforms the previous state-of-the-art methods in terms of both accuracy and speed.

Keywords

Lane detection Polynomial curve Deep neural network Polynomial regression 

Notes

Acknowledgment

This work is supported by the National Natural Science Foundation of China under Grant 61673362 and 61836008, Youth Innovation Promotion Association CAS (2017496), and the Fundamental Research Funds for the Central Universities.

Supplementary material

504473_1_En_42_MOESM1_ESM.pdf (1.2 mb)
Supplementary material 1 (pdf 1214 KB)

References

  1. 1.
    Aly, M.: Real time detection of lane markers in urban streets. In: IV (2008)Google Scholar
  2. 2.
    Borkar, A., Hayes, M., Smith, M.T.: Polar randomized hough transform for lane detection using loose constraints of parallel lines. In: ICASSP (2011)Google Scholar
  3. 3.
    Ester, M., Kriegel, H.P., Sander, J., Xu, X., et al.: A density-based algorithm for discovering clusters in large spatial databases with noise. In: KDD (1996)Google Scholar
  4. 4.
    Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Garnett, N., Cohen, R., Pe’er, T., Lahav, R., Levi, D.: 3D-lanenet: end-to-end 3D multiple lane detection. In: CVPR (2019)Google Scholar
  6. 6.
    Ghafoorian, M., Nugteren, C., Baka, N., Booij, O., Hofmann, M.: EL-GAN: embedding loss driven generative adversarial networks for lane detection. In: Leal-Taixé, L., Roth, S. (eds.) ECCV 2018. LNCS, vol. 11129, pp. 256–272. Springer, Cham (2019).  https://doi.org/10.1007/978-3-030-11009-3_15CrossRefGoogle Scholar
  7. 7.
    Gonzalez, J.P., Ozguner, U.: Lane detection using histogram-based segmentation and decision trees. In: IEEE Intelligent Transportation Systems (2000)Google Scholar
  8. 8.
    He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: CVPR (2016)Google Scholar
  9. 9.
    He, Y., Wang, H., Zhang, B.: Color-based road detection in urban traffic scenes. In: IEEE Transactions on Intelligent Transportation Systems, pp. 309–318 (2004)Google Scholar
  10. 10.
    Hou, Y., Ma, Z., Liu, C., Loy, C.C.: Learning lightweight lane detection CNNs by self attention distillation. In: ICCV (2019)Google Scholar
  11. 11.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  12. 12.
    Lee, S., et al.: Vpgnet: Vanishing point guided network for lane and road marking detection and recognition. In: ICCV (2017)Google Scholar
  13. 13.
    Li, X., Li, J., Hu, X., Yang, J.: Line-CNN: end-to-end traffic line detection with line proposal unit. IEEE Trans. Intell. Transp. Syst. 21, 248–258 (2019)CrossRefGoogle Scholar
  14. 14.
    McCall, J.C., Trivedi, M.M.: An integrated, robust approach to lane marking detection and lane tracking. In: IV (2004)Google Scholar
  15. 15.
    McCall, J.C., Trivedi, M.M.: Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation (2006)Google Scholar
  16. 16.
    Neven, D., De Brabandere, B., Georgoulis, S., Proesmans, M., Van Gool, L.: Towards end-to-end lane detection: an instance segmentation approach. In: IV (2018)Google Scholar
  17. 17.
    Pan, X., Shi, J., Luo, P., Wang, X., Tang, X.: Spatial as deep: Spatial cnn for traffic scene understanding. In: AAAI (2018)Google Scholar
  18. 18.
    Philion, J.: FastDraw: addressing the long tail of lane detection by adapting a sequential prediction network. In: CVPR (2019)Google Scholar
  19. 19.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems (2015)Google Scholar
  20. 20.
    Romera, E., Alvarez, J.M., Bergasa, L.M., Arroyo, R.: ERFNet: efficient residual factorized convNet for real-time semantic segmentation. IEEE Trans. Intell. Transp. Syst. 19, 263–272 (2017)CrossRefGoogle Scholar
  21. 21.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
  22. 22.
    Szegedy, C., et al.: Going deeper with convolutions. In: CVPR (2015)Google Scholar
  23. 23.
    TuSimple: http://benchmark.tusimple.ai/#/t/1. Accessed 08 Sept 2018
  24. 24.
    Van Gansbeke, W., De Brabandere, B., Neven, D., Proesmans, M., Van Gool, L.: End-to-end lane detection through differentiable least-squares fitting. In: ICCV Workshop (2019)Google Scholar
  25. 25.
    Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., Sang, N.: BiSeNet: bilateral segmentation network for real-time semantic segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11217, pp. 334–349. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-01261-8_20CrossRefGoogle Scholar
  26. 26.
    Zhou, S., Jiang, Y., Xi, J., Gong, J., Xiong, G., Chen, H.: A novel lane detection based on geometrical model and Gabor filter. In: IV (2010)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.University of Science and Technology of ChinaHefeiChina

Personalised recommendations