Skip to main content

Combining CNN and MRF for Road Detection

  • Chapter
  • First Online:
Artificial Intelligence and Robotics

Part of the book series: Studies in Computational Intelligence ((SCI,volume 752))

Abstract

Road detection aims at detecting the (drivable) road surface ahead vehicle and plays a crucial role in driver assistance system. To improve the accuracy and robustness of road detection approaches in complex environments, a new road detection method based on CNN (convolutional neural network) and MRF (markov random field) is proposed. The original road image is segmented into super-pixels of uniform size using simple linear iterative clustering (SLIC) algorithm. On this basis, we train the CNN which can automatically learn the features that are most beneficial to classification. Then, the trained CNN is applied to classify road region and non-road region. Finally, based on the relationship between the super-pixels neighborhood, we utilize MRF to optimize the classification results of CNN. Quantitative and qualitative experiments on the publicly datasets demonstrate that the proposed method is robust in complex environments. Furthermore, compared with state-of-the-art algorithms, the approach provides the better performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Research Institute of Highway Ministry of Transport: The Blue Book of Road Safety in China 2014, pp. 13–14. China Communications Press, Beijing (2015)

    Google Scholar 

  2. Cao, X., Lin, R., Yan, P., Li, X.: Visual attention accelerated vehicle detection in low-altitude airborne video of urban environment. IEEE Trans. Circuits Syst. Video Technol. 22(3), 366–378 (2012)

    Article  Google Scholar 

  3. Wang, K., Huang, Z.H., Zhong, Z.H.: Algorithm for urban road detection based on uncertain bezier deformable template. J. Mech. Eng. 49(8), 143–150 (2013)

    Article  Google Scholar 

  4. Wang, J., Gu, F., Zhang, C., Zhang, G.: Lane boundary detection based on parabola model. In: IEEE International Conference on Information and Automation, pp. 1729–1734. IEEE, Harbin (2010)

    Google Scholar 

  5. Kong, H., Audibert, J.Y., Ponce, J.: Vanishing point detection for road detection. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 96–103. IEEE (2009)

    Google Scholar 

  6. Alvarez, J.M., ĹOpez, A.M.: Road detection based on illuminant invariance. IEEE Trans. Intell. Transp. Syst. 12(1), 184–193 (2011)

    Article  Google Scholar 

  7. Mendes, C.C.T., Frémont, V., Wolf, D.F.: Exploiting fully convolutional neural networks for fast road detection. In: IEEE International Conference on Robotics and Automation. IEEE (2016)

    Google Scholar 

  8. Brostow, G.J., Shotton, J., Fauqueur, J., Cipolla, R.: Segmentation and recognition using structure from motion point clouds. In: ECCV, vol. 1, pp. 44–57 (2008)

    Google Scholar 

  9. Sturgess, P., Alahari, K., Ladicky, L., Torr, P.H.S.: Combining appearance and structure from motion features for road scene understanding. In: BMVC’09 (2009)

    Google Scholar 

  10. Yuan, Y., Jiang, Z., Wang, Q.: Video-based road detection via online structural learning. Neurocomputing 168(C), 336–347 (2015)

    Google Scholar 

  11. Fernández, C., Izquierdo, R., Llorca, D.F., Sotelo, M.A: A comparative analysis of decision trees based classifiers for road detection in urban environments. In: Proceedings of the IEEE International Conference on Intelligent Transportation Systems 2015, pp. 719–724 (2015)

    Google Scholar 

  12. Alvarez, J.M., Gevers, T., Lecun, Y., Lopez, A.M.: Road scene segmentation from a single image. In: Computer Vision–ECCV, pp. 376–389. Springer, Berlin (2012)

    Google Scholar 

  13. Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high definition ground truth database. Pattern Recogn. Lett. 30(2), 88–97 (2009)

    Article  Google Scholar 

  14. Achanta, R., Shaji, A., Smith, K.: SLIC super-pixels compared to state-of-the-art super-pixels methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)

    Article  Google Scholar 

  15. Achanta, R., Shaji, A., Smith, K.: SLIC Super-pixels. Swiss federal Institute of Technology, Lausanne, Vaud, Switzerland (2010)

    Google Scholar 

  16. Cecotti, H., Graser, A.: Convolutional neural networks for P300 detection with application to brain-computer interfaces. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 433–445 (2010)

    Article  Google Scholar 

  17. Ji, S., Xu, W., Yang, M., et al.: 3D convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. lntell. 35(1), 221–231 (2013)

    Article  Google Scholar 

  18. Turaga, S.C., Murray, J.F., Jain, V., Roth, F., Helmstaedter, M., Briggman, K., Denk, W., Seung, H.S.: Convolutional networks can learn to generate affinity graphs for image segmentation. Neural Comp. 22, 511–538 (2010)

    Article  MATH  Google Scholar 

  19. Lu, H., Li, Y., Chen, M., Kim, H., Serikawa, S.: Brain intelligence: go beyond artificial intelligence. Mob. Netw. Appl. 1–10 (2017)

    Google Scholar 

  20. Lu, H., Li, Y., Mu, S., Wang, D., Kim, H., Serikawa, S.: Motor anomaly detection for unmanned aerial vehicles using reinforcement learning. IEEE Int. Things J. https://doi.org/10.1109/JIOT.2017.2737479

  21. Lu, H., Li, B., Zhu, J., Li, Y., Li, Y., He, L., Li, J., Serikawa, S.: Wound intensity correction and segmentation with convolutional neural networks. Concurrency Comput. Pract. Experience. https://doi.org/10.1002/cpe.3927

  22. Serikawa, S., Lu, H.: Underwater image dehazing using joint trilateral filter. Comput. Electr. Eng. 40(1), 41–50 (2014)

    Article  Google Scholar 

  23. Li, S.Z.: Markov Random Field Modeling in Computer Vision. Springer, Tokyo, Japan (1995)

    Google Scholar 

  24. Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high definition ground truth database. Pattern Recog. Lett. (2008)

    Google Scholar 

Download references

Acknowledgements

This work is supported by National Natural Science Foundation of China under grant No. 61601325, the key technologies R & D program of Tianjin under grant No.14ZCZDGX00033, and research project for application foundation and frontier technology of Tianjin under grant No. 14JCYBJC42300.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhitao Xiao .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Geng, L., Sun, J., Xiao, Z., Zhang, F., Wu, J. (2018). Combining CNN and MRF for Road Detection. In: Lu, H., Xu, X. (eds) Artificial Intelligence and Robotics. Studies in Computational Intelligence, vol 752. Springer, Cham. https://doi.org/10.1007/978-3-319-69877-9_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-69877-9_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-69876-2

  • Online ISBN: 978-3-319-69877-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics