Skip to main content

Enhanced Autonomous Driving Through Improved 3D Objects Detection

  • Conference paper
  • First Online:
Book cover Advanced Information Networking and Applications (AINA 2022)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 449))

  • 911 Accesses

Abstract

The detection of 3D objects is fundamental in the field of autonomous driving. The involved computations consist of sets of 3D bounding boxes that determine specific significant objects. The existing scientific contributions generally do not report applied studies that assess the reliability of 3D objects detection considering various weather conditions, including adverse scenarios like heavy rain and thick fog, and also other relevant problematic use cases. This paper presents an applied research process that describes the core of a 3D objects detection system, which considers two particular road topologies, a roundabout and a T-junction. The experimental data is collected through a partnership with several car manufacturers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Geiger, A., Lenz, P., Urtasun, R.: Are We ready for autonomous driving? The KITTI vision benchmark suite. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA, 16–21 June 2012, vol. 2012, pp. 3354–3361 (2012)

    Google Scholar 

  • Chen, X., Ma, H., Wan, J., Li, B., Xia, T.: Multi-view 3D object detection network for autonomous driving. In: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017

    Google Scholar 

  • Ku, J., Mozifian, M., Lee, J., Harakeh, A., Waslander, S.: Joint 3D proposal generation and object detection from view aggregation. In: Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 1–5 October 2018

    Google Scholar 

  • Qi, C.R., Liu, W., Wu, C., Su, H., Guibas, L.J.: Frustum PointNets for 3D object detection from RGB-D data. In: Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–23 June 2018

    Google Scholar 

  • Ortiz, L.E., Cabrera, E.V., Gonçalves, L.M.: Depth data error modeling of the zed 3D vision sensor from stereolabs. ELCVIA Electron. Lett. Comput. Vis. Image Anal. 17, 1–15 (2013)

    Google Scholar 

  • Roberts, R., Sinha, S.N., Szeliski, R., Steedly, D.: Structure from motion for scenes with large duplicate structures. In: Proceedings of the CVPR 2011, Colorado Springs, CO, USA, 20–25 June 2011, pp. 3137–3144 (2011)

    Google Scholar 

  • Arnold, E., Al-Jarrah, O.Y., Dianati, M., Fallah, S., Oxtoby, D., Mouzakitis, A.: A survey on 3D object detection methods for autonomous driving applications. IEEE Trans. Intell. Transp. Syst. 20, 3782–3795 (2019)

    Article  Google Scholar 

  • Beltran, J., Guindel, C., Moreno, F.M., Cruzado, D., Garcia, F., De La Escalera, A.: BirdNet: a 3D object detection framework from Lidar information. In: Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA, 4–7 November 2018, pp. 3517–3523 (2018)

    Google Scholar 

  • Li, B., Zhang, T., Xia, T.: Vehicle detection from 3D lidar using fully convolutional network. In: Proceedings of Robotics: Science and Systems, Ann Arbor, MI, USA, 18–22 June 2016

    Google Scholar 

  • Simony, M., Milzy, S., Amendey, K., Gross, H.-M.: Complex-YOLO: an Euler-region-proposal for real-time 3D object detection on point clouds. In: Proceedings of the European Conference on Computer Vision (ECCV) Workshops, 8–14 September 2018

    Google Scholar 

  • Castanedo, F.: A review of data fusion techniques. Sci. World J. 2013, 142–149 (2013)

    Article  Google Scholar 

  • Feng, D., et al.: Deep multi-modal object detection and semantic segmentation for autonomous driving: datasets, methods, and challenges. arXiv 2019 arXiv:1902.07830

  • Zhou, Y., Tuzel, O.: Voxelnet: end-to-end learning for point cloud based 3D object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA, 18–23 June 2018

    Google Scholar 

  • Shi, S., Wang, X., Li, H.: PointRCNN: 3D object proposal generation and detection from point cloud. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15–20 June 2019

    Google Scholar 

  • Yang, S., Sun, Y., Liu, S., Shen, X., Jia, J:. STD: Sparse-to-Dense 3D object detector for point cloud. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), Seoul, Korea, 27 October–2 November 2019, pp. 1951–1960 (2019)

    Google Scholar 

  • Qi, C.R.; Su, H.; Mo, K.; Guibas, L.J. PointNet: Deep learning on point sets for 3D classification and segmentation. In: Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21–26 July 2017, pp. 652–660 (2017)

    Google Scholar 

  • Chen, Q., Tang, S., Yang, Q., Fu, S.: Cooper: cooperative perception for connected autonomous vehicles based on 3D point clouds. In: Proceedings of the 39th IEEE International Conference on Distributed Computing Systems (ICDCS), Dallas, TX, USA, 7–10 July 2019

    Google Scholar 

  • Chen, Q., Ma, X., Tang, S., Guo, J., Yang, Q., Fu, S.: F-Cooper: feature based cooperative perception for autonomous vehicle edge computing system using 3D point clouds. In: Proceedings of the IEEE/ACM Symposium on Edge Computing (SEC), 7–9 November 2019

    Google Scholar 

  • Hurl, B., Kohen, R., Czarnecki, K., Waslander, S.: TruPercept: trust modelling for autonomous vehicle cooperative perception from synthetic data. In: Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA, 19 October–13 November 2020

    Google Scholar 

  • Ghamisi, P.: Multisource and multitemporal data fusion in remote sensing: a comprehensive review of the state of the art. IEEE Geosci. Remote. Sens. Mag. 7, 6–39 (2019)

    Article  Google Scholar 

  • Yin, L., Wang, X., Ni, Y., Zhou, K., Zhang, J.: Extrinsic parameters calibration method of cameras with non-overlapping fields of view in airborne remote sensing. Remote Sens. 10, 1298 (2018)

    Article  Google Scholar 

  • Yue, R., Xu, H., Wu, J., Sun, R., Yuan, C.: Data registration with ground points for roadside Lidar sensors. Remote Sens. 11, 1354 (2019)

    Article  Google Scholar 

  • Knorr, M., Niehsen, W., Stiller, C.: Online extrinsic multi-camera calibration using ground plane induced homographies. In: Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, Australia, 23–26 June 2013, pp. 236–241 (2013)

    Google Scholar 

  • Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards realtime object detection with region proposal networks. In: Proceedings of the Advances in Neural Information Processing Systems, vol. 7–12, pp. 91–99 (2015)

    Google Scholar 

  • Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., Coltun, V.: CARLA: an open urban driving simulator. In: Proceedings of the 1st Annual Conference on Robot Learning, 13–15 November 2017, pp. 1–16 (2017)

    Google Scholar 

  • Everingham, M., Van Gool, L., Williams, C.K., Winn, J., Zisserman, A.: The Pascal visual object classes (VOC) challenge. Int. Comput. Vis. 88, 303–338 (2010)

    Article  Google Scholar 

  • Xu, S., Liu, H., Gao, F., Wang, Z.: Compressive sensing based radio tomographic imaging with spatial diversity. Sensors 19, 439 (2019)

    Article  Google Scholar 

  • Schlosser, J., Chow, C.K., Kira, Z.: Fusing Lidar and images for pedestrian detection using convolutional neural networks. In: Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden, 16–21 May 2016, pp. 2198–2205 (2016)

    Google Scholar 

  • Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv 2015 arXiv:1409.1556

  • Du, X., Ang, M.H., Karaman, S., Rus, D.: A general pipeline for 3D detection of vehicles. In: Proceedings of the 2018 IEEE International Conference on Robotics and Automation, Brisbane, Australia, 21–25 May 2018, pp. 3194–3200 (2018)

    Google Scholar 

  • Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, vol. 21–26, pp. 2117–2125 (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Razvan Bocu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bocu, R., Iavich, M. (2022). Enhanced Autonomous Driving Through Improved 3D Objects Detection. In: Barolli, L., Hussain, F., Enokido, T. (eds) Advanced Information Networking and Applications. AINA 2022. Lecture Notes in Networks and Systems, vol 449. Springer, Cham. https://doi.org/10.1007/978-3-030-99584-3_6

Download citation

Publish with us

Policies and ethics