Abstract
The development of autonomous driving technology proposes higher requirements of the fidelity of the high-definition maps (HD maps). The construction of HD map based on orthophotos generated from panoramic images is the state-of-the-art approach. However, in this process, the dynamic obstacles and shadows on the road captured by the panoramic camera has significant impact on reducing the map quality. Moreover, the GNSS signal may inevitably unavailable or have jitter error, leading to the unsatisfactory of the orthophoto mosaic. Therefore, an approach is proposed to tackle these problems of HD map construction. The semantic segmentation of the panoramic images is firstly implemented to extract the dynamic obstacles such as vehicles and the road segments. Then the shadows on the road segments are removed through GAN networks to generate clean orthophotos. Afterwards, the clean orthophotos are used for feature extraction and image registration based on the road segmentation to provide finer pose estimations. Finally, the GNSS data, odometer data, and estimated poses are combined to optimize the vehicle pose for orthophoto mosaic. The experimental results illustrate that the proposed approach can improve the HD map construction accuracy under the congested environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Häne, C., et al.: 3D visual perception for self-driving cars using a multi-camera system: Calibration, mapping, localization, and obstacle detection. Image Vis. Comput. 68, 14–27 (2017)
Lee, U., et al.: Development of a self-driving car that can handle the adverse weather. Int. J. Autom. Technol. 19(1), 191–197 (2018)
He, Y., et al.: Generation of precise lane-level maps based on multi-sensors. J. Chang’an Univ. (Nat. Sci. Edn.) S1, 274–278 (2015)
Li, L., et al.: An overview on sensor map based localization for automated driving. In: 2017 Joint Urban Remote Sensing Event (JURSE), pp. 1–4 (2017)
Lindong, G., et al.: Occupancy grid based urban localization using weighted point cloud. In: 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), pp. 60–65 (2016)
Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)
Lakshmi, S., Sankaranarayanan, D.V.: A study of edge detection techniques for segmentation computing approaches. In: IJCA Special Issue on “Computer Aided Soft Computing Techniques for Imaging and Biomedical Applications”, pp. 35–40 (2010)
Chen, L., et al.: DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans. Pattern Anal. Mach. Intell. 40(4), 834–848 (2018)
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) ECCV 2018. LNCS, vol. 11211, pp. 833–851. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01234-2_49
Shelhamer, E., Long, J., Darrell, T.: Fully convolutional networks for semantic segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(4), 640–651 (2017)
Goodfellow, I., et al.: Generative adversarial nets. In: Advances in Neural Information Processing Systems 27 (NIPS 2014), pp. 2672–2680 (2014)
Nguyen, V., et al.: Shadow detection with conditional generative adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp. 4510–4518 (2017)
Fredembach, C., Finlayson, G.: Simple shadow removal. In: 18th International Conference on Pattern Recognition (ICPR 2006), pp. 832–835 (2006)
Wang, J., Li, X., Yang, J.: Stacked conditional generative adversarial networks for jointly learning shadow detection and shadow removal. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1788–1797 (2018)
Shen, K., Guang, X., Li, W.: Application of EKF in integrated navigation system. Trans. Microsyst. Technol. 36(8), 158–160 (2017)
Fan, Y., et al.: Study on a stitching algorithm of the iterative closest point based on dynamic hierarchy. J. Opt. Technol. 82(1), 28–32 (2015)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)
Acknowledgements
The research work presented in this paper is sponsored by National Natural Science Foundation of China (U1764264/61873165), Shanghai Automotive Industry Science and Technology Development Foundation (1807), and Guangxi key laboratory of Automobile Components and Vehicle Technology Research Project (2020GKLACVTKF02).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhuang, H., Wang, C., Qian, Y., Yang, M. (2021). Semantic-Based Road Segmentation for High-Definition Map Construction. In: Sun, F., Liu, H., Fang, B. (eds) Cognitive Systems and Signal Processing. ICCSIP 2020. Communications in Computer and Information Science, vol 1397. Springer, Singapore. https://doi.org/10.1007/978-981-16-2336-3_50
Download citation
DOI: https://doi.org/10.1007/978-981-16-2336-3_50
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-2335-6
Online ISBN: 978-981-16-2336-3
eBook Packages: Computer ScienceComputer Science (R0)