Abstract
The new sensors with the pixel-level polarizer structure make us able to shoot once and get four images with different light characters at the same time. It is similar to change the exposure four times and creates opportunities to obtain images with higher dynamic range. Based on the character of the novel polarization camera and the image acquisition pipeline of the regular digital camera, we propose a real-time exposure fusion method to reconstruct the high dynamic images. Polarization information is used to construct the base layer as a reference for the calculation of the blending weights in the method. The result will benefit visual navigation as a result of the better input image source. We also compare our method with three exposure fusion methods. Experimental results indicate our comparable performance and lower complexity.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Banterle, Francesco, et al. Advanced high dynamic range imaging. AK Peters/CRC Press, 2017
Reppert, S.M., Zhu, H., White, R.H.: Polarized light helps monarch butterflies navigate. Curr. Biol. 14(2), 155–158 (2004)
T. W. Cronin, S. Johnsen, J. Marshall, and E. Warrant, Visual Ecology (Princton University, 2014)
The polarm camera. https://www.4dtechnology.com/products/polarimeters/polarcam/
IMX250 CMOS sensor. https://en.ids-imaging.com/sony-imx250.html
Wang, Fan, et al. ”Multimodality semantic segmentation based on polarization and color images.” Neurocomputing 253 (2017): 193–200
Wang, Xinhua, et al. “Real-Time Vision through Haze Based on Polarization Imaging.” Applied Sciences 9.1 (2019): 142
Cui, Zhaopeng, et al. “Polarimetric multi-view stereo.” Proc. of Computer Vision and Pattern Recognition (CVPR). 2017
Yang, Luwei, et al. “Polarimetric Dense Monocular SLAM.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018
Fan, Chen, et al. “Design and calibration of a novel camera-based bio-inspired polarization navigation sensor.” IEEE Sensors Journal 16.10 (2016): 3640–3648
Kadambi, Achuta, et al. “Depth sensing using geometrically constrained polarization normals.” International Journal of Computer Vision 125.1-3 (2017): 34-51
Mertens, Tom, Jan Kautz, and Frank Van Reeth. “Exposure fusion.” 15th Pacific Conference on Computer Graphics and Applications (PG’07). IEEE, 2007
Yang, Xin, et al. “Image correction via deep reciprocating HDR transformation.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2018
Li, Shutao, Kang, Xudong: Fast multi-exposure image fusion with median filter and recursive filter. IEEE Trans. Consum. Electron. 58(2), 626–632 (2012)
Zhang, Wenlong, et al. “Multi-exposure image fusion based on wavelet transform.” International Journal of Advanced Robotic Systems 15.2 (2018): 1729881418768939
Salahieh, Basel, et al. “Multi-polarization fringe projection imaging for high dynamic range objects.” Optics express 22.8 (2014): 10064–10071
Huynh, Tri TM, et al. “High Dynamic Range Imaging Using A 2x2 Camera Array with Polarizing Filters.” 2019 19th International Symposium on Communications and Information Technologies (ISCIT). IEEE, 2019
Nejati, Mansour, et al. “Fast exposure fusion using exposedness function.” 2017 IEEE International Conference on Image Processing (ICIP). IEEE, 2017
Han, Guoliang, et al. ”Design and calibration of a novel bio-inspired pixelated polarized light compass.” Sensors 17.11 (2017): 2623
Goldstein, Dennis H. Polarized light. CRC press, 2016
Debevec, Paul E., and Jitendra Malik. “Recovering high dynamic range radiance maps from photographs.” ACM SIGGRAPH 2008 classes. ACM, 2008
Jinno, Takao, Okuda, Masahiro: Multiple exposure fusion for high dynamic range image acquisition. IEEE Trans. Image Process. 21(1), 358–365 (2012)
Goshtasby, A. Ardeshir. “Fusion of multi-exposure images.” Image and Vision Computing 23.6 (2005): 611–618
Nayar, Shree K., and Tomoo Mitsunaga. ”High dynamic range imaging: Spatially varying pixel exposures.” Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No. PR00662). Vol. 1. IEEE, 2000
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wu, X. et al. (2022). Real Time Exposure Fusion Based on the Polarization Camera. In: Yan, L., Duan, H., Yu, X. (eds) Advances in Guidance, Navigation and Control . Lecture Notes in Electrical Engineering, vol 644. Springer, Singapore. https://doi.org/10.1007/978-981-15-8155-7_40
Download citation
DOI: https://doi.org/10.1007/978-981-15-8155-7_40
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-8154-0
Online ISBN: 978-981-15-8155-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)