Abstract
Color image demosaicking is key in developing low-cost digital cameras using a color filter array(CFA). Similarly, multispectral image demosaicking can be used to develop low-cost and portable multispectral cameras using a multispectral filter array (MSFA). In this work, we propose a generic multispectral image demosaicking algorithm based on spatial and spectral correlation. We also propose a new image quality metric Average-Normalized-Multispectral-PSNR (ANMPSNR), which helps in easily comparing the relative performance of different demosaicking algorithms. In experimental results, we prove the efficacy of the proposed algorithm using two publicly available datasets as per different image quality metrics.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aggarwal, H.K., Majumdar, A.: Single-sensor multi-spectral image demosaicing algorithm using learned interpolation weights. In: Proceedings of the International Geoscience and Remote Sensing Symposium, pp. 2011–2014 (2014)
Brauers, J., Aach, T.: A color filter array based multispectral camera. In: 12 Workshop Farbbildverarbeitung, pp. 55–64 (2006)
Geelen, B., Tack, N., Lambrechts, A.: A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic. In: Proceeding of SPIE, vol. 8974, p. 89740L (2014)
Gupta, M., Goyal, P.: Demosaicing method for multispectral images using derivative operations. Am. J. Math. Manag. Sci. 40(2), 163–176 (2021)
Gupta, M., Goyal, P., Ram, M.: Multispectral image demosaicking using limited MSFA sensors. Nonlinear Stud. 26(3), 1–16 (2019)
Gupta, M., Ram, M.: Weighted bilinear interpolation based generic multispectral image demosaicking method. J. Graphic Era Univ. 7(2), 108–118 (2019)
Habtegebrial, T.A., Reis, G., Stricker, D.: Deep convolutional networks for snapshot hypercpectral demosaicking. In: Workshop on Hyperspectral Imaging and Signal Processing: Evolution in Remote Sensing, pp. 1–5 (2019)
Jinju, J., Santhi, N., Ramar, K., Bama, B.S.: Spatial frequency discrete wavelet transform image fusion technique for remote sensing applications. Eng. Sci. Technol. Int. J. 2(3), 715–726 (2019)
Liu, C., et al.: Application of multispectral imaging to determine quality attributes and ripeness stage in strawberry fruit. PLoS ONE 9(2), 1–8 (2014)
Lu, G., Fei, B.: Medical hyperspectral imaging: a review. J. Biomed Optics 19(1), 010901 (2014)
Martinez, M.A., Valero, E.M., Hernández-Andrés, J., Romero, J., Langfelder, G.: Combining transverse field detectors and color filter arrays to improve multispectral imaging systems. Appl. Optics 53(13), C14–C24 (2014)
Miao, L., Qi, H.: The design and evaluation of a generic method for generating mosaicked multispectral filter arrays. IEEE Trans. Image Process. 15(9), 2780–2791 (2006)
Miao, L., Ramanath, R., Snyder, W.E.: Binary tree-based generic demosaicking algorithm for multispectral filter arrays. IEEE Trans. Image Process. 15(11), 3550–3558 (2006)
Mihoubi, S., Losson, O., Mathon, B., Macaire, L.: Multispectral demosaicking using intensity-based spectral correlation. In: Proceedings of the 5th International Conference on Image Processing, Theory, Tools and Applications, pp. 461–466 (2015)
Mihoubi, S., Losson, O., Mathon, B., Macaire, L.: Multispectral demosaicing using pseudo-panchromatic image. IEEE Trans. Comput. Imag. 3(4), 982–995 (2017)
Mizutani, J., Ogawa, S., Shinoda, K., Hasegawa, M., Kato, S.: Multispectral demosaicking algorithm based on inter-channel correlation. In: Proceedings of the IEEE Visual Communications and Image Processing Conference, pp. 474–477 (2014)
Monno, Y., Kikuchi, S., Tanaka, M., Okutomi, M.: A practical one-shot multispectral imaging system using a single image sensor. IEEE Trans. Image Process. 24(10), 3048–3059 (2015)
Rathi, V., Goyal, P.: Convolution filter based efficient multispectral image demosaicking for compact msfas. In: Proceedings of International Joint Conference on Computer Vision, Imaging and Computer Graphics, Theory and Application: VISAPP, pp. 112–121 (2021)
Rathi, V., Gupta, M., Goyal, P.: A new generic progressive approach based on spectral difference for single-sensor multispectral imaging system. In: Proceedings of International Joint Conference on Computer Vision, Imaging and Computer Graphics, Theory and Applications: VISAPP, pp. 329–336 (2021)
Shopovska, I., Jovanov, L., Philips, W.: RGB-NIR demosaicing using deep residual u-net. In: 26th Telecommunications Forum, pp. 1–4 (2018)
Sun, B., et al.: Sparse spectral signal reconstruction for one proposed nine-band multispectral imaging system. Mech. Syst. Signal Process. 141, 106627 (2020)
Thomas, J.B., Lapray, P.J., Gouton, P., Clerc, C.: Spectral characterization of a prototype SFA camera for joint visible and NIR acquisition. Sensor 16, 993 (2016)
Yasuma, F., Mitsunaga, T., Iso, D., Nayar, S.: Generalized assorted pixel camera: postcapture control of resolution, dynamic range, and spectrum. IEEE Trans. Image Process. 19(9), 2241–2253 (2010)
Acknowledgement
This work is sponsored by the DST Science and Engineering Research Board, India, under grant ECR/2017/003478.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Rathi, V., Goyal, P. (2022). Generic Multispectral Image Demosaicking Algorithm and New Performance Evaluation Metric. In: Raman, B., Murala, S., Chowdhury, A., Dhall, A., Goyal, P. (eds) Computer Vision and Image Processing. CVIP 2021. Communications in Computer and Information Science, vol 1567. Springer, Cham. https://doi.org/10.1007/978-3-031-11346-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-031-11346-8_5
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-11345-1
Online ISBN: 978-3-031-11346-8
eBook Packages: Computer ScienceComputer Science (R0)