Skip to main content
SpringerLink
Log in

Multispectral filter array design without training images

  • Regular Paper
  • Published:
Optical Review Aims and scope Submit manuscript

Abstract

Multispectral images (MSIs) have been studied for many applications; however, limitations persist in techniques to capture them due to the complexity of assembling one or more prisms and multiple sensor arrays in order to detect signals. Inspired by the application of color filter arrays to commercial digital RGB cameras, a number of researchers have studied multispectral filter arrays (MSFAs) to solve this problem. Determining the measurement wavelength and pattern of an MSFA is important for improving the quality of the demosaicked image. Some conventional studies for designing MSFAs have used training data and have optimized the measurement wavelengths and the pattern by iteratively minimizing the error between the training data and the demosaicked images. We propose a metric to evaluate an MSFA without MSIs, and optimize the measurement wavelengths and the pattern of the MSFA by minimizing the metric. The proposed metric measures the sampling distance between filters in a spatial–spectral domain and quantifies the dispersion of the sampling points by average nearest-neighbor distance (ANND) under a given arbitrary MSFA. Since the quality of the demosaicked image is assumed to be proportional to the degree of dispersion of the sampling points in the spatial–spectral domain, we optimize the MSFA by minimizing the ANND in a nested simulated annealing process. Experimental results show that the optimized MSFA obtained using our method attained a higher peak signal-to-noise ratio (PSNR) than conventional untrained MSFAs in many cases. In addition, the performance difference between some trained MSFAs and the proposed MSFA was small. We also confirmed the validity of the proposed ANND by a comparison with the mean square error obtained from MSI datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

References

  1. Yamaguchi, M., Haneishi, H., Ohyama, N.: Beyond red–green–blue(RGB): spectrum-based color imaging technology. J Imaging Sci Technol 52(1), 10201-1–10201-15 (2008)

    Article  Google Scholar 

  2. Fukuda, H., Uchiyama, T., Haneishi, H., Yamaguchi, M., Ohyama, N.: Development of 16-band multispectral image archiving system. Proc. SPIE 5667, 136–145 (2002)

    Article  ADS  Google Scholar 

  3. Park, J., Lee, M., Grossberg, M.D., Nayar, S.K.: Multispectral imaging using multiplexed illumination. In: IEEE International Conference on Computer Vision, pp. 1–8 (2007)

  4. Brauers, J., Aach, T.: A color filter array based multispectral camera. In: Proceedings of Workshop Farbbildverarbeitung (2006)

  5. Yasuma, F., Mitsunaga, T., Iso, D., Nayar, S.K.: Generalized assorted pixel camera: postcapture control of resolution, dynamic range, and spectrum. IEEE Trans. Image Process. 19(9), 2241–2253 (2010)

    Article  ADS  MathSciNet  Google Scholar 

  6. Aggarwal, H.K., Majumdar, A.: Multi-spectral demosaicing technique for single-sensor imaging. In: Proceedings of the Fourth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics, pp. 1–4 (2013)

  7. Monno, Y., Kikuchi, S., Tanaka, M., Okutomi, M.: A practical one-shot multispectral imaging system using a single image sensor. IEEE Trans. Image Process. 24(10), 3048–3059 (2015)

    Article  ADS  MathSciNet  Google Scholar 

  8. Lu, Y.M., Fredembach, C., Vetterli, M., Süsstrunk, S.: Designing color filter arrays for the joint capture of visible and near-infrared images. In: Proceedings of IEEE International Conference on Image Processing, pp. 3797–3800 (2009)

  9. Sadeghipoor, Z., Lu, Y.M., Süsstrunk, S.: Correlation-based joint acquisition and demosaicing of visible and near-infrared images. In: Proceedings of IEEE International Conference on Image Processing, pp. 3165–3168 (2011)

  10. Monno, Y., Kitao, T., Tanaka, M., Okutomi, M.: Optimal spectral sensitivity functions for a single-camera one-shot multispectral imaging system. In: Proceedings of IEEE International Conference on Image Processing, pp. 2137–2140 (2012)

  11. Yanagi, Y., Shinoda, K., Hasegawa, M., Kato, S., Ishikawa, M., Komagata, H., Kobayashi, N.: Optimal transparent wavelength and arrangement for multispectral filter array. In: IS&T International Symposium on Electronic Imaging, IPAS-024, pp. 1–5 (2016)

  12. Tucker, C.J.: Red and photographic infrared linear combinations for monitoring vegetation. Remote Sens. Environ. 8, 127–150 (1979)

    Article  ADS  Google Scholar 

  13. Tucker, C.J., Newcomb, W.W., Los, S.O., Prince, S.D.: Mean and inter-year variation of growing-season normalized difference vegetation index for the Sahel 1981–1989. Int. J. Remote Sens. 12, 1113–1115 (1991)

    Article  Google Scholar 

  14. Myneni, R.B., Tucker, C.J., Asrar, G., Keeling, C.D.: Interannual variations in satellite-sensed vegetation index data from 1981 to 1991. J. Geophys. Res. 103(D6), 6145–6160 (1998)

    Article  ADS  Google Scholar 

  15. Aoyagi, T.: Pulse oximetry: its invention, theory, and future. J. Anesth. 17(4), 259–266 (2003)

    Article  Google Scholar 

  16. Poh, M.Z., McDuff, D.J., Picard, R.W.: Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 18(10), 10762–10774 (2010)

    Article  ADS  Google Scholar 

  17. Miao, L., Qi, H.: The design and evaluation of a generic method for generating mosaicked multispectral filter arrays. IEEE Trans. Image Process. 15(9), 2780–2791 (2006)

    Article  ADS  MathSciNet  Google Scholar 

  18. Shinoda, K., Hamasaki, T., Hasegawa, M., Kato, S., Ortega, A.: Quality metric for filter arrangement in a multispectral filter array. In: Picture Coding Symposium, pp. 149–152 (2013)

  19. Levenshtein, V.I.: Binary codes capable of correcting deletions, insertions and reversals. Dokl. Akad. Nauk SSSR 163(4), 845–848 (1965)

    MathSciNet  MATH  Google Scholar 

  20. Hyvärinen, A., Hurri, J., Hoyer, P.O.: Natural Image Statistics: A Probabilistic Approach to Early Computational Vision, p. 99. Springer, New York (2009)

    Book  MATH  Google Scholar 

  21. Pratt, W.K., Mancill, C.E.: Spectral estimation techniques for the spectral calibration of a color image scanner. Appl. Opt. 15(1), 73–75 (1976)

    Article  ADS  Google Scholar 

  22. Clark, P.J., Evans, F.C.: Distance to nearest neighbor as a measure of spatial relationships in populations. Ecology 35(4), 445–453 (1954)

    Article  Google Scholar 

  23. Cottam, G., Curtis, J.T.: The use of distance measures in phytosociological sampling. Ecology 37(3), 451–460 (1956)

    Article  Google Scholar 

  24. Real-World Hyperspectral Images Database. http://vision.seas.harvard.edu/hyperspec/download.html. Accessed Dec 2016

  25. Multispectral Image Database: Stuff. http://www.cs.columbia.edu/CAVE/databases/multispectral/. Accessed Dec 2016

  26. Hyperspectral images of natural scenes. http://personalpages.manchester.ac.uk/staff/d.h.foster/Hyperspectral_images_of_natural_scenes_04.html. Accessed Dec 2016

  27. The Kodak Color Image Dataset. http://r0k.us/graphics/kodak/. Accessed Dec 2016

  28. Munsell colors matt (Spectrofotometer measured). https://www.uef.fi/web/spectral/munsell-colors-matt-spectrofotometer-measured. Accessed Dec 2016

  29. Condat, L., Saleh, M.: Joint demosaicking and denoising by total variation minimization. In: IEEE International Conference on Image Processing, pp. 2781–2784 (2012)

Download references

Acknowledgements

This work was supported by JSPS KAKENHI Grant Number 15K20899 and Konica Minolta Imaging Science Encouragement Award. We thank Prof. Antonio Ortega for helpful advice.

Author information

Authors and Affiliations

  1. Graduate School of Engineering, Utsunomiya University, 7-1-2 Yoto, Utsunomiya, Tochigi, 321-8585, Japan

    Kazuma Shinoda, Yudai Yanagi & Madoka Hasegawa

  2. Center for Optical Research and Education (CORE), Utsunomiya University, 7-1-2 Yoto, Utsunomiya, Tochigi, 321-8585, Japan

    Yoshio Hayasaki

Authors
  1. Kazuma Shinoda
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yudai Yanagi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yoshio Hayasaki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Madoka Hasegawa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kazuma Shinoda.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shinoda, K., Yanagi, Y., Hayasaki, Y. et al. Multispectral filter array design without training images. Opt Rev 24, 554–571 (2017). https://doi.org/10.1007/s10043-017-0349-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10043-017-0349-4

Keywords

Search

Navigation