A Database of Spectral Filter Array Images that Combine Visible and NIR

  • Pierre-Jean Lapray
  • Jean-Baptiste Thomas
  • Pierre Gouton
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10213)

Abstract

Spectral filter array emerges as a multispectral imaging technology, which could benefit several applications. Although several instantiations are prototyped and commercialized, there are yet only a few raw data available that could serve research and help to evaluate and design adequate related image processing and algorithms. This document presents a freely available spectral filter array database of images that combine visible and near infra-red information.

Keywords

Multispectral imaging Spectral filter arrays Image database 

References

  1. 1.
    Eichenholz, J.M., Dougherty, J.: Ultracompact fully integrated megapixel multispectral imager. In: SPIE OPTO: Integrated Optoelectronic Devices, p. 721814. International Society for Optics and Photonics (2009)Google Scholar
  2. 2.
    Geelen, B., Blanch, C., Gonzalez, P., Tack, N., Lambrechts, A.: A tiny VIS-NIR snapshot multispectral camera. In: SPIE OPTO, p. 937414. International Society for Optics and Photonics (2015)Google Scholar
  3. 3.
    IMEC: Hyperspectral-imaging. http://www2.imec.be
  4. 4.
    Jia, J., Barnard, K.J., Hirakawa, K.: Fourier spectral filter array for optimal multispectral imaging. IEEE Trans. Image Process. 25(4), 1530–1543 (2016)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Kiku, D., Monno, Y., Tanaka, M., Okutomi, M.: Simultaneous capturing of RGB and additional band images using hybrid color filter array. In: Proceedings of SPIE, vol. 9023, pp. 90230V–90230V-9 (2014). http://dx.doi.org/10.1117/12.2039396
  6. 6.
    Lapray, P.J., Heyrman, B., Ginhac, D.: Hardware-based smart camera for recovering high dynamic range video from multiple exposures. Opt. Eng. 53(10), 102110 (2014). http://dx.doi.org/10.1117/1.OE.53.10.102110 CrossRefGoogle Scholar
  7. 7.
    Lapray, P.J., Thomas, J.B., Gouton, P.: A multispectral acquisition system using MSFAs. In: Color and Imaging Conference 2014, pp. 97–102 (2014). http://www.ingentaconnect.com/content/ist/cic/2014/00002014/00002014/art00016
  8. 8.
    Lapray, P.J., Thomas, J.B., Gouton, P., Ruichek, Y.: Energy balance in spectral filter array camera design. J. Eur. Opt. Soc. Rapid Pub. 13(1), 1 (2017). http://dx.doi.org/10.1186/s41476-016-0031-7 CrossRefGoogle Scholar
  9. 9.
    Lapray, P.J., Wang, X., Thomas, J.B., Gouton, P.: Multispectral filter arrays: recent advances and practical implementation. Sensors 14(11), 21626 (2014). http://www.mdpi.com/1424-8220/14/11/21626 CrossRefGoogle Scholar
  10. 10.
    Miao, L., Qi, H., Ramanath, R., Snyder, W.E.: Binary tree-based generic demosaicking algorithm for multispectral filter arrays. IEEE Trans. Image Process. 15(11), 3550–3558 (2006)CrossRefGoogle Scholar
  11. 11.
    Mihoubi, S., Losson, O., Mathon, B., Macaire, L.: Multispectral demosaicing using intensity-based spectral correlation. In: The fifth International Conference on Image Processing Theory, Tools and Applications, IPTA 2015, Orléans (2015). https://hal.archives-ouvertes.fr/hal-01196983
  12. 12.
    Mihoubi, S., Losson, O., Mathon, B., Macaire, L.: Multispectral demosaicing using intensity in edge-sensing and iterative difference-based methods. In: SITIS, COMI 2016, Naples, December 2016Google Scholar
  13. 13.
    Monno, Y., Kikuchi, S., Tanaka, M., Okutomi, M.: A practical one-shot multispectral imaging system using a single image sensor. IEEE Trans. Image Process. 24(10), 3048–3059 (2015)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Monno, Y., Tanaka, M., Okutomi, M.: N-to-sRGB mapping for single-sensor multispectral imaging. In: 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), pp. 66–73, December 2015Google Scholar
  15. 15.
    Park, H., Crozier, K.B.: Multispectral imaging with vertical silicon nanowires. Sci. Rep. 3, 2460 (2013)Google Scholar
  16. 16.
    Park, H., Dan, Y., Seo, K., Yu, Y.J., Duane, P.K., Wober, M., Crozier, K.B.: Vertical silicon nanowire photodetectors: spectral sensitivity via nanowire radius. In: CLEO: Science and Innovations, p. CTh3L-5. Optical Society of America (2013)Google Scholar
  17. 17.
    Péguillet, H., Thomas, J.B., Ruicheck, Y., Gouton, P.: Energy balance in single exposure multispectral sensors. In: CVCS 2013 (2013)Google Scholar
  18. 18.
    PIXELTEQ: Micro-patterned optical filters. https://pixelteq.com/
  19. 19.
    Sadeghipoor, Z., Lu, Y.M., Ssstrunk, S.: Correlation-based joint acquisition and demosaicing of visible and near-infrared images. In: 2011 18th IEEE International Conference on Image Processing (ICIP), pp. 3165–3168, September 2011Google Scholar
  20. 20.
    Sadeghipoor, Z., Thomas, J.B., Süsstrunk, S.: Demultiplexing visible and near-infrared information in single-sensor multispectral imaging. In: Color and Imaging Conference 2016, (24), 1 (2016). http://www.ingentaconnect.com/content/ist/cic/2016
  21. 21.
    Shrestha, R., Hardeberg, J.Y., Khan, R.: Spatial arrangement of color filter array for multispectral image acquisition. In: Proceedings of SPIE, vol. 7875, pp. 787503–787503-9 (2011). http://dx.doi.org/10.1117/12.872253
  22. 22.
  23. 23.
    SILIOS Technologies: Micro-optics supplier. http://www.silios.com/
  24. 24.
    Thomas, J.: Illuminant estimation from uncalibrated multispectral images. In: Colour and Visual Computing Symposium, CVCS 2015, Gjovik, 25–26 August 2015, pp. 1–6. IEEE (2015). http://dx.doi.org/10.1109/CVCS.2015.7274900
  25. 25.
    Thomas, J.B., Lapray, P.J., Gouton, P., Clerc, C.: Spectral characterization of a prototype SFA camera for joint visible and NIR acquisition. Sensors 16(7), 993 (2016). http://www.mdpi.com/1424-8220/16/7/993 CrossRefGoogle Scholar
  26. 26.
    Wang, C., Wang, X., Hardeberg, J.Y.: A linear interpolation algorithm for spectral filter array demosaicking. In: Elmoataz, A., Lezoray, O., Nouboud, F., Mammass, D. (eds.) ICISP 2014. LNCS, vol. 8509, pp. 151–160. Springer, Cham (2014). doi:10.1007/978-3-319-07998-1_18 Google Scholar
  27. 27.
    Wang, X., Thomas, J.B., Hardeberg, J.Y., Gouton, P.: Discrete wavelet transform based multispectral filter array demosaicking. In: Colour and Visual Computing Symposium (CVCS 2013), pp. 1–6 (2013)Google Scholar
  28. 28.
    Wang, X., Green, P.J., Thomas, J.-B., Hardeberg, J.Y., Gouton, P.: Evaluation of the colorimetric performance of single-sensor image acquisition systems employing colour and multispectral filter array. In: Trémeau, A., Schettini, R., Tominaga, S. (eds.) CCIW 2015. LNCS, vol. 9016, pp. 181–191. Springer, Cham (2015). doi:10.1007/978-3-319-15979-9_18 CrossRefGoogle Scholar
  29. 29.
    Wang, X., Thomas, J.B., Hardeberg, J.Y., Gouton, P.: Median filtering in multispectral filter array demosaicking. In: Proceedings of SPIE (EI), vol. 8660, pp. 86600E–86600E-10 (2013). http://dx.doi.org/10.1117/12.2005256
  30. 30.
    Yi, D., Kong, L., Wang, J., Zhao, F.: Fabrication of multispectral imaging technology driven MEMS-based micro-arrayed multichannel optical filter mosaic. In: SPIE MOEMS-MEMS, p. 792711. International Society for Optics and Photonics (2011)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Pierre-Jean Lapray
    • 1
  • Jean-Baptiste Thomas
    • 2
    • 3
  • Pierre Gouton
    • 3
  1. 1.MIPS Laboratory, Université de Haute AlsaceMulhouseFrance
  2. 2.The Norwegian Colour and Visual Computing LaboratoryNTNUGjøvikNorway
  3. 3.Le2i, Université de Bourgogne, Franche-ComtéDijonFrance

Personalised recommendations