Measuring Spectral Reflectance and 3D Shape Using Multi-primary Image Projector

  • Keita Hirai
  • Ryosuke Nakahata
  • Takahiko Horiuchi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9680)


This paper presents a method to measure spectral reflectance and 3D shape of an object. For realizing these measurements, we applied a multi-primary image projector as a computational illumination system. This multi-primary image projector employs a light source which is programmable and can reproduce any spectral power distributions. In other words, the projector can reproduce 2D pattern projections with arbitrary spectra. In our actual measurements, we developed an imaging system by synchronizing the multi-primary image projector and a highspeed monochrome camera. First, the surface spectral reflectance of an object in a darkroom was obtained based on a finite-dimensional linear model of spectral reflectances. In the spectral reflectance measurements, nine basis images were projected and captured by the synchronized imaging system. Then spectral reflectance at each camera image coordinate was estimated from the captured nine images. Next, structured lights were projected for reconstructing 3D shape. We applied eight binary image projections and a conventional 3D shape reconstruction algorithm to our study. In summary, seventeen images were projected and captured for measuring spectral reflectance and 3D shape. The projection and capturing speed of the seventeen images is 0.085 s on the system specification. In the validation experiments, we could obtain spectral reflectance of X-rite ColorChecker with the average color difference \(\varDelta E_{ab}^{*}\) of approximately 4. We also confirmed that precise 3D shapes could be reconstructed by our method.


Spectral reflectance 3D shape Fast measurement Computational illumination system Multi-primary image projector 



This work was partially supported by JSPS Grant-in-Aid for Scientific Research (C) (Grant Number 25330184).


  1. 1.
    Geng, J., Waterman, M.S.: Structured-light 3D surface imaging: a tutorial. Adv. Opt. Photonics 3(2), 128–160 (2011)CrossRefGoogle Scholar
  2. 2.
    Salvi, J., Pages, J., Batlle, J.: Pattern codification strategies in structured light systems. Pattern Recogn. 34(4), 827–849 (2004)CrossRefzbMATHGoogle Scholar
  3. 3.
    Bimber, O., Raskar, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. A.K. Peters/CRC Press, Natick (2005)CrossRefGoogle Scholar
  4. 4.
    Park, J.I., Lee, M.H., Grossberg, M.D., Nayar, S.K.: Multispectral imaging using multiplexed illumination. In: IEEE 11th International Conference on Computer Vision (ICCV), pp. 1–8 (2007)Google Scholar
  5. 5.
    Tominaga, S., Horiuchi, T.: Spectral imaging by synchronizing capture and illumination. J. Opt. Soc. Am. A 29(9), 1764–1775 (2012)CrossRefGoogle Scholar
  6. 6.
    Hirai, K., Tanimoto, T., Yamamoto, K., Horiuchi, T., Tominaga, S.: An LED-based spectral imaging system for surface reflectance and normal estimation. In: The 9th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), pp. 441–447 (2013)Google Scholar
  7. 7.
    Han, S., Sato, I., Okabe, T., Sato, Y.: Fast spectral reflectance recovery using DLP projector. Int. J. Comput. Vis. 110(2), 172–184 (2014)CrossRefGoogle Scholar
  8. 8.
    Nakahata, R., Hirai, K., Horiuchi, T., Tominaga, S.: Development of a dynamic relighting system for moving planar objects with unknown reflectance. In: Trémeau, A., Schettini, R., Tominaga, S. (eds.) CCIW 2015. LNCS, vol. 9016, pp. 81–90. Springer, Heidelberg (2015)CrossRefGoogle Scholar
  9. 9.
    Sato, Y., Wheeler, M.D., Ikeuchi, K.: Object shape and reflectance modeling from observation. In: SIGGRAPH, pp. 379–387 (1997)Google Scholar
  10. 10.
    Oxholm, G., Nishino, K.: Shape and reflectance from natural illumination. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part I. LNCS, vol. 7572, pp. 528–541. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  11. 11.
    Patow, G., Pueyo, X.: A survey of inverse rendering problems. Comput. Graph. Forum 22(4), 663–687 (2003)CrossRefzbMATHGoogle Scholar
  12. 12.
    Tonsho, K., Akao, Y., Tsumura, N., Miyake, Y.: Development of goniophotometric imaging system for recording reflectance spectra of 3D objects. In: Proceedings of SPIE, vol. 4663, pp. 370–378 (2001)Google Scholar
  13. 13.
    Manabe, Y., Parkkinen, J., Jaaskelainen, T., Chihara, K.: Three dimensional measurement using color structured patterns and imaging spectrograph. In: 16th International Conference on Pattern Recognition (ICPR), pp. 649–652 (2002)Google Scholar
  14. 14.
    Tominaga, S., Tanaka, N.: Spectral image acquisition, analysis, and rendering for art paintings. J. Electron. Imaging 17(4), 043022:1–043022:13 (2008)CrossRefGoogle Scholar
  15. 15.
    Mansouri, A., Lathuiliere, A., Marzani, F.S., Voisin, Y., Gouton, P.: Toward a 3D multispectral scanner: an application to multimedia. IEEE MultiMedia 14(1), 40–47 (2007)CrossRefGoogle Scholar
  16. 16.
    Chane, C.S., Schutze, R., Boochs, F., Marzani, F.S.: Registration of 3D and multispectral data for the study of cultural heritage surfaces. Sensors 13(1), 1004–1020 (2013)CrossRefGoogle Scholar
  17. 17.
    Sitnik, R., Krzesłowski, J., Maczkowski, G.: Archiving shape and appearance of cultural heritage objects using structured light projection and multispectral imaging. Opt. Eng. 51(2), 021115:1–021115:8 (2012)CrossRefGoogle Scholar
  18. 18.
    Hirai, K., Irie, D., Horiuchi, T.: Multi-primary image projector using programmable spectral light source. J. Soc. Inf. Display (2016). doi: 10.1002/jsid.422
  19. 19.
    Hirai, K., Irie, D., Horiuchi, T.: Photometric and geometric measurements based on multi-primary image projector. In: Colour and Visual Computing Symposium (CVCS), pp. 1–5 (2015)Google Scholar
  20. 20.
    Romero, J., García-Beltrán, A., Hernández-Andrés, J.: Linear basis for representation of natural and artificial illuminants. J. Opt. Soc. Am. A 14(5), 1007–1014 (1997)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Keita Hirai
    • 1
  • Ryosuke Nakahata
    • 1
  • Takahiko Horiuchi
    • 1
  1. 1.Graduate School of Advanced Integration ScienceChiba UniversityChibaJapan

Personalised recommendations