Virtual Reality

, Volume 17, Issue 4, pp 253–262 | Cite as

Evaluation of tone mapping operators in night-time virtual worlds

SI: Evaluating Virtual Worlds
First Online:
Received:
Accepted:

Abstract

The subjective quality of a virtual world depends on the quality of displayed images. In the present paper, we address a technical aspect of image quality in virtual environments. Due to the recent development of high dynamic range (HDR) imaging in computer graphics applications, tone mapping operators (TMO) are needed in the graphic pipeline, and their impact on the final image quality needs to be tested. Previous evaluations of such operators have emphasized the fact that the specific merit of a given operator may depend on both the scene and the application. The dynamic behavior of tone mapping operators was not tested before, and we have designed two psychophysical experiments in order to assess the relevance of various TMO for a specific class of virtual worlds, outdoor scenes at night and an interactive application, to explore an outdoor virtual world at night. In a first experiment, 5 HDR video clips were tone-mapped using 8 operators from the literature, resulting in 40 videos. These 40 videos were presented to 14 subjects, which were asked to rate their realism. However, the subject’s evaluation was not a direct comparison with the HDR videos. In a second experiment, 9 HDR photographs of urban scenes at night were tone-mapped with the same 8 operators. The resulting 72 photographs were presented to 13 subjects, at the location where the photographs were taken. The subjects were asked to rate the realism of each tone-mapped image, displayed on a laptop, with respect to the physical scene they experienced. The first experiment emphasized the importance of modeling the temporal visual adaptation for a night-time application.

Keywords

Virtual environments Image rendering Tone mapping Presence Subjective evaluation 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgements

The authors would like to express appreciation to Sophie Lemonnier and Jean-Philippe tarel for their helpful advices. The authors are grateful for subject’s participation to the psychophysical experiments.

References

  1. Akyuz AO, Fleming R, Riecke BE, Reinhard E, Bulthoff HH (2007) Do HDR displays support LDR content? A psychophysical evaluation. ACM Trans Graph 26(3):Art. 38Google Scholar
  2. Ashikhmin M, Goyal J (2006) A reality check for tone mapping operators. ACM Trans Appl Percept 3(4):399–411CrossRefGoogle Scholar
  3. Bormann K (2006) Subjective performance. Virtual Real 9:226–233CrossRefGoogle Scholar
  4. Čadík M, Wimmer M, Neumann L, Artusi A (2008) Evaluation of HDR tone mapping methods using essential perceptual attributes. Comput Graph 32(3):330–349CrossRefGoogle Scholar
  5. Choudhury P, Tumblin J (2003) The trilateral filter for high contrast images and meshes. In: Proceedings of the eurographics symposium on rendering, pp 186–196Google Scholar
  6. Debevec P, Malik J (1997) Recovering high dynamic range radiance maps from photographs. In: Proceedings of SIGGRAPH. ACM, Los Angeles, CA, pp 369–378Google Scholar
  7. Drago F, Myszkowski K, Annen T, Chiba N (2003) Adaptive logarithmic mapping for displaying high contrast scenes. In: Proceedings of eurographics. Granada (Spain) pp 419–426Google Scholar
  8. Drago F, Martens WL, Myszkowski K, Seidel HP (2003) Perceptual evaluation of tone mapping operators. In: ACM SIGGRAPH conference abstracts and applicationsGoogle Scholar
  9. Durand F, Dorsey J (2000) Interactive tone mapping. In: Proceedings of eurographics symposium on rendering. Brno, Czech Rep., pp 219–230Google Scholar
  10. Durand F, Dorsey J (2002) Fast bilateral filtering of HDR images. In: Proceedings of SIGGRAPH. ACM, New Orleans, Lousiana, pp 257–265Google Scholar
  11. Ferwerda JA (2003) Three varieties of realism in computer graphics. In: Proceedings of SPIE human vision and electronic imaging. San Jose, CA, pp 290–297Google Scholar
  12. Giannopulu I, Bertin R, Brémond R, Espié S, Kapoula Z (2008) Visuomotor strategies using driving simulators in virtual and pre-recorded environment. Adv Transp Stud 14:49–56Google Scholar
  13. Grave J., Brémond R (2008) A tone mapping algorithm for road visibility experiments. ACM Trans Appl Percept 5(2): article 12Google Scholar
  14. Gruyer D, Glaser S, Monnier B (2010) SiVIC, a virtual platform for ADAS and PADAS prototyping, test and evaluation. In: Proceedings of FISITA world automotive congress. Budapest (Hungary)Google Scholar
  15. Hunt RWG (1995) The reproduction of colour. 5th edn. Fountain Press Ltd, LondonGoogle Scholar
  16. Irawan PAJ, Marschner SR (2005) Perceptually based tone mapping of high dynamic range image streams. In: Proceedings of eurographics symposium on rendering. Konstanz (Germany), pp 231–242Google Scholar
  17. Kuang J, Johnson GM, Fairchild MD (2005) Image preference scaling for HDR image rendering. In: Proceedings of IS&T/SID 13th color imaging conference. Scotsdale, ArizonaGoogle Scholar
  18. Kuang J, Liu C, Johnson G, Fairchild M (2006) Evaluation of HDR image rendering algorithms using real-world scenes. In: Proceedings of international congress of imaging scienceGoogle Scholar
  19. Kuang J, Yamaguchi H, Johnson GM, Fairchild MD (2004) Testing HDR image rendering algorithms. In: Proceedings of IS&T/SID 12th color imaging conference. Scotsdale, ArizonaGoogle Scholar
  20. Kuang J, Yamaguchi H, Liu C, Johnson GM, Fairchild MD (2007) Evaluating HDR rendering algorithms. ACM Trans Appl Percept 3(3):286–308Google Scholar
  21. Land E, McCann J (1971) Lightness and retinex theory. J Opt Soc Am 61(1):1–11CrossRefGoogle Scholar
  22. Ledda P, Chalmers A, Troscianko T, Seetzen H (2005) Evaluation of tone mapping operators using a high dynamic range display. In: Proceedings of SIGGRAPH. ACM, Los Angeles, CA, pp 640–648Google Scholar
  23. Ledda P, Santos LP, Chalmers A (2004) A local model of eye adaptation for high dynamic range images. In: Proceedings of AFRIGRAPH. ACM, Stellenbosch (South Africa), pp 151–160Google Scholar
  24. Lepecq JC, Bringoux L, Pergandi JM, Coyle T, Mestre D (2009) Afforded actions as a behavioral assessment of physical presence in virtual environemnts. Virtual Real 13:141–151CrossRefGoogle Scholar
  25. McNamara A (2006) Exploring visual and automatic measures of perceptual fidelity in real and simulated imagery. ACM Trans Appl Percept 3(3):217–238MathSciNetCrossRefGoogle Scholar
  26. Pattanaik SN, Ferwerda JA, Fairchild MD, Greenberg DP (1998) A multiscale model of adaptation and spatial vision for realistic image display. Comput Graph 32(Annual Conference Series):287–298Google Scholar
  27. Pattanaik SN, Tumblin J, Yee H, Greenberg DP (2000) Time-dependent visual adaptation for fast realistic image display. In: Proceedings of SIGGRAPH. ACM, New Orleans, Lousiana, pp 47–54Google Scholar
  28. Petit J, Brémond R (2010) A high dynamic range rendering pipeline for interactive applications: in search for perceptual realism. The Visual Computer 28(6–8):533–542. Special issue CGI 2010Google Scholar
  29. Rahman ZU, Jobson DJ, Woodell GA (1996) A multiscale retinex for color rendition and dynamic range compression. In: SPIE Proceedings: Applications of digital image processing XIX, vol. 2847. Denver, COGoogle Scholar
  30. Reinhard E, Stark M, Shirley P, Ferwerda J (2002) Photographic tone reproduction for digital images. In: Proceedings of SIGGRAPH. ACM, San Antonio, Texas, pp 267–276Google Scholar
  31. Reinhard E, Ward G, Pattanaik SN, Debevec P (2005) High dynamic range imaging: acquisition, display, and image-based lighting. Morgan Kaufmann, USAGoogle Scholar
  32. Robertson MA, Borman S, Stevenson RL (1999) Dynamic range improvement through multiple exposures. In: Proceedings of IEEE international conference on image processing. Kobe (Japan)Google Scholar
  33. Seetzen H, Heidrich W, Stuerzlinger W, Ward G, Whitehead L, Trentacoste M, Ghosh A, Vorozcovs A (2004) High dynamic range display systems. ACM Trans Graph 23(3):760–768CrossRefGoogle Scholar
  34. Tumblin J, Rushmeier H (1993) Tone reproduction for realistic images. IEEE Comput Graph Appl 13(6):42–48CrossRefGoogle Scholar
  35. Tumblin J, Turk G (1999) Low curvature image simplifiers (LCIS). In: Proceedings of SIGGRAPH. Addison Wesley, Los Angeles, CA, pp 83–90Google Scholar
  36. Wallach HS, Safir MP, Samana R (2010) Personality variables and presence. Virtual Real 14:3–13CrossRefGoogle Scholar
  37. Ward G (1994) A contrast-based scale factor for luminance display. Graph Gems IV, Academic Press Professional, Inc., San Diego, CA, pp 415-421Google Scholar
  38. Ward G, Rushmeier H, Piatko C (1997) A visibility matching tone reproduction operator for high dynamic range scenes. IEEE Trans Vis Comput Graph 3(4):291–306CrossRefGoogle Scholar
  39. Yoshida A, Blanz V, Myszkowski K, Seidel HP (2005) Perceptual evaluation of tone mapping operators with real world scenes. In: Proceedings of the SPIE, vol. 5666. San Jose, CA, pp 192–203Google Scholar
  40. Yoshida A, Mantiuk R, Myszkowski K, Seidel HP (2006) Analysis of reproducing real-world appearance on displays of varying dynamic range. Comput Graph Forum 25(3):415–426CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London 2012

Authors and Affiliations

  1. 1.Université Paris Est, IFSTTAR, IM, LEPSiSParisFrance

Personalised recommendations