High Dynamic Range Visual Quality of Experience Measurement: Challenges and Perspectives
- 1k Downloads
Traditional capture and display devices can only support a limited dynamic range (contrast) and color gamut given the hardware limitations. As a result, the real physical luminance present in a natural scene cannot be captured by these. However, with the recent advancements in the related software and hardware technologies, it is now possible to capture or reproduce higher contrast and luminance ranges. Such scene-referred visual signals are known as high dynamic range (HDR) signals. They are visually more appealing because they can represent the dynamic range of the visual stimuli present in the real world more accurately. Not surprisingly, the emergence of HDR is seen as an important step towards improving the visual quality of experience (QoE) of the end users. However, HDR comes with its own set of challenges including capture, storage, processing, display, and so on. This chapter focuses on some of those issues from a QoE viewpoint.
KeywordsVisual Quality Human Visual System High Dynamic Range Tone Mapping Tone Mapping Operator
- 1.Yoshida A., Blanz V., Myszkowski K., and Seidel H. Perceptual evaluation of tone mapping operators with real-world scenes. In Proceedings of SPIE Human Vision & Electronic Imaging X, pages 192–203, San Jose, CA, USA, 2005.Google Scholar
- 2.Industrial Light & Magic (2008) OpenEXR. Available at: http://www.openexr.com.
- 3.SIM2 MULTIMEDIA Available at: http://www.sim2.com/HDR/.
- 4.Spheron HDR VR. Available at: http://www.spheron.com/home.html.
- 5.Guthier B. Real-time algorithms for high dynamic range video. PhD. Thesis, 2012.Google Scholar
- 7.Banterle F., Artusi A., Debattista K., and Chalmers A. Advanced High Dynamic Range Imaging: Theory and Practice. AK Peters (CRC Press), Natrick, MA, USA, 2011.Google Scholar
- 10.Drago F., Martens W., Myszkowski K., and Seidel H. Perceptual evaluation of tone mapping operators. In Procedings of ACM SIGGRAPH 2003 Sketches & Applications, pages 1–1. ACM Press, 2003.Google Scholar
- 13.Mather G. Foundations of Perception. Psychology Press, Hove, East Sussex, 2006.Google Scholar
- 14.Ward G. Real pixels. In Graphic Gems II, pages 80–83. Academic Press, 1991.Google Scholar
- 15.Ward G. A contrast-based scalefactor for luminance display. In Graphic Gems IV, pages 415–421. Academic Press, 1994.Google Scholar
- 17.Ward G. and Simmons M. JPEG-HDR: A backwards-compatible high dynamic range extension to jpeg. In ACM SIGGRAPH 2006 Courses, 2006.Google Scholar
- 19.Kuang J., Johnson G., and Fairchild M. iCAM06: A refined image appearance model for hdr image rendering. J. Visual Communication and Image Representation (JVCI), 18(5):406–414, October 2007.Google Scholar
- 20.Kuang J., Yamaguchi H., Liu C., Johnson G., and Fairchild M. Evaluating hdr rendering algorithms. ACM Transactions on Applied Perception (TAP), 4(2), Article No. 9,July 2007.Google Scholar
- 22.Chiu K., Herf M., Shirley P., Swamy S., Wang C., and Zimmerman K. Spatially nonuniform scaling functions for high contrast images. In Proceedings of Graphics Interface, pages 245–253, 1993.Google Scholar
- 23.Ashikhmin M. A tone mapping algorithm for high contrast images. In Proceedings of the 13 th Eurographics workshop on Rendering (EGRW), pages 145–156, 2002.Google Scholar
- 26.Narwaria M., Silva M., Callet P., and Pepion R. Effect of tone mapping operators on visual attention deployment. In Proceedings of SPIE 8499, Applications of Digital Image Processing XXXV, San Diego, California, USA, 2012.Google Scholar
- 28.Narwaria M., Silva M., Callet P., and Pepion R. Impact of tone mapping in high dynamic range image compression. In Proceedings of Eighth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM), Chandler, Arizona, USA, 2014.Google Scholar
- 29.Narwaria M., Silva M., Callet P., and Pepion R. Tone mapping based hdr compression: Does it affect visual experience? Signal Processing: Image Communication, 29(2):257–273, February 2014.Google Scholar
- 30.Sugiyama N., Kaida H., Xue X., Jinno T., Adami N., and Okuda M. HDR compression using optimized tone mapping model. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 1001–1004, 2009.Google Scholar
- 34.Mantiuk R., Jim K., Rempel A., and Heidrich W. HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. ACM Transactions on Graphics (TOG), 30(4), July 2011.Google Scholar
- 35.Mantiuk R., Myszkowski K., and Seidel H. A perceptual framework for contrast processing of high dynamic range images. ACM Transactions on Applied Perception (TAP), 3(3):267–276, July 2006.Google Scholar
- 36.Rensink R. Visual attention. In Encyclopedia of Cognitive Science. Nature Publishing Group, London, 2003.Google Scholar
- 37.Mann S. and Picard R. Being ‘undigitial’ with digital cameras: Extending dynamic range by combining differently exposed pictures. In Proceedings of IS&T 48th Annual Conference, pages 422–428. Society for Imaging Science and Technology, 1995.Google Scholar
- 38.Aydin T., Mantiuk R., and Seidel H. Extending quality metrics to full luminance range images. In Proceedings of SPIE Human Vision & Electronic Imaging XIII, pages 68060B–68060B–10, San Jose, CA, USA, 2008.Google Scholar