Abstract
This paper addresses the problem of retargeting the stereoscopic images. We propose a disparity-constrained resolution adaptation method. In our method, we try to preserve the shapes of the prominent contents in the stereo images when they are displayed in the target resolution. Moreover, in order to improve the visual comfort, viewers can adjust the disparity of the stereo image pair linearly in our method. We first model the retargeting energy considering the images’ significance map, content distortion and disparity constraints. Then we minimize the total energy and solve it as a nonlinear least square problem. The optimization is automatic without any post work, such as inpainting or occlusion handling. Finally, we demonstrate our method on the Middlebury stereo datasets and 3D animation screenshots. For stereo evaluation, the disparity map comparison results are provided.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Mansfield, A., Gehler, P., Van Gool, L., Rother, C.: Scene Carving: Scene Consistent Image Retargeting. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 143–156. Springer, Heidelberg (2010)
Shamir, A., Sorkine, O.: Visual Media Retargeting. ACM SIGGRAPH Asia Courses (2009)
Mendiburu, B.: 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen. Focal Press (2009)
Chamaret, C., Boisson, G., Chevance, C.: Video Retargeting for Stereoscopic Content Under 3D Viewing. SPIE-IS&T Electronic Imaging (2012)
Wang, C., Sawchuk, A.A.: Disparity Manipulation for Stereo Images and Video. In: Proc. SPIE, Stereoscopic Displays and Applications XIX, vol. 6803, p. 68031E (2008)
Chang, C.H., Liang, C.K., Chuang, Y.Y.: Content-aware Display Adaptation and Interactive Editing for Stereoscopic Images. IEEE Transactions on Multimedia (2011)
Liu, C.: Beyond Pixels: Exploring New Representations and Applications for Motion Analysis. Massachusetts Institute of Technology (2009)
Liu, C.W., Huang, T.H., Chang, M.H., Lee, K.Y., Liang, C.K., Chuang, Y.Y.: 3D Cinematography Principles and Their Applications to Stereoscopic Media Processing. IEEE Transactions on Multimedia (2011)
Lowe, D.G.: Distinctive Image Features from Scale-invariant Keypoints. International Journal of Computer Vision (2004)
Banterle, F., Artusi, A., Aydin, T.O., Didyk, P., Eisemann, E., Gutierrez, D., Mantiuk, R., Myszkowski, K.: Multidimensional Image Retargeting. ACM SIGGRAPH Asia (2011)
Lin, H.S., Guan, S.H., Lee, C.T., Ouhyoung, M.: Stereoscopic 3D Experience Optimization Using Cropping and Warping. ACM SIGGRAPH Asia (2011)
Lin, H.Y., Chang, C.C., Hsieh, C.H.: Cooperative Resizing Technique for Stereo Image Pairs. In: International Conference on Software and Computer Applications (2012)
Kiess, J., Guthier, B., Kopf, S., Effelsberg, W.: SeamCrop for Image Retargeting. In: Proc. SPIE, Multimedia on Mobile Devices, vol. 8304 (2012)
Lee, K.Y., Chung, C.D., Chuang, Y.Y.: Scene Warping Layer-based Stereoscopic Image Resizing. In: IEEE Conference on Computer Vision and Pattern Recognition (2012)
Itti, L., Koch, C., Niebur, E.: A Model of Saliency-based Visual Attention for Rapid Scene Analysis. Pattern Analysis and Machine Intelligence (1998)
Fischler, M.A., Bolles, R.C.: Random Sample Consensus: a Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of the ACM (1981)
Lang, M., Hornung, A., Wang, O., Poulakos, S., Gross, M.: Nonlinear Disparity Mapping for Stereoscopic 3D. ACM SIGGRAPH (2010)
Krähenbühl, P., Lang, M., Hornung, A.: A System for Retargeting of Streaming Video. ACM SIGGRAPH Asia (2011)
von Gioi, R.G., Jakubowicz, J., Morel, J.M., Randall, G.: LSD: a Line Segment Detector. Image Processing On Line (2012)
Koppal, S.J., Zitnick, C.L., Cohen, M.F., Kang, S.B., Ressler, B., Colburn, A.: A Viewer-centric Editor for 3D Movies. IEEE Computer Graphics and Applications (2011)
Sugimoto, S., Shimizu, S., Kimata, H., Kojima, A.: Multi-layered Image Retargeting. In: IEEE International Conference on Image Processing (2012)
Basha, T., Moses, Y., Avidan, S.: Stereo Seam Carving a Geometrically Consistent Approach. IEEE Transactions on Pattern Analysis and Machine Intelligence (2013)
Niu, Y., Feng, W.C., Liu, F.: Enabling Warping on Stereoscopic Images. ACM SIGGRAPH Asia (2012)
Wang, Y.S., Tai, C.L., Sorkine, O., Lee, T.Y.: Optimized Scale-and-stretch for Image Resizing. ACM SIGGRAPH Asia (2008)
Scharstein, D., Szeliski, R.: A Taxonomy and Evaluation of Dense Two-frame Stereo Correspondence Algorithms. International Journal of Computer Vision (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer International Publishing Switzerland
About this paper
Cite this paper
Liu, Y., Sun, L., Yang, S. (2013). Disparity-Constrained Resolution Adaptation for Stereoscopic Images. In: Huet, B., Ngo, CW., Tang, J., Zhou, ZH., Hauptmann, A.G., Yan, S. (eds) Advances in Multimedia Information Processing – PCM 2013. PCM 2013. Lecture Notes in Computer Science, vol 8294. Springer, Cham. https://doi.org/10.1007/978-3-319-03731-8_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-03731-8_2
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-03730-1
Online ISBN: 978-3-319-03731-8
eBook Packages: Computer ScienceComputer Science (R0)