Abstract
In this paper, we propose a novel method for the metamorphosis between two different images. By the approach, the transition sequence is generated by stitching two forward and backward warped sequences in a three-dimensional space along transition surface. In contrast to the traditional methods by blending two warped images at each intermediate frame, we continuously warp images on opposite direction without blending until the two warped images match in a three-dimensional space leading to a better transition in quality. Furthermore, for each pixel, we make decision of choosing a given input image best suitable so as to produce plausible in-between images to prevent from ghost and blur. By our scheme, the transition surface is computed by minimizing an energy function in terms of graph-cut optimization. Depending on the transition surface, a warp function is proposed to create a smooth and clear transformation. We demonstrate the advantage of our framework by performing transformation test to various kinds of image couples.
Similar content being viewed by others
References
Beier, T., Neely, S.: Feature-based image metamorphosis. ACM SIGGRAPH Comput. Graph. 26(2), 35–42 (1992) (Proceedings of SIGGRAPH 92)
Nishita, T., Fujii, T., Nakamae, E.: Metamorphosis using Bezier clipping. In: Proceedings of PCCGA 93, pp. 162–173 (1993)
Wolberg, G.: Digital Image Warping. IEEE Computer Society Press, Washington (1990)
Lee, S., Chwa, K.Y., Hahn, J., Shin, S.Y.: Image morphing using deformation techniques. J. Vis. Comput. Animat. 7, 3–23 (1996)
Hu, S.M., Li, C.F., Zhang, H.: Actual morphing: a physics-based approach to blending. In: Proceedings of ACM SMA 04, pp. 309–314 (1994)
Stich, T., Linz, C., Wallraven, C., Cunningham, D., Magnor, M.: Perception-motivated interpolation of image sequences. ACM Trans. Appl. Percept. 8(2), 1–25 (2011)
Mahajan, D., Huang, F., Matusik, W., Ramorthi, R., Belhumeur, P.: Moving gradients: a path-based method for plausible image interpolation. ACM Trans. Graph. 28(3), 42:1–42:11 (2009) (SIGGRAPH 09)
Wolberg, G.: Image morphing: a survey. Vis. Comput. 14, 360–372 (1998)
Karam, H., Hassanien, A., Nakajima, M.: Feature-based image metamorphosis optimization algorithm. In: Proceedings of VSMM 01, pp. 555–564 (2001)
Lee, S., Chwa, K.Y., Hahn, J., Shin, S.Y., Wolberg, G.: Image metamorphosis using snakes and free-form deformations. In: Proceedings of SIGGRAPH 95, pp. 439–448 (1995)
Litwinowicz, P., Williams, L.: Animating images with drawings. In: Proceedings of SIGGRAPH 94, pp. 409–412 (1994)
Stich, T., Linz, C., Albuquerque, G., Magnor, M.: View and time interpolation in image space. Comput. Graph. Forum 27(7), 1781–1787 (2008)
Stich, T., Magnor, M.: Image morphing for space-time interpolation. Computer Graphic Lab, TU Braunschweig, Technical Report (2007)
Lerios, A., Garfinkle, C.D., Levoy, M.: Feature-based volume metamorphosis. In: Proceedings of SIGGRAPH 95, pp. 449–456 (1995)
Szewczyk, R., Ferencz, A., Andrews, H., Smith, B.C.: Motion and feature-based video metamorphosis. In: Proceedings of MULTIMEDIA 97, pp. 273–281 (1997)
Zhang, Z., Wang, L., Guo, B., Shum, H.Y.: Feature-based light field morphing. ACM Trans. Graph. 21(3), 457–464 (2002) (Proceedings of SIGGRAPH 02)
Schaefer, S., McPhail, T., Warren, J.: Image deformation using moving least squares. In: ACM Transactions on Graphics (TOG), pp. 533–540 (2006) (Proceedings of SIGGRAPH 06)
Lipski, C., Linz, C., Magnor, M.: Belief propagation optical Flow for high-resolution image morphing. In: SIGGRAPH 10 ACM SIGGRAPH 2010 Posters, p. 67 (2010)
Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graph cut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22(3), 277–286 (2003) (Proceedings of SIGGRAPH 03)
Schödl, A., Szeliski, R., Salesin, D.H., Essa, I.: Video textures. In: Proceedings of SIGGRAPH 00, pp. 489–498 (2000)
Linz, C., Lipski, C., Magnor, M.: Multi-image interpolation based on graph-cuts and symmetric optic flow. In: Proceedings of Vision, Modeling and Visualization (VMV), pp. 115–122. Eurographics Association, Aire-la-Ville (2010)
Bhat, P., Zitnick, L., Snavely, N., Agarwala, A., Agrawala, M., Curless, B., Cohen, M., Kang, S.: Using photographs to enhance videos of a static scene. In: Proceedings of Eurographics Symposium on Rendering, pp. 327–338 (2007)
Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)
Acknowledgements
Support to the research has been from the National Fundamental S&T Research Grant 973 Program (2009CB320802, 2011CB302801), the NSFC grant (60833007), and the Research Grant of University of Macau.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wu, E., Liu, F. Robust image metamorphosis immune from ghost and blur. Vis Comput 29, 311–321 (2013). https://doi.org/10.1007/s00371-012-0734-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-012-0734-8