Skip to main content
Log in

Robust image metamorphosis immune from ghost and blur

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

In this paper, we propose a novel method for the metamorphosis between two different images. By the approach, the transition sequence is generated by stitching two forward and backward warped sequences in a three-dimensional space along transition surface. In contrast to the traditional methods by blending two warped images at each intermediate frame, we continuously warp images on opposite direction without blending until the two warped images match in a three-dimensional space leading to a better transition in quality. Furthermore, for each pixel, we make decision of choosing a given input image best suitable so as to produce plausible in-between images to prevent from ghost and blur. By our scheme, the transition surface is computed by minimizing an energy function in terms of graph-cut optimization. Depending on the transition surface, a warp function is proposed to create a smooth and clear transformation. We demonstrate the advantage of our framework by performing transformation test to various kinds of image couples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Beier, T., Neely, S.: Feature-based image metamorphosis. ACM SIGGRAPH Comput. Graph. 26(2), 35–42 (1992) (Proceedings of SIGGRAPH 92)

    Article  Google Scholar 

  2. Nishita, T., Fujii, T., Nakamae, E.: Metamorphosis using Bezier clipping. In: Proceedings of PCCGA 93, pp. 162–173 (1993)

    Google Scholar 

  3. Wolberg, G.: Digital Image Warping. IEEE Computer Society Press, Washington (1990)

    Google Scholar 

  4. Lee, S., Chwa, K.Y., Hahn, J., Shin, S.Y.: Image morphing using deformation techniques. J. Vis. Comput. Animat. 7, 3–23 (1996)

    Article  Google Scholar 

  5. Hu, S.M., Li, C.F., Zhang, H.: Actual morphing: a physics-based approach to blending. In: Proceedings of ACM SMA 04, pp. 309–314 (1994)

    Google Scholar 

  6. Stich, T., Linz, C., Wallraven, C., Cunningham, D., Magnor, M.: Perception-motivated interpolation of image sequences. ACM Trans. Appl. Percept. 8(2), 1–25 (2011)

    Article  Google Scholar 

  7. Mahajan, D., Huang, F., Matusik, W., Ramorthi, R., Belhumeur, P.: Moving gradients: a path-based method for plausible image interpolation. ACM Trans. Graph. 28(3), 42:1–42:11 (2009) (SIGGRAPH 09)

    Article  Google Scholar 

  8. Wolberg, G.: Image morphing: a survey. Vis. Comput. 14, 360–372 (1998)

    Article  Google Scholar 

  9. Karam, H., Hassanien, A., Nakajima, M.: Feature-based image metamorphosis optimization algorithm. In: Proceedings of VSMM 01, pp. 555–564 (2001)

    Google Scholar 

  10. Lee, S., Chwa, K.Y., Hahn, J., Shin, S.Y., Wolberg, G.: Image metamorphosis using snakes and free-form deformations. In: Proceedings of SIGGRAPH 95, pp. 439–448 (1995)

    Chapter  Google Scholar 

  11. Litwinowicz, P., Williams, L.: Animating images with drawings. In: Proceedings of SIGGRAPH 94, pp. 409–412 (1994)

    Chapter  Google Scholar 

  12. Stich, T., Linz, C., Albuquerque, G., Magnor, M.: View and time interpolation in image space. Comput. Graph. Forum 27(7), 1781–1787 (2008)

    Article  Google Scholar 

  13. Stich, T., Magnor, M.: Image morphing for space-time interpolation. Computer Graphic Lab, TU Braunschweig, Technical Report (2007)

  14. Lerios, A., Garfinkle, C.D., Levoy, M.: Feature-based volume metamorphosis. In: Proceedings of SIGGRAPH 95, pp. 449–456 (1995)

    Chapter  Google Scholar 

  15. Szewczyk, R., Ferencz, A., Andrews, H., Smith, B.C.: Motion and feature-based video metamorphosis. In: Proceedings of MULTIMEDIA 97, pp. 273–281 (1997)

    Chapter  Google Scholar 

  16. Zhang, Z., Wang, L., Guo, B., Shum, H.Y.: Feature-based light field morphing. ACM Trans. Graph. 21(3), 457–464 (2002) (Proceedings of SIGGRAPH 02)

    Article  Google Scholar 

  17. Schaefer, S., McPhail, T., Warren, J.: Image deformation using moving least squares. In: ACM Transactions on Graphics (TOG), pp. 533–540 (2006) (Proceedings of SIGGRAPH 06)

    Google Scholar 

  18. Lipski, C., Linz, C., Magnor, M.: Belief propagation optical Flow for high-resolution image morphing. In: SIGGRAPH 10 ACM SIGGRAPH 2010 Posters, p. 67 (2010)

    Google Scholar 

  19. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graph cut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22(3), 277–286 (2003) (Proceedings of SIGGRAPH 03)

    Article  Google Scholar 

  20. Schödl, A., Szeliski, R., Salesin, D.H., Essa, I.: Video textures. In: Proceedings of SIGGRAPH 00, pp. 489–498 (2000)

    Chapter  Google Scholar 

  21. Linz, C., Lipski, C., Magnor, M.: Multi-image interpolation based on graph-cuts and symmetric optic flow. In: Proceedings of Vision, Modeling and Visualization (VMV), pp. 115–122. Eurographics Association, Aire-la-Ville (2010)

    Google Scholar 

  22. Bhat, P., Zitnick, L., Snavely, N., Agarwala, A., Agrawala, M., Curless, B., Cohen, M., Kang, S.: Using photographs to enhance videos of a static scene. In: Proceedings of Eurographics Symposium on Rendering, pp. 327–338 (2007)

    Google Scholar 

  23. Boykov, Y., Veksler, O., Zabih, R.: Fast approximate energy minimization via graph cuts. IEEE Trans. Pattern Anal. Mach. Intell. 23(11), 1222–1239 (2001)

    Article  Google Scholar 

Download references

Acknowledgements

Support to the research has been from the National Fundamental S&T Research Grant 973 Program (2009CB320802, 2011CB302801), the NSFC grant (60833007), and the Research Grant of University of Macau.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Feitong Liu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wu, E., Liu, F. Robust image metamorphosis immune from ghost and blur. Vis Comput 29, 311–321 (2013). https://doi.org/10.1007/s00371-012-0734-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-012-0734-8

Keywords

Navigation