Multimedia Tools and Applications

, Volume 78, Issue 6, pp 6637–6653 | Cite as

Creating waterfall animation on a single image

  • Chih-Yang Lin
  • Yun-Wen Huang
  • Timothy K. ShihEmail author


A static image always becomes more eye-catching with an animation. In this paper, we present a system for adding a waterfall animation to a single image by extracting a flow animation from a video sequence. To the best of our knowledge, this is the first attempt by researchers to create a waterfall animation on a still waterfall image. Such work poses challenges in many areas, including color consistency, texture consistency, flow velocity, block matching, and block effects. The proposed method integrates optical flow, line integral convolution, color transfer, graph-cut, and multi-resolution splining techniques to mimic a real waterfall on a single image. It uses a segmentation process to separate the necessary foreground and the unnecessary background. Then, flow analysis is performed on the target image and source video. Finally, flow similarity and a synthesis process are applied to form the animation. Experiments generated 8 animation results that prove the feasibility of the proposed method. The limitations and potential impact of this research are also discussed in our experimental results.


Video synthesis Image rendering Waterfall animation 



  1. 1.
    Bai J, Agarwala A, Agrawala M, Ramamoorthi R (2013) Automatic cinemagraph portraits. Computer Graphics Forum 32(4):17–25CrossRefGoogle Scholar
  2. 2.
    Barrett WA, Cheney AS (2002) Object-based image editing. ACM Trans Graph 21(3):777–784CrossRefGoogle Scholar
  3. 3.
    Bhat KS, Seitz SM, Hodgins JK, Khosla PK (2004) Flow-based video synthesis and editing. ACM Trans Graph 23(3):360–363CrossRefGoogle Scholar
  4. 4.
    Burt PJ, Adelson EH (1983) A multiresolution spline with application to image mosaics. ACM Trans Graph 2(4):217–236CrossRefGoogle Scholar
  5. 5.
    Cabral B, Leedom LC (1993) Imaging vector fields using line integral convolution, in Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, pp. 263–270Google Scholar
  6. 6.
    Chuang YY, Goldman DB, Zheng KC, Curless B, Salesin DH, Szeliski R (2005) Animating pictures with stochastic motion textures. ACM Trans Graph 24(3):853–860CrossRefGoogle Scholar
  7. 7.
    Efros AA, Freeman WT (2001) Image quilting for texture synthesis and transfer, in Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques: ACM, pp. 341–346Google Scholar
  8. 8.
    Farnebäck G (2003) Two-frame motion estimation based on polynomial expansion, in Scandinavian Conference on Image Analysis: Springer, Berlin, Heidelberg, pp. 363–370CrossRefGoogle Scholar
  9. 9.
    Gonzalex RC, Woods RE (2006) Digital image processing (3ed ed.). Prentice-Hall, Inc., Upper Saddle RiverGoogle Scholar
  10. 10.
    He K, Rhemann C, Rother C, Tang X, Sun J (2011) A global sampling method for alpha matting, in IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2049–2056Google Scholar
  11. 11.
    Hornung A, Dekkers E, Kobbelt L (2007) Character animation from 2D pictures and 3D motion data. ACM Trans Graph 26(1):1CrossRefGoogle Scholar
  12. 12.
    Igarashi T, Moscovich T, Hughes JF (2005) As-rigid-as-possible shape manipulation. ACM Trans Graph 24(3):1134–1141CrossRefGoogle Scholar
  13. 13.
    Kwatra V, Schödl A, Essa I, Turk G, Bobick A (2003) Graphcut textures: image and video synthesis using graph cuts. ACM Trans Graph 22(3):277–286CrossRefGoogle Scholar
  14. 14.
    Litwinowicz P, Williams L (1994) Animating images with drawings, in Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques: ACM Press/Addison-Wesley Publishing Co., pp. 409–412Google Scholar
  15. 15.
    Liu Y, Nie L, Han L, Zhang L, Rosenblum DS (2015) Action2Activity: recognizing complex activities from sensor data, in Proceedings of the 24th International Joint Conference on Artificial Intelligence, pp. 1617–1623Google Scholar
  16. 16.
    Liu L, Cheng L, Liu Y, Jia Y, Rosenblum DS (2016) Recognizing complex activities by a probabilistic interval-based model, in AAAI Conference on Artificial Intelligence, pp. 1266–1272Google Scholar
  17. 17.
    Liu Y, Nie L, Liu L, Rosenblum DS (2016) From action to activity: sensor-based activity recognition. Neurocomputing 118(1):108–115CrossRefGoogle Scholar
  18. 18.
    Liu Y, Zhang L, Nie L, Yan Y, Rosenblum DS (2016) Fortune teller: predicting your career path, in AAAI Conference on Artificial Intelligence, pp. 201–207Google Scholar
  19. 19.
    McNamara A, Treuille A, Popovic Z, Stam J (2004) Fluid control using the adjoint method. ACM Trans Graph 23(3):449–456CrossRefGoogle Scholar
  20. 20.
    Porter T, Duff T (1984) Compositing digital images. ACM Siggraph Computer Graphics 18(3):253–259CrossRefGoogle Scholar
  21. 21.
    Reinhard E, Ashikhmin M, Gooch B, Shirley P (2001) Color transfer between images. IEEE Comput Graph Appl 21(5):34–41CrossRefGoogle Scholar
  22. 22.
    Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans Graph 23(3):309–314CrossRefGoogle Scholar
  23. 23.
    Tompkin J, Pece F, Subr K, Kautz J (2011) Towards moment imagery: Automatic cinemagraphs, in: Proceedings of IEEE Conference on Visual Media Production, pp. 87–93Google Scholar
  24. 24.
    Treuille A, McNamara A, Popovic Z, Stam J (2003) Keyframe control of smoke simulations. ACM Trans Graph 22(3):716–723CrossRefGoogle Scholar
  25. 25.
    Wang Y, Zhu S-C (2003) Modeling textured motion: particle, wave and sketch, in Proceedings. Ninth IEEE International Conference on Computer Vision, pp. 213–220Google Scholar
  26. 26.
    Xie L, Zhu L, Chen G (2016) Unsupervised multi-graph cross-modal hashing for large-scale multimedia retrieval. Multimedia Tools and Applications 75(15):9185–9204CrossRefGoogle Scholar
  27. 27.
    Zhu L, Jin H, Zheng R, Feng X (2014) Effective naive Bayes nearest neighbor based image classification on GPU. J Supercomput 68(2):820–848CrossRefGoogle Scholar
  28. 28.
    Zhu L, Shen J, Xie L (2015) Topic hypergraph hashing for mobile image retrieval, in: Proceedings of the 23rd ACM International Conference on Multimedia, pp. 843–846Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Chih-Yang Lin
    • 1
  • Yun-Wen Huang
    • 2
  • Timothy K. Shih
    • 2
    Email author
  1. 1.Department of Electrical EngineeringYuan-Ze UniversityTaoyuanTaiwan
  2. 2.Department of Computer Science & Information EngineeringNational Central UniversityTaoyuanTaiwan

Personalised recommendations