Motion Map Generation for Maintaining the Temporal Coherence of Brush Strokes

  • Youngsup Park
  • KyungHyun Yoon
Part of the Communications in Computer and Information Science book series (CCIS, volume 4)


Painterly animation is a method that expresses images with a hand-painted appearance from a video, and the most crucial element for it is the coherence between frames. A motion map generation is proposed in this paper as a resolution to the issue of maintaining the coherence in the brush strokes between the frames. A motion map refers to the range of motion calculated by their magnitudes and directions between the frames with the edge of the previous frame as a point of reference. The different methods of motion estimation used in this paper include the optical flow method and the block-based method, and the method that yielded the biggest PSNR using the motion information (the directions and magnitudes) acquired by various methods of motion estimation has been chosen as the final motion information to form a motion map. The created motion map determined the part of the frame that should be re-painted. In order to maintain the temporal coherence, the motion information was applied to only the strong edges that determine the directions of the brush strokes. Also, this paper sought to reduce the flickering phenomenon between the frames by using the multiple exposure method and the difference map created by the difference between images of the source and the canvas. Maintenance of the coherence in the direction of the brush strokes was also attempted by a local gradient interpolation in an attempt to maintain the structural coherence.


Non-photorealistic Animation Painterly Animation Motion Map Temporal Coherence Strong Edge Local Gradient Interpolation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Beier, T., Neely, S.: Feature based image metamorphosis. In: SIGGRAPH 1992, pp. 35–42 (1992)Google Scholar
  2. Deng, Y., Kenney, C., Moore, M., Manjunath, B.: Peer group filtering and perceptual color image quantization. In: ISCAS 1999, pp. 21–24 (1999a)Google Scholar
  3. Deng, Y., Manjunath, B., Shin, H.: Color image segmentation. In: CVPR 1999, pp. 2446–2451 (1999b)Google Scholar
  4. Hays, J., Essa, I.: Image and video based painterly animation. In: NPAR 2004, pp. 113–120 (2004)Google Scholar
  5. Hertzmann, A.: Painterly rendering with curved brush strokes of multiple sizes. In: SIGGRAPH 1998, pp. 453–460 (1998)Google Scholar
  6. Hertzmann, A., Perlin, K.: Painterly rendering for video and interaction. In: NPAR 2000, pp. 7–12 (2000)Google Scholar
  7. Horn, B., Schunck, B.: Determining optical flow. In: Artifitial Intelligence, pp. 185–203 (1981)Google Scholar
  8. Koga, T., Iinuma, K., Hirano, A., Iijima, Y., Ishiguro, T.: Motion-compensated interframe coding for video. In: NTC 1981, pp. 531–534 (1981)Google Scholar
  9. Laybourne, K.: Animation Book, 2nd edn. Three Reviers Press (1998)Google Scholar
  10. Litwinowicz, P.: Processing images and video for an impressionist. In: SIGGRAPH 1997, pp. 407–414 (1997)Google Scholar
  11. Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: DARPA Image Understanding Workshop, pp. 121–130 (1981)Google Scholar
  12. Park, Y., Yoon, K.: Adaptive brush stroke generation for painterly rendering. In: EG 2004 - Short Presentations, pp. 65–68 (2004)Google Scholar
  13. Tekalp, A.M.: Digital Video Processing, 2nd edn. Prentice Hall, Englewood Cliffs (1995)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Youngsup Park
    • 1
  • KyungHyun Yoon
    • 1
  1. 1.Chung-Ang University 221 HukSeok-Dong, DongJak-Gu, SeoulKorea

Personalised recommendations