Abstract
Traditional cartoons have been widely used in entertainment, education, and advertisement. Thus, a large amount of cartoon data is available. In this paper, we propose a new technique for capturing the motion of a character in an existing cartoon sequence. This technique tracks the contours of the cartoon character in the sequence, and key frames are used to guide the tracking. We model contour tracking as a space-time optimization problem in which an energy function including both temporal and spatial constraints is defined. First, the user labels the contours of the character on the key frames. Then, the contours on the intermediate frames are tracked by minimizing the energy function. The user may need to interactively adjust the tracking result and restart the optimization process to refine the result. Finally, an edge snapping algorithm is applied to make the tracking result more precise. Experiments show that our technique works effectively.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Agarwala, A., Hertzmann, A., Salesin, D.H., Seitz, S.M., 2004. Keyframe-based tracking for rotoscoping and animation. ACM Trans. Graph., 23(3):584–591. [doi:10.1145/1015706.1015764]
Bregler, C., Loeb, L., Chuang, E., Deshpande, H., 2002. Turning to the masters: motion capturing cartoons. ACM Trans. Graph., 21(3):399–407. [doi:10.1145/566654.566595]
Canny, J., 1986. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell., 8(6):679–698. [doi:10.1109/TPAMI.1986.4767851]
Chui, H., Rangarajan, A., 2003. A new point matching algorithm for non-rigid registration. Comput. Vis. Image Understand., 89(2–3):114–141. [doi:10.1016/S1077-3142(03)00009-2]
Comaniciu, D., Meer, P., 2002. Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell., 24(5):603–619. [doi:10.1109/34.1000236]
de Juan, C., Bodenheimer, B., 2004. Cartoon Textures. Proc. ACM SIGGRAPH/Eurographics Symp. on Computer Animation, p.267–276. [doi:10.1145/1028523.1028559]
Lucas, B.D., Kanade, T., 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. Proc. 7th Int. Joint Conf. on Artificial Intelligence, p.674–679.
Mortensen, E.N., Barrett, W.A., 1995. Intelligent Scissors for Image Composition. Proc. 22nd Annual Conf. on Computer Graphics and Interactive Techniques, p.191–198. [doi:10.1145/218380.218442]
Nocedal, J., Wright, S.J., 2006. Numerical Optimization (2nd Ed.). Springer, New York, p.258–265.
Rastegari, M., Gheissari, N., 2008. Multi-Scale Cartoon Motion Capture and Retargeting without Shape Matching. Proc. Digital Image Computing Techniques and Applications, p.320–326. [doi:10.1109/DICTA.2008.51]
Schodl, A., Szeliski, R., Salesin, D.H., Essa, I., 2000. Video Textures. Proc. 27th Annual Conf. on Computer Graphics and Interactive Techniques, p.489–498. [doi:10.1145/344779.345012]
Sumi, F., Nakajima, M., 2003. A Production Method of Reusing Existing 2D Animation Sequences. Proc. Computer Graphics Int., p.282–287. [doi:10.1109/CGI.2003.1214483]
van Haevre, W., di Fiore, F., van Reeth, F., 2005. Uniting Cartoon Textures with Computer Assisted Animation. Proc. 3rd Int. Conf. on Computer Graphics and Interactive Techniques, p.245–253. [doi:10.1145/1101389.1101437]
Wang, H., Li, H., 2002. Cartoon Motion Capture by Shape Matching. Proc. 10th Pacific Conf. on Computer Graphics and Applications, p.454–456. [doi:10.1109/PCCGA.2002.1167899]
Yang, Y., Zhuang, Y., Xu, D., Pan, Y., Tao, D., Maybank, S., 2009. Retrieval Based Interactive Cartoon Synthesis via Unsupervised Bi-distance Metric Learning. Proc. 17th ACM Int. Conf. on Multimedia, p.311–320. [doi:10.1145/1631272.1631316]
Yu, J., Zhuang, Y., Xiao, J., Chen, C., 2007. Adaptive control in cartoon data reusing. Comput. Animat. Virt. Worlds, 18(4–5):571–582. [doi:10.1002/cav.189]
Zhuang, Y., Yu, J., Xiao, J., Chen, C., 2008. Perspective-aware cartoon clips synthesis. Comput. Animat. Virt. Worlds, 19(3–4):355–364. [doi:10.1002/cav.258]
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by the National Natural Science Foundation of China (No. 60903134), the National Key Technology R & D Program of China (No. 2007BAH11B00), and the Fundamental Research Funds for the Central Universities of China (No. 2009QNA5021)
Rights and permissions
About this article
Cite this article
Zhou, Cl., Xiao, J. Cartoon capture by key-frame based contour tracking. J. Zhejiang Univ. - Sci. C 12, 36–43 (2011). https://doi.org/10.1631/jzus.C1000123
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.C1000123