Advertisement

The Visual Computer

, Volume 32, Issue 12, pp 1549–1561 | Cite as

Image stylization using anisotropic reaction diffusion

  • Ming-Te Chi
  • Wei-Ching Liu
  • Shu-Hsuan Hsu
Original Article
  • 422 Downloads

Abstract

Image stylization refers to the process of converting input images to a specific representation that enhances image content using several designed patterns. The critical steps to a successful image stylization are the design of patterns and arrangements. However, only skilled artists master such tasks because these tasks are challenging for most users. In this paper, a novel image stylization system based on anisotropic reaction diffusion is proposed to facilitate pattern generation and stylized image design. The system begins with self-organized patterns generated by reaction diffusion. To extend the style of reaction diffusion, the proposed method involves using a set of modifications of anisotropic diffusion to deform shape and introducing a flow field to guide pattern arrangement. A pattern picker is proposed to facilitate the pattern selection from these modifications. In the post-process step, a new thresholding and color mapping method is introduced to refine the sizes, densities, and colors of patterns. From the experimental results and a user study, several image stylizations, including paper-cut, stylized halftone, and motion illusion, are generated using our method, demonstrating the feasibility and flexibility of the proposed system.

Keywords

Non-photorealistic rendering Image stylization Reaction diffusion Pattern generation 

Notes

Acknowledgments

We thank the anonymous reviewers and the editor for their valuable comments. We acknowledge Chao-Hung Lin and Shin-Syun Lin for their suggestions. We thank Chen-Chi Hu for helping on user study. This work is supported by the ministry of science and technology, Taiwan under MOST 103-2221-E-004-008.

References

  1. 1.
    Barla, P., Thollot, J., Markosian, L.: X-toon: An extended toon shader. In: Proceedings of the 4th International Symposium on Non-photorealistic Animation and Rendering, NPAR ’06, pp. 127–132. ACM, New York, NY, USA (2006)Google Scholar
  2. 2.
    Bousseau, A., Neyret, F., Thollot, J., Salesin, D.: Video watercolorization using bidirectional texture advection. In: ACM SIGGRAPH 2007 Papers, SIGGRAPH ’07. ACM, New York, NY, USA (2007)Google Scholar
  3. 3.
    Chi, M.T., Lee, T.Y., Qu, Y., Wong, T.T.: Self-animating images: illusory motion using repeated asymmetric patterns. In: ACM Transactions on Graphics (TOG), vol. 27, p. 62. ACM (2008)Google Scholar
  4. 4.
    Huang, H., Fu, T.N., Li, C.F.: Painterly rendering with content-dependent natural paint strokes. Visual Comp. 27(9), 861–871 (2011)CrossRefGoogle Scholar
  5. 5.
    Huang, H., Zang, Y., Li, C.F.: Example-based painting guided by color features. Visual Comp. 26(6–8), 933–942 (2010)CrossRefGoogle Scholar
  6. 6.
    Kang, H., Lee, S., Chui, C.K.: Coherent line drawing. In: Proceedings of the 5th International Symposium on Non-photorealistic Animation and Rendering, NPAR ’07, pp. 43–50. ACM, New York, NY, USA (2007)Google Scholar
  7. 7.
    Kang, H., Lee, S., Chui, C.K.: Flow-based image abstraction. IEEE Trans. Visual. Comp. Graph. 15(1), 62–76 (2009)CrossRefGoogle Scholar
  8. 8.
    Kim, T., Lin, M.: Stable advection-reaction-diffusion with arbitrary anisotropy. Comput. Animat. Virtual Worlds 18(4–5), 329–338 (2007)CrossRefGoogle Scholar
  9. 9.
    Kyprianidis, J.E., Döllner, J.: Image abstraction by structure adaptive filtering. In: Proc. EG UK Theory and Practice of Computer Graphics, pp. 51–58 (2008)Google Scholar
  10. 10.
    Kyprianidis, J.E., Kang, H.: Image and video abstraction by coherence-enhancing filtering. Computer Graphics Forum 30(2), 593–V602 (2011). (Proceedings Eurographics 2011) Google Scholar
  11. 11.
    Lee, H., Seo, S., Ryoo, S., Yoon, K.: Directional texture transfer. In: Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, NPAR ’10, pp. 43–48. ACM, New York, NY, USA (2010)Google Scholar
  12. 12.
    Li, Y., Bao, F., Zhang, E., Kobayashi, Y., Wonka, P.: Geometry synthesis on surfaces using field-guided shape grammars. Visual. Comp. Graph. IEEE Trans. 17(2), 231–243 (2011)CrossRefGoogle Scholar
  13. 13.
    McGraw, T.: Generalized reaction diffusion textures. Comp. Graph. 32(1), 82–92 (2008)CrossRefGoogle Scholar
  14. 14.
    Pearson, J.E.: Complex patterns in a simple system. Science 261(5118), 189–192 (1993)CrossRefGoogle Scholar
  15. 15.
    Pizer, S.M., Amburn, E.P., Austin, J.D., Cromartie, R., Geselowitz, A., Greer, T., Romeny, B.T.H., Zimmerman, J.B.: Adaptive histogram equalization and its variations. Comput. Vision Graph. Image Process. 39(3), 355–368 (1987)CrossRefGoogle Scholar
  16. 16.
    Sanderson, A.R., Johnson, C.R., Kirby, R.M.: Display of vector fields using a reaction-diffusion model. In: Proceedings of the Conference on Visualization ’04. VIS ’04, pp. 115–122. IEEE Computer Society, Washington, DC, USA (2004)Google Scholar
  17. 17.
    Son, M., Lee, Y., Kang, H., Lee, S.: Structure grid for directional stippling. Graph. Models 73(3), 74–87 (2011)CrossRefGoogle Scholar
  18. 18.
    Steidl, G., Teuber, T.: Anisotropic smoothing using double orientations. In: Scale Space and Variational Methods in Computer Vision, pp. 477–489. Springer (2009)Google Scholar
  19. 19.
    Turk, G.: Generating textures on arbitrary surfaces using reaction-diffusion. In: ACM SIGGRAPH 1991 Papers, SIGGRAPH ’91, pp. 289–298. ACM, New York, NY, USA (1991)Google Scholar
  20. 20.
    Wan, L., Liu, X., Wong, T.T., Leung, C.S.: Evolving mazes from images. Visual. Comp. Graph. IEEE Trans. 16(2), 287–297 (2010)CrossRefGoogle Scholar
  21. 21.
    Witkin, A., Kass, M.: Reaction-diffusion textures. ACM Siggraph. Comp. Graph. 25(4), 299–308 (1991)CrossRefGoogle Scholar
  22. 22.
    Xu, J., Kaplan, C.S.: Artistic thresholding. In: Proceedings of the 6th International Symposium on Non-photorealistic Animation and Rendering, NPAR ’08, pp. 39–47. ACM, New York, NY, USA (2008)Google Scholar
  23. 23.
    Xu, J., Kaplan, C.S., Mi, X.: Computer-generated papercutting. In: Proceedings of the 15th Pacific Conference on Computer Graphics and Applications, PG ’07, pp. 343–350. IEEE Computer Society, Washington, DC, USA (2007)Google Scholar
  24. 24.
    Zang, Y., Huang, H., Li, C.F.: Artistic preprocessing for painterly rendering and image stylization. Visual Comp. 30(9), 969–979 (2014)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2015

Authors and Affiliations

  1. 1.National Chengchi UniversityTaiwanRepublic of China

Personalised recommendations