Skip to main content
SpringerLink
Log in

Painterly rendering with content-dependent natural paint strokes

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We present a new painterly rendering method that simulates artists’ content-dependent painting process and the natural variation of hand-painted strokes. First, a new stroke layout strategy is proposed to enhance the contrast between large and small paint strokes, which is an important characteristic of hand-painted paintings. Specifically, the input image is partitioned into nonuniform grids according to its importance map, and determined by the grid size, an individually constructed paint stroke is applied in each grid. Second, an anisotropic digital brush is designed to simulate a real paint brush. In particular, each bristle of the digital brush has an individual color, so that strokes rendered by the new brush can have multiple colors and naturally varied textures. Finally, we present a novel method to add lighting effects to the canvas. This lighting imitation method is robust and very easy to implement, and it can significantly improve the quality of rendering. Comparing with traditional painterly rendering approaches, the new method simulates more closely the real painting procedure, and our experimental results show that it can produce vivid paintings with fewer artifacts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Bors, A.G.: Introduction of the radial basis function (rbf) networks. In: Online Symposium for Electronics Engineers. DSP Algorithms: Multimedia, vol. 1 (2001)

    Google Scholar 

  2. Curtis, C., Anderson, S., Seims, J., Fleischer, K., Salesin, D.: Computer-generated watercolor. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, pp. 421–430. ACM/Addison-Wesley, New York (1997)

    Google Scholar 

  3. Gooch, B., Coombe, G., Shirley, P.: Artistic vision: Painterly rendering using computer vision techniques. In: Proceedings of the 2nd International Symposium on Non-photorealistic Animation and rendering, June, Citeseer, pp. 03–05 (2002)

    Google Scholar 

  4. Haeberli, P.: Paint by numbers: Abstract image representations. Comput. Graph. 24(4), 214 (1990)

    Google Scholar 

  5. Hays, J., Essa, I.: Image and video based painterly animation. In: Proceedings of the 3rd International Symposium on Non-photorealistic Animation and Rendering, pp. 113–120 (2004). doi:10.1145/987657.987676

    Chapter  Google Scholar 

  6. Hertzmann, A.: Painterly rendering with curved brush strokes of multiple sizes. In: Computer Graphics. Proceedings. SIGGRAPH 98 Conference Proceedings, pp. 453–60. ACM, New York (1998). Proceedings of SIGGRAPH 98: 25th International Conference on Computer Graphics and Interactive Techniques, 19–24 July 1998, Orlando, FL, USA

    Chapter  Google Scholar 

  7. Hertzmann, A.: Fast paint texture. In: Proceedings of the 2nd International Symposium on Non-photorealistic Animation and Rendering, June, pp. 03–05 (2002). doi:10.1145/508530.508546

    Google Scholar 

  8. Hertzmann, A., Perlin, K.: Painterly rendering for video and interaction. In: Proceedings of the 1st International Symposium on Non-photorealistic Animation and Rendering, pp. 7–12. ACM, New York (2000)

    Chapter  Google Scholar 

  9. Hertzmann, A., Jacobs, C., Oliver, N., Curless, B., Salesin, D.: Image analogies. In: Proceedings of SIGGRAPH, pp. 327–340 (2001)

    Google Scholar 

  10. Huang, H., Fu, T., Li, C.: Anisotropic brush for painterly rendering. In: Proceedings of Computer Graphics International. Computer Graphics Society (2010)

  11. Huang, H., Zang, Y., Li, C.: Example-based painting guided by color features. Vis. Comput. 26(6–8), 933–942 (2010)

    Article  Google Scholar 

  12. Huang, H., Zhang, L., Fu, T.N.: Video painting via motion layer manipulation. Comput. Graph. Forum 29(7), 2055–2064 (2010)

    Article  Google Scholar 

  13. Kagaya, M., Brendel, W., Deng, Q., Kesterson, T., Todorovic, S., Neill, P., Zhang, E.: Video painting with space-time-varying style parameters. IEEE Trans. Vis. Comput. Graph. (2010)

  14. Lee, H., Lee, C., Yoon, K.: Motion based painterly rendering. Comput. Graph. Forum 28(4), 1207–1215 (2009)

    Article  Google Scholar 

  15. Lin, L., Zeng, K., Lv, H., Wang, Y., Xu, Y., Zhu, S.: Painterly animation using video semantics and feature correspondence. In: Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, pp. 73–80. ACM, New York (2010)

    Chapter  Google Scholar 

  16. Litwinowicz, P.: Processing images and video for an impressionist effect. In: Computer Graphics Proceedings, SIGGRAPH 97, pp. 407–414. ACM, New York (1997). Proceedings of 24th International Conference on Computer Graphics and Interactive Techniques, 3–8 August 1997, Los Angeles, CA, USA

    Google Scholar 

  17. Olsen, S., Maxwell, B., Gooch, B.: Interactive vector fields for painterly rendering. In: Proceedings of Graphics Interface 2005, p. 247 (2005). Canadian Human-Computer Communications Society

  18. Streit, L., Buchanan, J., et al.: Importance driven halftoning. Comput. Graph. Forum 17, 207–218 (1998)

    Article  Google Scholar 

  19. Wang, B., Wang, W., Yang, H., Sun, J.: Efficient example-based painting and synthesis of 2d directional texture. IEEE Trans. Vis. Comput. Graph. 10(3), 266–277 (2004)

    Article  Google Scholar 

  20. Winkenbach, G., Salesin, D.: Computer-generated pen-and-ink illustration. In: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, p. 100. ACM, New York (1994)

    Google Scholar 

  21. Zeng, K., Zhao, M., Xiong, C., Zhu, S.C.: From image parsing to painterly rendering. ACM Trans. Graph. 29(1), 2:1–2:11 (2009). doi:http://doi.acm.org/10.1145/1640443.1640445

    Article  Google Scholar 

  22. Zhang, E., Mischaikow, K., Turk, G.: Vector field design on surfaces. ACM Trans. Graph. 25(4), 1294–1326 (2006). doi:http://doi.acm.org/10.1145/1183287.1183290

    Article  Google Scholar 

  23. Zhang, E., Hays, J., Turk, G.: Interactive tensor field design and visualization on surfaces. IEEE Trans. Vis. Comput. Graph. 13(1), 94–107 (2007). doi:10.1109/TVCG.2007.16

    Article  Google Scholar 

  24. Zhang, S., Chen, T., Zhang, Y., Hu, S., Martin, R.: Video-based running water animation in Chinese painting style. Sci. China Ser. F 52(2), 162–171 (2009)

    Article  Google Scholar 

  25. Zhang, S., Li, X., Hu, S., Martin, R.: Online video stream stylization. Tech. rep. (2009). URL http://cg.cs.tsinghua.edu.cn/papers/VideoStylization.pdf

  26. Zhao, M., Zhu, S.C.: Sisley the abstract painter. In: NPAR ’10: Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering, pp. 99–107. ACM, New York (2010). doi:http://doi.acm.org/10.1145/1809939.1809951

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Electronic and Information Engineering, Xi’an Jiaotong University, Xi’an, China

    Hua Huang & Tian-Nan Fu

  2. School of Engineering, Swansea University, Swansea, UK

    Chen-Feng Li

Authors
  1. Hua Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tian-Nan Fu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chen-Feng Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hua Huang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Huang, H., Fu, TN. & Li, CF. Painterly rendering with content-dependent natural paint strokes. Vis Comput 27, 861–871 (2011). https://doi.org/10.1007/s00371-011-0596-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-011-0596-5

Keywords

Search

Navigation