Skip to main content
SpringerLink
Log in

Real-time 3D rendering with hatching

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

We present an approach for real-time pen-and-ink hatching renderings on large scenes. Starting with 3D models including photorealistic textures and materials, we aim to propose a solution that produces hatched renderings. As we consider scene objects described as polygonal meshes with their own textures, we produce once hatching patterns at different tones and resolutions considering the material of each object. To achieve that, we create a flow direction map per texture pixel, using contour characteristics extracted from the original texture and then interpolated. Stroke trajectories are thus generated depending on the flow direction and using B-splines, providing tones from light-to-dark. Tones are then stored in a mutli-resolution tonal art map. Moreover, we aim to overcome the limitations of existing hatching rendering methods by introducing an illumination model, fully implemented on GPU and able to manage three shading types: regular shadow, soft/cast shadow and self-shadowing. Tones and hatching resolutions are, therefore, assigned according to local/global illumination supporting multiple light sources. Our model, both dedicated for 3D static model renderings and 3D model animation, supports model deformations and is also spatially and temporally coherent since it gives continuous hatching strokes during object animations and/or light displacements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Similar content being viewed by others

References

  1. Barla, P., Breslav, S., Thollot, J., Sillion, F.X., Markosian, L.: Stroke pattern analysis and synthesis. Comput. Graph. Forum 25(3), 663–671 (2006)

    Article  Google Scholar 

  2. Belhadj, F.: Terrain modeling: a constrained fractal model. In: Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa, AFRIGRAPH ’07, pp. 197–204 (2007)

  3. Breslav, S., Szerszen, K., Markosian, L., Barla, P., Thollot, J.: Dynamic 2d patterns for shading 3d scenes. ACM Trans. Graph. 26(3), 20 (2007)

    Article  Google Scholar 

  4. Chen, J., Guennebaud, G., Barla, P., Granier, X.: Non-oriented mls gradient fields. Comput. Graph. Forum 32(8), 98–109 (2013)

    Article  Google Scholar 

  5. Coconu, L., Deussen, O., Hege, H.C.: Real-time pen-and-ink illustration of landscapes. In: NPAR, pp. 27–35 (2006)

  6. Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H.S., Finkelstein, A., Funkhouser, T., Rusinkiewicz, S.: Where do people draw lines? ACM Trans. Graph. (Proc. SIGGRAPH) 27(3) (2008)

  7. Deussen, O., Hiller, S., van Overveld, C.W.A.M., Strothotte, T.: Floating points: a method for computing stipple drawings. Comput. Graph. Forum 19(3), 41–50 (2000)

    Article  Google Scholar 

  8. Deussen, O., Strothotte, T.: Computer-generated pen-and-ink illustration of trees. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, SIGGRAPH ’00, pp. 13–18 (2000)

  9. Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp. 341–346 (2001)

  10. Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2, ICCV ’99, pp. 1033–1038 (1999)

  11. Freeman, W.T., Tenenbaum, J.B., Pasztor, E.C.: Learning style translation for the lines of a drawing. ACM Trans. Graph. 22(1), 33–46 (2003)

    Article  Google Scholar 

  12. Freudenberg, B., Masuch, M., Strothotte, T.: Walk-Through Illustrations: Frame-Coherent Pen-and-Ink Style in a Game Engine. Proceedings of Eurographics 2001 (Manchester, UK, sep 2001) 20(3), 184–191 (2001)

  13. Fung, J., Veryovka, O.: Pen-and-Ink Textures for Real-Time Rendering. In: GI2003, pp. 131–138 (2003)

  14. Gerl, M., Isenberg, T.: Interactive example-based hatching. Comput. Graph. 37(1–2), 65–80 (2013)

    Article  Google Scholar 

  15. Girshick, A., Interrante, V., Haker, S., Lemoine, T.: Line direction matters: an argument for the use of principal directions in 3d line drawings. In: NPAR, pp. 43–52 (2000)

  16. Han, J., Zhou, K., Wei, L.Y., Gong, M., Bao, H., Zhang, X., Guo, B.: Fast example-based surface texture synthesis via discrete optimization. Vis. Comput. 22(9), 918–925 (2006)

    Article  Google Scholar 

  17. Hasenfratz, J.M., Lapierre, M., Holzschuch, N., Sillion, F.X.: A survey of real-time soft shadows algorithms. Comput. Forum 22(4), 753–774 (2003)

    Article  Google Scholar 

  18. Hertzmann, A., Oliver, N., Curless, B., Seitz, S.M.: Curve analogies. In: Proceedings of the 13th Eurographics Workshop on Rendering Techniques, Pisa, Italy, June 26–28, 2002, pp. 233–246 (2002)

  19. Hertzmann, A., Zorin, D.: Illustrating smooth surfaces. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’00, pp. 517–526 (2000)

  20. Jodoin, P., Epstein, E., Granger-Piché, M., Ostromoukhov, V.: Hatching by example: a statistical approach. In: NPAR, pp. 29–36 (2002)

  21. Kalnins, R.D., Markosian, L., Meier, B.J., Kowalski, M.A., Lee, J.C., Davidson, P.L., Webb, M., Hughes, J.F., Finkelstein, A.: WYSIWYG NPR: drawing strokes directly on 3d models. ACM Trans. Graph. 21(3), 755–762 (2002)

    Article  Google Scholar 

  22. Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., Hertzmann, A.: Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Trans. Graph. 31(1) (2012)

  23. Kim, Y., Yu, J., Yu, X., Lee, S.: Line-art illustration of dynamic and specular surfaces. ACM Trans. Graph. (SIGGRAPH ASIA 2008) 27(5) (2008)

  24. Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. In: Proceedings of the 32nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’05, pp. 795–802 (2005)

  25. Lawonn, K., Mönch, T., Preim, B.: Streamlines for illustrative real-time rendering. Comput. Graph. Forum 32(3), 321–330 (2013)

    Article  Google Scholar 

  26. Lefebvre, S., Hoppe, H.: Appearance-space texture synthesis. In: Proceedings of the 33rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’06, pp. 541–548 (2006)

  27. Guptill, L.A.: Rendering in pen and ink, 60 edn. Watson-Guptill Publications (1997)

  28. Lum, E.B., Ma, K.: Expressive line selection by example. Vis. Comput. 21(8–10), 811–820 (2005)

    Article  Google Scholar 

  29. Martín, D., Arroyo, G., Luzón, M.V., Isenberg, T.: Scale-dependent and example-based grayscale stippling. Comput. Graph. 35(1), 160–174 (2011)

    Article  Google Scholar 

  30. Neyret, F.: Advected textures. In: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’03, pp. 147–153 (2003)

  31. Paget, R.: Strong markov random field model. IEEE Trans. Pattern Anal. Mach. Intell. 26(3), 408–413 (2004)

    Article  Google Scholar 

  32. Popat, A.C.: Conjoint probabilistic subband modeling. In: Vismod (1997)

  33. Praun, E., Finkelstein, A., Hoppe, H.: Lapped textures. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’00, pp. 465–470 (2000)

  34. Praun, E., Hoppe, H., Webb, M., Finkelstein, A.: Real-time hatching. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp. 581– (2001)

  35. Rössl, C., Kobbelt, L.: Line-art rendering of 3d-models. In: Proceedings of the 8th Pacific Conference on Computer Graphics and Applications, 3–5 October 2000

  36. Röttger, S., Irion, A., Ertl, T.: Shadow volumes revisited. In: WSCG, pp. 373–380 (2002)

  37. Runions, A., Samavati, F., Prusinkiewicz, P.: Ribbons: a representation for point clouds. Vis. Comput. 23(9–11), 945–954 (2007). doi:10.1007/s00371-007-0153-4

    Article  Google Scholar 

  38. Salisbury, M.P., Anderson, S.E., Barzel, R., Salesin, D.H.: Interactive pen-and-ink illustration. In: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’94, pp. 101–108 (1994)

  39. Salisbury, M.P., Wong, M.T., Hughes, J.F., Salesin, D.H.: Orientable textures for image-based pen-and-ink illustration. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’97, pp. 401–406 (1997)

  40. Soler, C., Cani, M.P., Angelidis, A.: Hierarchical pattern mapping. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’02, pp. 673–680 (2002)

  41. Streit, L.M., Buchanan, J.W.: Importance driven halftoning. Comput. Graph. Forum 17(3), 207–218 (1998)

    Article  Google Scholar 

  42. Suarez, J., Belhadj, F., Boyer, V.: Gpu real time hatching. In: WSCG, pp. 101–108 (2013)

  43. Turk, G.: Generating textures on arbitrary surfaces using reaction-diffusion. In: Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’91, pp. 289–298 (1991)

  44. Turk, G.: Texture synthesis on surfaces. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp. 347–354 (2001)

  45. Umenhoffer, T., Szécsi, L., Szirmay-Kalos, L.: Hatching for motion picture production. Comput. Graph. Forum 30(2), 533–542 (2011)

    Article  Google Scholar 

  46. Veryovka, O.: Animation with threshold textures. In: Graphics Interface, pp. 9–16 (2002)

  47. Webb, M., Praun, E., Finkelstein, A., Hoppe, H.: Fine tone control in hardware hatching. In: Proceedings of the 2nd International Symposium on Non-photorealistic Animation and Rendering, NPAR ’02, p. 53 (2002)

  48. Wei, L.Y., Lefebvre, S., Kwatra, V., Turk, G.: State of the art in example-based texture synthesis. In: Proceedings of Eurographics (2009)

  49. Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’00, pp. 479–488 (2000)

  50. Wei, L.Y., Levoy, M.: Texture synthesis over arbitrary manifold surfaces. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp. 355–360 (2001)

  51. Wijk, J.J.V.: Image based flow visualization for curved surfaces. In: Proceedings of the 14th IEEE Visualization 2003 (VIS’03), VIS ’03, pp. 17– (2003)

  52. Winkenbach, G., Salesin, D.H.: Computer-generated pen-and-ink illustration. In: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’94, pp. 91–100 (1994)

  53. Winnemöller, H., Kyprianidis, J.E., Olsen, S.C.: Xdog: an extended difference-of-gaussians compendium including advanced image stylization. Comput. Graph. 36(6), 740–753(2012)

  54. Ying, L., Hertzmann, A., Biermann, H., Zorin, D.: Texture and shape synthesis on surfaces. In: Proceedings of the 12th Eurographics Conference on Rendering, EGWR’01, pp. 301–312 (2001)

  55. Zander, J., Isenberg, T., Schlechtweg, S., Strothotte, T.: High quality hatching. Comput. Graph. Forum 23(3), 421–430 (2004)

    Article  Google Scholar 

  56. Zhang, E., Mischaikow, K., Turk, G.: Vector field design on surfaces. ACM Trans. Graph. 25(4), 1294–1326 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. L.I.A.S.D.-University Paris 8, Saint-Denis, France

    Jordane Suarez, Farès Belhadj & Vincent Boyer

Authors
  1. Jordane Suarez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Farès Belhadj
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vincent Boyer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Vincent Boyer.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Suarez, J., Belhadj, F. & Boyer, V. Real-time 3D rendering with hatching. Vis Comput 33, 1319–1334 (2017). https://doi.org/10.1007/s00371-016-1222-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-016-1222-3

Keywords

Search

Navigation