Abstract
We present an approach for real-time pen-and-ink hatching renderings on large scenes. Starting with 3D models including photorealistic textures and materials, we aim to propose a solution that produces hatched renderings. As we consider scene objects described as polygonal meshes with their own textures, we produce once hatching patterns at different tones and resolutions considering the material of each object. To achieve that, we create a flow direction map per texture pixel, using contour characteristics extracted from the original texture and then interpolated. Stroke trajectories are thus generated depending on the flow direction and using B-splines, providing tones from light-to-dark. Tones are then stored in a mutli-resolution tonal art map. Moreover, we aim to overcome the limitations of existing hatching rendering methods by introducing an illumination model, fully implemented on GPU and able to manage three shading types: regular shadow, soft/cast shadow and self-shadowing. Tones and hatching resolutions are, therefore, assigned according to local/global illumination supporting multiple light sources. Our model, both dedicated for 3D static model renderings and 3D model animation, supports model deformations and is also spatially and temporally coherent since it gives continuous hatching strokes during object animations and/or light displacements.
Similar content being viewed by others
References
Barla, P., Breslav, S., Thollot, J., Sillion, F.X., Markosian, L.: Stroke pattern analysis and synthesis. Comput. Graph. Forum 25(3), 663–671 (2006)
Belhadj, F.: Terrain modeling: a constrained fractal model. In: Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa, AFRIGRAPH ’07, pp. 197–204 (2007)
Breslav, S., Szerszen, K., Markosian, L., Barla, P., Thollot, J.: Dynamic 2d patterns for shading 3d scenes. ACM Trans. Graph. 26(3), 20 (2007)
Chen, J., Guennebaud, G., Barla, P., Granier, X.: Non-oriented mls gradient fields. Comput. Graph. Forum 32(8), 98–109 (2013)
Coconu, L., Deussen, O., Hege, H.C.: Real-time pen-and-ink illustration of landscapes. In: NPAR, pp. 27–35 (2006)
Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H.S., Finkelstein, A., Funkhouser, T., Rusinkiewicz, S.: Where do people draw lines? ACM Trans. Graph. (Proc. SIGGRAPH) 27(3) (2008)
Deussen, O., Hiller, S., van Overveld, C.W.A.M., Strothotte, T.: Floating points: a method for computing stipple drawings. Comput. Graph. Forum 19(3), 41–50 (2000)
Deussen, O., Strothotte, T.: Computer-generated pen-and-ink illustration of trees. In: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, SIGGRAPH ’00, pp. 13–18 (2000)
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp. 341–346 (2001)
Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2, ICCV ’99, pp. 1033–1038 (1999)
Freeman, W.T., Tenenbaum, J.B., Pasztor, E.C.: Learning style translation for the lines of a drawing. ACM Trans. Graph. 22(1), 33–46 (2003)
Freudenberg, B., Masuch, M., Strothotte, T.: Walk-Through Illustrations: Frame-Coherent Pen-and-Ink Style in a Game Engine. Proceedings of Eurographics 2001 (Manchester, UK, sep 2001) 20(3), 184–191 (2001)
Fung, J., Veryovka, O.: Pen-and-Ink Textures for Real-Time Rendering. In: GI2003, pp. 131–138 (2003)
Gerl, M., Isenberg, T.: Interactive example-based hatching. Comput. Graph. 37(1–2), 65–80 (2013)
Girshick, A., Interrante, V., Haker, S., Lemoine, T.: Line direction matters: an argument for the use of principal directions in 3d line drawings. In: NPAR, pp. 43–52 (2000)
Han, J., Zhou, K., Wei, L.Y., Gong, M., Bao, H., Zhang, X., Guo, B.: Fast example-based surface texture synthesis via discrete optimization. Vis. Comput. 22(9), 918–925 (2006)
Hasenfratz, J.M., Lapierre, M., Holzschuch, N., Sillion, F.X.: A survey of real-time soft shadows algorithms. Comput. Forum 22(4), 753–774 (2003)
Hertzmann, A., Oliver, N., Curless, B., Seitz, S.M.: Curve analogies. In: Proceedings of the 13th Eurographics Workshop on Rendering Techniques, Pisa, Italy, June 26–28, 2002, pp. 233–246 (2002)
Hertzmann, A., Zorin, D.: Illustrating smooth surfaces. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’00, pp. 517–526 (2000)
Jodoin, P., Epstein, E., Granger-Piché, M., Ostromoukhov, V.: Hatching by example: a statistical approach. In: NPAR, pp. 29–36 (2002)
Kalnins, R.D., Markosian, L., Meier, B.J., Kowalski, M.A., Lee, J.C., Davidson, P.L., Webb, M., Hughes, J.F., Finkelstein, A.: WYSIWYG NPR: drawing strokes directly on 3d models. ACM Trans. Graph. 21(3), 755–762 (2002)
Kalogerakis, E., Nowrouzezahrai, D., Breslav, S., Hertzmann, A.: Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Trans. Graph. 31(1) (2012)
Kim, Y., Yu, J., Yu, X., Lee, S.: Line-art illustration of dynamic and specular surfaces. ACM Trans. Graph. (SIGGRAPH ASIA 2008) 27(5) (2008)
Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. In: Proceedings of the 32nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’05, pp. 795–802 (2005)
Lawonn, K., Mönch, T., Preim, B.: Streamlines for illustrative real-time rendering. Comput. Graph. Forum 32(3), 321–330 (2013)
Lefebvre, S., Hoppe, H.: Appearance-space texture synthesis. In: Proceedings of the 33rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’06, pp. 541–548 (2006)
Guptill, L.A.: Rendering in pen and ink, 60 edn. Watson-Guptill Publications (1997)
Lum, E.B., Ma, K.: Expressive line selection by example. Vis. Comput. 21(8–10), 811–820 (2005)
Martín, D., Arroyo, G., Luzón, M.V., Isenberg, T.: Scale-dependent and example-based grayscale stippling. Comput. Graph. 35(1), 160–174 (2011)
Neyret, F.: Advected textures. In: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA ’03, pp. 147–153 (2003)
Paget, R.: Strong markov random field model. IEEE Trans. Pattern Anal. Mach. Intell. 26(3), 408–413 (2004)
Popat, A.C.: Conjoint probabilistic subband modeling. In: Vismod (1997)
Praun, E., Finkelstein, A., Hoppe, H.: Lapped textures. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’00, pp. 465–470 (2000)
Praun, E., Hoppe, H., Webb, M., Finkelstein, A.: Real-time hatching. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp. 581– (2001)
Rössl, C., Kobbelt, L.: Line-art rendering of 3d-models. In: Proceedings of the 8th Pacific Conference on Computer Graphics and Applications, 3–5 October 2000
Röttger, S., Irion, A., Ertl, T.: Shadow volumes revisited. In: WSCG, pp. 373–380 (2002)
Runions, A., Samavati, F., Prusinkiewicz, P.: Ribbons: a representation for point clouds. Vis. Comput. 23(9–11), 945–954 (2007). doi:10.1007/s00371-007-0153-4
Salisbury, M.P., Anderson, S.E., Barzel, R., Salesin, D.H.: Interactive pen-and-ink illustration. In: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’94, pp. 101–108 (1994)
Salisbury, M.P., Wong, M.T., Hughes, J.F., Salesin, D.H.: Orientable textures for image-based pen-and-ink illustration. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’97, pp. 401–406 (1997)
Soler, C., Cani, M.P., Angelidis, A.: Hierarchical pattern mapping. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’02, pp. 673–680 (2002)
Streit, L.M., Buchanan, J.W.: Importance driven halftoning. Comput. Graph. Forum 17(3), 207–218 (1998)
Suarez, J., Belhadj, F., Boyer, V.: Gpu real time hatching. In: WSCG, pp. 101–108 (2013)
Turk, G.: Generating textures on arbitrary surfaces using reaction-diffusion. In: Proceedings of the 18th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’91, pp. 289–298 (1991)
Turk, G.: Texture synthesis on surfaces. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp. 347–354 (2001)
Umenhoffer, T., Szécsi, L., Szirmay-Kalos, L.: Hatching for motion picture production. Comput. Graph. Forum 30(2), 533–542 (2011)
Veryovka, O.: Animation with threshold textures. In: Graphics Interface, pp. 9–16 (2002)
Webb, M., Praun, E., Finkelstein, A., Hoppe, H.: Fine tone control in hardware hatching. In: Proceedings of the 2nd International Symposium on Non-photorealistic Animation and Rendering, NPAR ’02, p. 53 (2002)
Wei, L.Y., Lefebvre, S., Kwatra, V., Turk, G.: State of the art in example-based texture synthesis. In: Proceedings of Eurographics (2009)
Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’00, pp. 479–488 (2000)
Wei, L.Y., Levoy, M.: Texture synthesis over arbitrary manifold surfaces. In: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, pp. 355–360 (2001)
Wijk, J.J.V.: Image based flow visualization for curved surfaces. In: Proceedings of the 14th IEEE Visualization 2003 (VIS’03), VIS ’03, pp. 17– (2003)
Winkenbach, G., Salesin, D.H.: Computer-generated pen-and-ink illustration. In: Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’94, pp. 91–100 (1994)
Winnemöller, H., Kyprianidis, J.E., Olsen, S.C.: Xdog: an extended difference-of-gaussians compendium including advanced image stylization. Comput. Graph. 36(6), 740–753(2012)
Ying, L., Hertzmann, A., Biermann, H., Zorin, D.: Texture and shape synthesis on surfaces. In: Proceedings of the 12th Eurographics Conference on Rendering, EGWR’01, pp. 301–312 (2001)
Zander, J., Isenberg, T., Schlechtweg, S., Strothotte, T.: High quality hatching. Comput. Graph. Forum 23(3), 421–430 (2004)
Zhang, E., Mischaikow, K., Turk, G.: Vector field design on surfaces. ACM Trans. Graph. 25(4), 1294–1326 (2006)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Suarez, J., Belhadj, F. & Boyer, V. Real-time 3D rendering with hatching. Vis Comput 33, 1319–1334 (2017). https://doi.org/10.1007/s00371-016-1222-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-016-1222-3