Advertisement

Expressive line drawings of human faces from range images

  • YueZhu HuangEmail author
  • Ralph R. Martin
  • Paul L. Rosin
  • XiangXu Meng
  • ChengLei Yang
Article

Abstract

We propose a novel technique to extract features from a range image and use them to produce a 3D pen-and-ink style portrait similar to a traditional artistic drawing. Unlike most previous template-based, component-based or example-based face sketching methods, which work from a frontal photograph as input, our system uses a range image as input. Our method runs in real-time for models of moderate complexity, allowing the pose and drawing style to be modified interactively. Portrait drawing in our system makes use of occluding contours and suggestive contours as the most important shape cues. However, current 3D feature line detection methods require a smooth mesh and cannot be reliably applied directly to noisy range images. We thus present an improved silhouette line detection algorithm. Feature edges related to the significant parts of a face are extracted from the range image, connected, and smoothed, allowing us to construct chains of line paths which can then be rendered as desired. We also incorporate various portrait-drawing principles to provide several simple yet effective nonphotorealistic portrait renderers such as a pen-and-ink shader, a hatch shader and a sketch shader. These are able to generate various life-like impressions in different styles from a user-chosen viewpoint. To obtain satisfactory results, we refine rendered output by smoothing changes in line thickness and opacity. We are careful to provide appropriate visual cues to enhance the viewer’s comprehension of the human face. Our experimental results demonstrate the robustness and effectiveness of our approach, and further suggest that our approach can be extended to other 3D geometric objects.

Keywords

portrait drawing non-photorealistic rendering line drawing suggestive contour occluding contour feature line stylization 

References

  1. 1.
    Gooch B, Reinhard E, Gooch A. Human facial illustrations: Creation and psychophysical evaluation. ACM Trans Graph, 2004, 23(1): 27–44CrossRefGoogle Scholar
  2. 2.
    Hertzmann A, Zorin D. Illustrating smooth surfaces. In: Proc of SIGGRAPH, 2000, 517–526Google Scholar
  3. 3.
    Isenberg T, Halper N, Strothotte T. Stylizing silhouettes at interactive rates: From silhouette edges to silhouette strokes. In: Proc of EuroGraphics, 2002, 249–258Google Scholar
  4. 4.
    Kalnins R, Markosian L, Meier B, et al. WYSIWYG NPR: Drawing strokes directly on 3d models. In: Proc of SIGGRAPH, 2002. 755–762Google Scholar
  5. 5.
    Kalnins R, Davidson P, Markosian L, et al. Coherent stylized silhouettes. ACM Trans Graph, 2003, 22(3): 856–861CrossRefGoogle Scholar
  6. 6.
    Northrup J, Markosian L. Artistic silhouettes: a hybrid ap proach. In: Proc of NPAR, 2000. 31–38Google Scholar
  7. 7.
    Sousa CM, Buchanan WJ. Computer-generated graphite pencil rendering of 3d polygonal models. In: Proc of EuroGraphics, 1999. 195–208Google Scholar
  8. 8.
    Winkenbach G, Salesin H D. Computer-generated pen-and-ink illustration. In: Proc of SIGGRAPH, 1994. 91–100Google Scholar
  9. 9.
    Liang L, Chen H, Xu Y Q, et al. Example-based caricature generation with exaggeration. In: Proc of 10th Pacific Conf on Computer Graphic and Application, 2002. 386–393Google Scholar
  10. 10.
    Chen H, Liu Z Q, Rose C, et al. Example-based composite sketching of human portraits. In: Proc of NPAR, 2004. 95–153Google Scholar
  11. 11.
    Tresset P, Leymarie F F. Generative Portrait Sketching. In: 11th Inter Conf on Virtual Systems and Multi-Media, 2005. 739–748Google Scholar
  12. 12.
    Douglas G R. Drawing Portraits. New York: Watson-Guptill Publications, 1983Google Scholar
  13. 13.
    Freeman J. Portrait Drawing. Marlborough: Crowood Press, 2006Google Scholar
  14. 14.
    Blake W, Lawn J. Portrait Drawing: A Step-by-Step Art Instruction Book. New York: Watson-Guptill Publications, 2006Google Scholar
  15. 15.
    Decarlo D, Finkelstein A, Rusinkiewicz S, et al. Suggestive contours for conveying shape. ACM Trans Graph, 2003, 22(3): 848–855CrossRefGoogle Scholar
  16. 16.
    Decarlo D, Finkelstein A, Rusinkiewicz S. Interactive rendering of suggestive contours with temporal coherence. In: Proc of NPAR, 2004. 15–24Google Scholar
  17. 17.
    Akleman E. Making caricature with morphing. In: Proc of SIGGRAPH, 1997. 145Google Scholar
  18. 18.
    Luo Y, Gavrilova M L, Sousa M C. NPAR by example: line drawing facial animation from photographs. In: IEEE Inter Conf on Computer Graphics, Imaging and Visualization, 2006. 514–521Google Scholar
  19. 19.
    Xu Z J, Chen H, Zhu S C, et al. A hierarchical compositional model for face representation and sketching. IEEE Trans Patt Anal Mach Intell, 2008, 30(6): 955–969CrossRefGoogle Scholar
  20. 20.
    Fujiwara T, Koshimizu H, Fujimura K, et al. 3D modeling system of human face and full 3D facial caricaturing. In: Proc of 3D Digital Imaging and Modeling, 2001. 39–51Google Scholar
  21. 21.
    Boyer V. An artistic portrait caricature model. In: Proc of Inter Symp of Visual Computing, 2005. 595–600Google Scholar
  22. 22.
    Cole F, Golovinskiy A, Limpaecher A, et al. Where do people draw lines? ACM Trans Graph, 2008, 22(3): 44–55Google Scholar
  23. 23.
    Decarlo D, Finkelstein A. Line drawings from 3D models. In: Proc of SIGGRAPH, Course Note, 2005Google Scholar
  24. 24.
    Decarlo D, Rusinkiewicz S. Highlight lines for conveying shape. In: Proc of NPAR, 2007. 63–70Google Scholar
  25. 25.
    Lee Y J, Markosian L, Lee S, et al. Line drawings via abstracted shading. ACM Trans Graph, 2007, 26(3): 18CrossRefGoogle Scholar
  26. 26.
    Judd T, Durand F, Adelson E. Apparent ridges for line drawing. ACM Trans Graph, 2007, 26(3): 19CrossRefGoogle Scholar
  27. 27.
    Sun X F, Rosin P L, Martin R R, et al. Fast and effective feature-preserving mesh denoising. IEEE Trans Visual Comput Graph, 2007, 13(5): 925–938CrossRefGoogle Scholar
  28. 28.
    Canny J. A computational approach to edge detection. IEEE Trans Patt Anal Mach Intell, 1986, 8(6): 679–698CrossRefGoogle Scholar
  29. 29.
    Finkelstein A, Salesin D H. Multiresolution curves. In: Proc of SIGGRAPH, 1994, 261–268Google Scholar
  30. 30.
    Sousa M C, Prusinkiewicz P. A few good lines: suggestive drawing of 3D models. Comput Graph Forum, 2003, 22(3): 381–390CrossRefGoogle Scholar
  31. 31.
    Kass M, Witkin A, Terzopoulos D. Snakes: active contour models. Inter J Comput Vision, 1988, 1(4): 321–331CrossRefGoogle Scholar
  32. 32.
    Mortensen E, Barrett W. Intelligent scissors for image composition. In: Proc of SIGGRAPH, 1995. 191–198Google Scholar
  33. 33.
    Lake A, Marshall C, Harris M, et al. Stylized rendering techniques for scalable real-time 3d animation. In: Proc of NPAR, 2000. 13–20Google Scholar
  34. 34.
    Goodwin T, Vollick I, Hertzmann A. Isophote distance: A shading approach to artistic stroke thickness. In: Proc of NPAR, 2007. 53–62Google Scholar
  35. 35.
    Flynn J P, Bowyer W K, Phillips J P. Assessment of time dependency in face recognition: An initial study. In: Audio and Video-Based Biometric Person Authentication, 2003. 44–51Google Scholar

Copyright information

© Science in China Press and Springer-Verlag GmbH 2009

Authors and Affiliations

  • YueZhu Huang
    • 1
    • 2
    Email author
  • Ralph R. Martin
    • 2
  • Paul L. Rosin
    • 2
  • XiangXu Meng
    • 1
  • ChengLei Yang
    • 1
  1. 1.Department of Computer Science and TechnologyShandong UniversityJinanChina
  2. 2.School of Computer ScienceCardiff UniversityCardiffUK

Personalised recommendations