User-guided line abstraction using coherence and structure analysis
Line drawing is a style of image abstraction where the perceptual content of the image is conveyed using distinct straight or curved lines. However, extracting semantically salient lines is not trivial and mastered only by skilled artists. While many parametric filters have successfully extracted accurate and coherent lines, their results are sensitive to parameter choice and easily lead to either an excessive or insufficient number of lines. In this work, we present an interactive system to generate concise line abstractions of arbitrary images via a few user specified strokes. Specifically, the user simply has to provide a few intuitive strokes on the input images, including tracing roughly along edges and scribbling on the region of interest, through a sketching interface. The system then automatically extracts lines that are long, coherent and share similar textural structures to form a corresponding highly detailed line drawing. We have tested our system with a wide variety of images. Our experimental results show that our system outperforms state-of-the-art techniques in terms of quality and efficiency.
Keywordsline abstraction interactive drawing coherence strokes structure strokes stroke matching
We are grateful to the anonymous reviewers for their comments and suggestions. The work was supported in part by the “Ministry of Science and Technology of Taiwan” (Nos. 103-2221-E-007-065-MY3 and 105-2221-E-007-104-MY2).
- Kyprianidis, J. E.; Döllner, J. Image abstraction by structure adaptive filtering. In: Proceedings of the EG UK Theory and Practice of Computer Graphics, 51–58, 2008.Google Scholar
- Maire, M.; Arbelaez, P.; Fowlkes, C.; Malik, J. Using contours to detect and localize junctions in natural images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1–8, 2008.Google Scholar
- Limpaecher, A.; Feltman, N.; Treuille, A.; Cohen, M. Real-time drawing assistance through crowdsourcing. ACM Transactions on Graphics Vol. 32, No. 4, Article No. 54, 2013.Google Scholar
- Su, Q.; Li, W. H. A.; Wang, J.; Fu, H. EZsketching: Three-level optimization for error-tolerant image tracing. ACM Transactions on Graphics Vol. 33, No. 4, Article No. 54, 2014.Google Scholar
- Gleicher, M. Image snapping. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, 183–190, 1995.Google Scholar
- Lee, Y. J.; Zitnick, C. L.; Cohen, M. F. ShadowDraw: Real-time user guidance for freehand drawing. ACM Transactions on Graphics Vol. 30, No. 4, Article No. 27, 2011.Google Scholar
- Iarussi, E.; Bousseau, A.; Tsandilas, T. The drawing assistant: Automated drawing guidance and feedback from photographs. In: Proceedings of the ACM Symposium on User Interface Software and Technology, 2013.Google Scholar
- Dixon, D.; Prasad, M.; Hammond, T. iCanDraw: Using sketch recognition and corrective feedback to assist a user in drawing human faces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 897–906, 2010.Google Scholar
- Lu, J.; Barnes, C.; DiVerdi, S.; Finkelstein, A. RealBrush: Painting with examples of physical media. ACM Transactions on Graphics Vol. 32, No. 4, Article No. 117, 2013.Google Scholar
- Berger, I.; Shamir, A.; Mahler, M.; Carter, E.; Hodgins, J. Style and abstraction in portrait sketching. ACM Transactions on Graphics Vol. 32, No. 4, Article No. 55, 2013.Google Scholar
- Yang, S.; Wang, J.; Shapiro, L. Supervised semantic gradient extraction using linear-time optimization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2826–2833, 2013.Google Scholar
- Wobbrock, J. O.; Wilson, A. D.; Li, Y. Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. In: Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, 159–168, 2007.Google Scholar
Open Access The articles published in this journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.