Robust Classification of Strokes with SVM and Grouping
The ability to recognize the strokes drawn by the user, is central to most sketch-based interfaces. However, very few solutions that rely on recognition are robust enough to make sketching a definitive alternative to traditional WIMP user interfaces. In this paper, we propose an approach based on classification that given an unconstrained sketch, can robustly assign a label to each stroke that comprises the sketch. A key contribution of our approach is a technique for grouping strokes that eliminates outliers and enhances the robustness of the classification. We also propose a set of features that capture important attributes of the shape and mutual relationship of strokes. These features are statistically well-behaved and enable robust classification with Support Vector Machines (SVM). We conclude by presenting a concrete implementation of these techniques in an interface for driving facial expressions.
KeywordsSupport Vector Machine Facial Expression Semantic Grouping Training Vector Shape Attribute
Unable to display preview. Download preview PDF.
Supplementary material (70,410 KB)
- 2.Chang, E., Jenkins, O.C.: Sketching articulation and pose for facial animation, 19–26 (2006)Google Scholar
- 4.Sharon, D., van de Panne, M.: Constellation models for sketch recognition. SBIM 2006, 19–26 (2006)Google Scholar
- 5.Shilman, M., Viola, P., Chellapilla, K.: Recognition and grouping of handwritten text in diagrams and equations. In: IWFHR 2004, pp. 569–574. IEEE Computer Society Press, Washington, DC, USA (2004)Google Scholar
- 6.Cheong, C.E., Kim, H.Y., Suh, J.W., Kim, H.: Handwritten numeral string recognition with stroke grouping. In: ICDAR 1999, p. 745. IEEE Computer Society, Washington, DC, USA (1999)Google Scholar
- 7.Saund, E., Mahoney, J., Fleet, D., Larner, D., Lank, E.: Perceptual organization as a foundation for intelligent sketch editing (2002)Google Scholar
- 8.Saund, E., Moran, T.P.: A perceptually-supported sketch editor. In: ACM Symposium on User Interface Software and Technology, pp. 175–184. ACM, New York (1994)Google Scholar
- 9.Arnheim, R.: Art and Visual Perception: A Psychology of the Creative Eye (1974)Google Scholar
- 10.Yang, C., Sharon, D., van de Panne, M.: Sketch-based modeling of parameterized objects. In: Eurographics Workshop on Sketch-Based Interfaces and Modeling, pp. 63–72 (2005)Google Scholar
- 11.Nataneli, G., Faloutsos, P.: Technical report: Sketching facial expressions. UCLA (2007), URL: http://www.cs.ucla.edu/~nataneli/pages/publications.html