Using Error Recovery Techniques to Improve Sketch Recognition Accuracy

  • Gennaro Costagliola
  • Vincenzo Deufemia
  • Michele Risi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5046)


Sketching is an activity that produces informal documents containing hand-drawn shapes highly variable and ambiguous. In this paper we present a diagrammatic sketch recognizer that is able to cope with the recognition of in-accurate hand-drawn symbols by exploiting error recovery techniques as developed for programming language compilers. The error recovery algorithms are able to interact with recognizers automatically generated from grammar specifications in order to obtain the information on missing or misrecognized strokes.


Sketch Recognition LR parsing Error Recovery 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alvarado, C., Davis, R.: A framework for multi-domain sketch recognition. In: Proc. of AAAI Spring Symposium on Sketch Understanding, pp. 1–8 (2002)Google Scholar
  2. 2.
    Caetano, A., Goulart, N., Fonseca, M., Jorge, J.: JavaSketchIT: Issues in sketching the look of user interfaces. In: Proc. of AAAI Spring Symposium on Sketch Understanding, pp. 9–14 (2002)Google Scholar
  3. 3.
    Costagliola, G., Deufemia, V., Risi, M.: A multi-layer parsing strategy for on-line recognition of hand-drawn diagrams. In: Proc. of IEEE Symposium Visual Languages and Human Centric Computing (VL/HCC 2006), pp. 103–110 (2006)Google Scholar
  4. 4.
    Costagliola, G., Deufemia, V., Risi, M.: Sketch Grammars: A formalism for describing and recognizing diagrammatic sketch languages. In: Proc. of International Conference on Document Analysis and Recognition (ICDAR 2005), pp. 1226–1230. IEEE Press, Los Alamitos (2005)CrossRefGoogle Scholar
  5. 5.
    Aho, A.V., Sethi, R., Ullman, J.D.: Compilers Principles, Techniques, and Tools. Addison-Wesley, Reading (1987)Google Scholar
  6. 6.
    Snelting, G.: How to build LR parsers which accept incomplete input. SIGPLAN Notices 25(4), 51–58 (1990)CrossRefGoogle Scholar
  7. 7.
    Blostein, D., Lank, A., Rose, A., Zanibbi, R.: User interfaces for on-line diagram recognition. In: Blostein, D., Kwon, Y.-B. (eds.) GREC 2001. LNCS, vol. 2390, pp. 92–103. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  8. 8.
    Kara, L.B., Stahovich, T.F.: Hierarchical parsing and recognition of hand-sketched diagrams. In: Proc. of ACM Conference on User Interface and Software Technologies (UIST 2004), pp. 13–22 (2004)Google Scholar
  9. 9.
    Hammond, T., Davis, R.: LADDER, A sketching language for user interface developers. Computers & Graphics 29(4), 518–532 (2005)CrossRefGoogle Scholar
  10. 10.
    Alvarado, C., Davis, R.: SketchREAD: A multi-domain sketch recognition engine. In: Proc. of User Interface Software and Technology (UIST 2004), pp. 23–32 (2004)Google Scholar
  11. 11.
    Shilman, M., Viola, P.: Spatial recognition and grouping of text and graphics. In: Proc. of Workshop Sketch-Based Interfaces and Modeling, pp. 91–95 (2004)Google Scholar
  12. 12.
    Sezgin, T.M., Davis, R.: HMM-based efficient sketch recognition. In: Proc. of 10th Int. Conf. Intelligent User Interfaces (IUI 2005), pp. 281–283 (2005)Google Scholar
  13. 13.
    Romeu, J.M., Lamiroy, B., Sanchez, G., Llados, J.: Automatic adjacency grammar generation from user drawn sketches. In: Proc. of International Conference on Pattern Recognition (ICPR 2006), pp. 1026–1029. IEEE Press, Los Alamitos (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Gennaro Costagliola
    • 1
  • Vincenzo Deufemia
    • 1
  • Michele Risi
    • 1
  1. 1.Dipartimento di Matematica e InformaticaUniversità di SalernoFiscianoItaly

Personalised recommendations