Shape Representation Robust to the Sketching Order Using Distance Map and Direction Histogram

  • Kiwon Yun
  • Junyeong Yang
  • Hyeran Byun
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5342)


We propose a powerful shape representation to recognize sketches drawn on a pen-based input device. The proposed method is robust to the sketching order by using the combination of distance map and direction histogram. A distance map created after normalizing a freehand sketch represents a spatial feature of shape regardless of the writing order. Moreover, a distance map which acts a spatial feature is more robust to shape variation than chamfer distance. Direction histogram is also able to extract a directional feature unrelated to the drawing order by using the alignment of the spatial location between two neighboring points of the stroke. The combination of these two features represents rich information to recognize an input sketch. The experiment result demonstrates the superiority of the proposed method more than previous works. It shows 96% recognition performance for the experimental database, which consists of 28 freehand sketches and 10 on-line handwritten digits.


Shape representation Sketch recognition Sketching order On-line handwriting recognition 


  1. 1.
    Connell, S.D., Jain, A.K.: Template-based online character recognition. Pattern Recognition 34(1), 1–14 (2001)CrossRefzbMATHGoogle Scholar
  2. 2.
    Plamondon, R., Smithies, S.: On-line and off-line handwriting recognition: A comprehensive survey. IEEE Trans. on Pattern Analysis and Recognition 22(1), 63–84 (2000)CrossRefGoogle Scholar
  3. 3.
    LaViola, J.J., Zeleznik, R.C.: MathPad2: a system for the creation and exploration of mathematical sketches. ACM Trans. on Graphics 23(3), 432–440 (2004)CrossRefGoogle Scholar
  4. 4.
    Smithies, S., Novins, K., Arvo, J.: A handwriting-based equation editor. In: Proc. of Graphics Interface, Kingston, pp. 84–91 (1999)Google Scholar
  5. 5.
    Chan, K.F., Yeung, D.Y.: PenCalc: A Novel Application of On-Line Mathematical Expression Recognition Technology. In: Proc. of the Sixth International Conf. on Document Analysis and Recognition, Seattle, p. 774 (2001)Google Scholar
  6. 6.
    Matsakis, N.E.: Recognition of handwritten mathematical expression. Master’s thesis, Massachusetts Institute of Technology (1999)Google Scholar
  7. 7.
    Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Analysis and Machine Intell. 24(4), 509–522 (2002)CrossRefGoogle Scholar
  8. 8.
    LaViola, J., Zeleznik, R.: A Practical Approach for Writer-Dependent Symbol Recognition Using a Writer-Independent Symbol Recognizer. IEEE Trans. on Pattern Analysis and Machine Intell., 1917–1926 (2007)Google Scholar
  9. 9.
    Thayananthan, A., Stenger, B., Torr, P., Cipolla, R.: Shape context and chamfer matching in cluttered scenes. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Madison, vol. 1, pp. 127–133 (2003)Google Scholar
  10. 10.
    Sezgin, T.M., Stahovich, T., Davis, R.: Sketch Based Interfaces: Early Processing for Sketch Understanding. In: Proc. 2001 Workshop Perceptive User Interfaces. ACM Press, Orlando (2001)Google Scholar
  11. 11.
    Barrow, H.G., Tenenbaum, J.M., Bolles, R.C., Wolf, H.C.: Parametric correspondence and chamfer matching: Two new techniques for image matching. In: Proc. 5th Int. Joint Conf. Artificial Intell., Cambridge, Massachusetts, pp. 659–663 (1977)Google Scholar
  12. 12.
    Borgefors, G.: Hierarchical chamfer matching: A parametric edge matching algorithm. IEEE Trans. Pattern Analysis and Machine Intell. 10(6), 849–865 (1988)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Kiwon Yun
    • 1
  • Junyeong Yang
    • 1
  • Hyeran Byun
    • 1
  1. 1.Dept. of Computer ScienceYonsei UniversitySeoulKorea

Personalised recommendations