Dynamic User Modeling for Sketch-Based User Interface

  • Zhengxing Sun
  • Bin Li
  • Qiang Wang
  • Guihuan Feng
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3942)


This paper presents a strategy of dynamic user modeling for sketch-based user interface. A user model is defined as an incremental decision tree for a specific user. A drawing style modeling process is designed to model user’s temporal drawing performances among inputting strokes, and to predict the possible shape in term of fuzzy matching. A user mediation process is proposed based on relevance feedback to capture users’ drawing intentions and refine the recognition results. Experiments prove efficiency of the method.


Feature Vector Relevance Feedback Candidate Object Base User Interface Fuzzy Match 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Landay, J.A., Myers, B.A.: Sketching Interfaces: Toward More Human Interface Design. IEEE Computer 34(3), 56–64 (2001)Google Scholar
  2. 2.
    Sun, Z., Liu, J.: Informal user interfaces for graphical computing. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 675–682. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  3. 3.
    Kara, L.B., Stahovich, T.F.: Sim-U-Sketch: A Sketch-Based Interface for Simulink. In: Proceedings of AVI 2004, pp. 354–357 (2004)Google Scholar
  4. 4.
    Newman, M.W., James, L., Hong, J.I., et al.: DENIM: An informal web site design tool inspired by observations of practice. HCI 18, 259–324 (2003)CrossRefGoogle Scholar
  5. 5.
    Liu, W., Jin, X., Sun, Z.: Sketch-Based User Interface for Inputting Graphic Objects on Small Screen Device. In: Blostein, D., Kwon, Y.-B. (eds.) GREC 2001. LNCS, vol. 2390, pp. 67–85. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  6. 6.
    Sun, Z., Liu, W., Peng, B., et al.: User adaptation for online sketchy shape recognition. In: Lladós, J., Kwon, Y.-B. (eds.) GREC 2003. LNCS, vol. 3088, pp. 303–314. Springer, Heidelberg (2004)Google Scholar
  7. 7.
    Xu, X., Sun, Z., Peng, B., et al.: An online composite graphics recognition approach based on matching of spatial relation graphs. IJDAR 7(1), 44–55 (2004)Google Scholar
  8. 8.
    Shokoufandeh, A., Dickson, S., Siddiqi, K., Zucker, S.: Indexing using a spectral encoding of spatial structure. In: Proc. of the CVPR, pp. 491–497 (1999)Google Scholar
  9. 9.
    Rocchio, J.J.: Relevance feedback in information retrieval. In: The SMART Retrieval System, Experiments in Automatic Document Processing, pp. 313–323. Prentice Hall, Englewood Cliffs (1971)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Zhengxing Sun
    • 1
  • Bin Li
    • 1
  • Qiang Wang
    • 1
  • Guihuan Feng
    • 1
  1. 1.State Key Lab for Novel Software TechnologyNanjing UniversityP.R. China

Personalised recommendations