A Streaming Digital Ink Framework for Multi-party Collaboration

  • Rui Hu
  • Vadim Mazalov
  • Stephen M. Watt
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7362)


We present a framework for pen-based, multi-user, online collaboration in mathematical domains. This environment provides participants, who may be in the same room or across the planet, with a shared whiteboard and voice channel. The digital ink stream is transmitted as InkML, allowing special recognizers for different content types, such as mathematics and diagrams. Sessions may be recorded and stored for later playback, analysis or annotation. The framework is currently structured to use the popular Skype and Google Talk services for the communications channel, but other transport mechanisms could be used. The goal of the work is to support computer-enhanced distance collaboration, where domain-specific recognizers handle different kinds of digital ink input and editing. The first of these recognizers is for mathematics, which allows converting math input into machine-understandable format. This supports multi-party collaboration, with sessions recorded in rich formats that allow semantic analysis and manipulation of the content.


Pen computing distance collaboration mathematical handwriting recognition InkML Skype Google Talk 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gowers, T., Nielsen, M.: Massively Collaborative Mathematics. Nature 461, 879–881 (2009)CrossRefGoogle Scholar
  2. 2.
    Maplesoft Inc.: Maple user manualGoogle Scholar
  3. 3.
    Microsoft Inc.: Onenote (2010)Google Scholar
  4. 4.
    Iotum Inc.: Calliflower,
  5. 5.
    Dabbleboard Inc.: Dabbleboard,
  6. 6.
    Watt, S., Underhill, T.: Ink Markup Language (InkML),
  7. 7.
    Microsoft Inc.: Skype,
  8. 8.
    Google Inc.: Google Talk,
  9. 9.
    Regmi, A., Watt, S.M.: A Collaborative Interface for Multimodal Ink and Audio Documents. In: Proc. 10th International Conference on Document Analysis and Recognition, ICDAR 2009, pp. 901–905. IEEE Computer Society (2009)Google Scholar
  10. 10.
    Ning, H., Williams, J.R., Slocum, A.H., Sanchez, A.: InkBoard - Tablet PC Enabled Design oriented Learning. In: Proc. 7th IASTED International Conference on Computers and Advanced Technology in Education, CATE 2004, August 16-18, pp. 154–160. ACTA Press (2004)Google Scholar
  11. 11.
    Beavers, J., Chou, T., Hinrichs, R., Moffatt, C., Pahud, M., Powers, L., Eaton, J.V.: The Learning Experience Project: Enabling Collaborative Learning with ConferenceXP. Technical Report MSR-TR-2004-42, Microsoft Research (2004)Google Scholar
  12. 12.
  13. 13.
    Mazalov, V., Watt, S.M.: Writing on Clouds. In: Jeuring, J., et al. (eds.) CICM 2012. LNCS (LNAI), vol. 7362, pp. 401–415. Springer, Heidelberg (2012)Google Scholar
  14. 14.
    Golubitsky, O., Watt, S.M.: Distance-Based Classification of Handwritten Symbols. International J. on Document Analysis and Recognition 13(2), 113–146 (2010)Google Scholar
  15. 15.
    Mazalov, V., Watt, S.M.: Digital Ink Compression via Functional Approximation. In: Proc. 12th International Conference on Frontiers in Handwriting Recognition, ICFHR 2010, November 16-18, pp. 688–694. IEEE Computer Society (2010)Google Scholar
  16. 16.
    Mazalov, V., Watt, S.M.: Linear Compression of Digital Ink via Selection of Subsets of Points. In: Proc. 10th IAPR International Workshop on Document Analysis Systemsm, DAS 2012, March 27-29, pp. 429–434. IEEE Computer Society (2012)Google Scholar
  17. 17.
    Hu, R.: Portable Implementation of Digital Ink: Collaboration and Calligraphy. Master’s thesis, The University of Western Ontario, Canada (2009)Google Scholar
  18. 18.
    Watt, S.M.: On the Mathematics of Calligraphy (invited talk). In: International Conference on Mathematics Mechanization – In Honor of Professor Wen-Tsun Wu’s Ninetieth Birthday, Beijing, China (2009)Google Scholar
  19. 19.
    Burd, E., Overy, D., Wheetman, A.: Evaluating Using Animation to Improve Understanding of Sequence Diagrams. In: Proc. 10th International Workshop on Program Comprehension, IWPC 2002, p. 107. IEEE Computer Society (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Rui Hu
    • 1
  • Vadim Mazalov
    • 1
  • Stephen M. Watt
    • 1
  1. 1.The University of Western OntarioLondonCanada

Personalised recommendations