U-Note: Capture the Class and Access It Everywhere

  • Sylvain Malacria
  • Thomas Pietrzak
  • Aurélien Tabard
  • Éric Lecolinet
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6946)


We present U-Note, an augmented teaching and learning system leveraging the advantages of paper while letting teachers and pupils benefit from the richness that digital media can bring to a lecture. U-Note provides automatic linking between the notes of the pupils’ notebooks and various events that occurred during the class (such as opening digital documents, changing slides, writing text on an interactive whiteboard...). Pupils can thus explore their notes in conjunction with the digital documents that were presented by the teacher during the lesson. Additionally, they can also listen to what the teacher was saying when a given note was written. Finally, they can add their own comments and documents to their notebooks to extend their lecture notes.We interviewed teachers and deployed questionnaires to identify both teachers and pupils’ habits: most of the teachers use (or would like to use) digital documents in their lectures but have problems in sharing these resources with their pupils. The results of this study also show that paper remains the primary medium used for knowledge keeping, sharing and editing by the pupils.Based on these observations, we designed U-Note, which is built on three modules. U-Teach captures the context of the class: audio recordings, the whiteboard contents, together with the web pages, videos and slideshows displayed during the lesson. U-Study binds pupils’ paper notes (taken with an Anoto digital pen) with the data coming from U-Teach and lets pupils access the class materials at home, through their notebooks. U-Move lets pupils browse lecture materials on their smartphone when they are not in front of a computer.


Augmented classroom digital pen digital lecturing environment capture and access digital classroom 


  1. 1.
    Abowd, G.D.: Classroom 2000: an experiment with the instrumentation of a living educational environment. IBM Systems Journal, 508–530 (1999) Google Scholar
  2. 2.
    Anoto technology,
  3. 3.
    Brandl, P., Richter, C., Haller, M.: Nicebook: supporting natural note taking. In: Proc. CHI 2010, pp. 599–608. ACM, New York (2010)Google Scholar
  4. 4.
    Brotherton, J.A., Abowd, G.D.: Lessons learned from eclass: Assessing automated capture and access in the classroom. ACM Trans. on Comp.-Hum. Interact., 121–155 (2004) Google Scholar
  5. 5.
    Jqtouch plugin,
  6. 6.
    Jquery library,
  7. 7.
    Kiewra, K.A.: Note taking and review: the research and its implications. Journal of Instructional Science, 233–249 (1987)Google Scholar
  8. 8.
    Kong, C.K., Muppala, J.K.: ReCap: a tool for automated capture and generation of synchronized audio, PowerPoint and digital ink presentation. In: Proc. CATE 2007 (2007) Google Scholar
  9. 9.
    Livesribe digital pens,
  10. 10.
    Miura, M., Kunifuji, S., Sakamoto, Y.: Airtransnote: An instant note sharing and reproducing system to support students learning. In: Proc. ICALT 2007, pp. 175–179. IEEE Computer Society, Los Alamitos (2007)Google Scholar
  11. 11.
    Miura, M., Kunifuji, S., Shizuki, B., Tanaka, J.: Augmented classroom: A paper-centric approach for collaborative learning system. In: Murakami, H., Nakashima, H., Tokuda, H., Yasumura, M. (eds.) UCS 2004. LNCS, vol. 3598, pp. 104–116. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  12. 12.
    Mühlhäuser, M., Trompler, C.: Digital lecture halls keep teachers in the mood and learners in the loop. In: E-Learn, Montreal, Canada, pp. 714–721 (October 2002) Google Scholar
  13. 13.
    Oviatt, S., Arthur, A., Cohen, J.: Quiet interfaces that help students think. In: Proc. UIST 2006, pp. 191–200. ACM, New York (2006)CrossRefGoogle Scholar
  14. 14.
    Rössling, G., Trompler, C., Mühlhäuser, M., Köbler, S., Wolf, S.: Enhancing classroom lectures with digital sliding blackboards. SIGCSE Bull., 218–222 (2004) Google Scholar
  15. 15.
    Sellen, A.J., Harper, R.H.: The Myth of the Paperless Office. MIT Press, Cambridge (2003)Google Scholar
  16. 16.
    Steimle, J., Brdiczka, O., Mühlhäuser, M.: Coscribe: Using paper for collaborative annotations in lectures. In: Proc. ICALT 2008, pp. 306–310. IEEE Computer Society, Los Alamitos (2008)Google Scholar
  17. 17.
    Stifelman, L., Arons, B., Schmandt, C.: The audio notebook: paper and pen interaction with structured speech. In: Proc. CHI 2001, pp. 182–189. ACM, New York (2001)Google Scholar
  18. 18.
    Tabard, A., Mackay, W.E., Eastmond, E.: From individual to collaborative: the evolution of prism, a hybrid laboratory notebook. In: Proc. CSCW 2008, pp. 569–578. ACM, New York (2008)CrossRefGoogle Scholar
  19. 19.
    Truong, K.N., Abowd, G.D., Brotherton, J.A.: Personalizing the capture of public experiences. In: Proc. UIST 1999, pp. 121–130. ACM, New York (1999)CrossRefGoogle Scholar
  20. 20.
    West, D., Quigley, A., Kay, J.: Memento: a digital-physical scrapbook for memory sharing. Personal Ubiquitous Computing, 313–328 (2007) Google Scholar
  21. 21.
    Whittaker, S., Tucker, S., Swampillai, K., Laban, R.: Design and evaluation of systems to support interaction capture and retrieval. Personal and Ubiquitous Computing 12 (2008) Google Scholar
  22. 22.
    Wilkerson, M., Griswold, W.G., Simon, B.: Ubiquitous presenter: increasing student access and control in a digital lecturing environment. In: SIGCSE 2005, pp. 116–120. ACM, New York (2005)CrossRefGoogle Scholar
  23. 23.
    Yeh, R., Liao, C., Klemmer, S., Guimbretière, F., Lee, B., Kakaradov, B., Stamberger, J., Paepcke, A.: Butterflynet: a mobile capture and access system for field biology research. In: Proc. CHI 2006, pp. 571–580. ACM, New York (2006)Google Scholar
  24. 24.
    Yeh, R., Paepcke, A., Klemmer, S.: Iterative design and evaluation of an event architecture for pen-and-paper interfaces. In: Proc. UIST 2008, pp. 111–120. ACM, New York (2008)CrossRefGoogle Scholar
  25. 25.
    Zip file containing questionnaires,

Copyright information

© IFIP International Federation for Information Processing 2011

Authors and Affiliations

  • Sylvain Malacria
    • 1
  • Thomas Pietrzak
    • 1
    • 2
  • Aurélien Tabard
    • 1
    • 3
  • Éric Lecolinet
    • 1
  1. 1.Telecom ParisTech – CNRS LTCI UMR 5141ParisFrance
  2. 2.University of TorontoTorontoCanada
  3. 3.IT University of CopenhagenCopenhagenDenmark

Personalised recommendations