Ubiquitous Interactive Video Editing Via Multimodal Annotations

  • Maria da Graça C. Pimentel
  • Rudinei Goularte
  • Renan G. Cattelan
  • Felipe S. Santos
  • Cesar Teixeira
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5066)


Considering that, when users watch a video with someone else, they are used to make comments regarding its contents – such as a comment with respect to someone appearing in the video – in previous work we exploited ubiquitous computing concepts to propose the watching-and-commenting authoring paradigm in which a user’s comments are automatically captured so as to automatically generate a corresponding annotated interactive video. In this paper we revisit and extend our previous work and detail our prototype that supports the watching-and-editing paradigm, discussing how a ubiquitous computing platform may explore digital ink and associated gestures to support the authoring of multimedia content while enhancing the social aspects of video watching.


Ubiquitous Computing Multimedia Content Interactive Video Authoring Tool Multimedia Document 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Abowd, G., Mynatt, E., Rodden, T.: The human experience. IEEE Pervasive Computing 1(1), 48–57 (2002)CrossRefGoogle Scholar
  2. 2.
    Abowd, G.: Classroom 2000: An experiment with the instrumentation of a living educational environment. IBM Systems Journal 38(4), 508–530 (1999)Google Scholar
  3. 3.
    Abowd, G., Gauger, M., Lachenmann, A.: The family video archive: an annotation and browsing environment for home movies. In: Proc. ACM SIGMM Intl. Work. Multimedia Information Retrieval, pp. 1–8 (2003)Google Scholar
  4. 4.
    Bulterman, D.: Using SMIL to encode interactive, peer-level multimedia annotations. In: ACM DOCENG 2003, pp. 32–41 (2003)Google Scholar
  5. 5.
    Bulterman, D., César, P., Jansen, A.: An architecture for viewer-side enrichment of tv content. In: ACM MULTIMEDIA 2006, pp. 651–654 (2006)Google Scholar
  6. 6.
    Butkus, A., Petersen, M.: Semantic modelling using tv-anytime genre metadata. In: Cesar, P., Chorianopoulos, K., Jensen, J.F. (eds.) EuroITV 2007. LNCS, vol. 4471, pp. 226–234. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  7. 7.
    César, P., Bulterman, D., Jansen, A.: The ambulant annotator: empowering viewer-side enrichment of multimedia content. In: ACM DOCENG 2006, pp. 186–187 (2006)Google Scholar
  8. 8.
    César, P., Bulterman, D., Obrenovic, Z., Ducret, J., Cruz-Lara, S.: An architecture for non-intrusive user interfaces for interactive digital television. In: Cesar, P., Chorianopoulos, K., Jensen, J.F. (eds.) EuroITV 2007. LNCS, vol. 4471, pp. 11–20. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  9. 9.
    Costa, R., Moreno, M., Rodrigues, R., Soares, L.: Live editing of hypermedia documents. In: ACM DOCENG 2006, pp. 165–172 (2006)Google Scholar
  10. 10.
    Van den Ende, N., de Hesselle, H., Meesters, L.: Towards content-aware coding: User study. In: Cesar, P., Chorianopoulos, K., Jensen, J.F. (eds.) EuroITV 2007. LNCS, vol. 4471, pp. 185–194. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  11. 11.
    Girgensohn, A., Boreczky, J., Chiu, P., Doherty, J., Foote, J., Golovchinsky, G., Uchihashi, S., Wilcox, L.: A semi-automatic approach to home video editing. In: ACM UIST 2000, pp. 81–89 (2000)Google Scholar
  12. 12.
    Goularte, R., Cattelan, R., Camacho-Guerrero, J., Inácio, V., Pimentel, M.: Interactive multimedia annotations: enriching and extending content. In: ACM DOCENG 2004, pp. 84–86 (2004)Google Scholar
  13. 13.
    Hemmeryckx-Deleersnijder, B., Thorne, J.: Awareness and conversational context sharing to enrich tv based communication. In: Cesar, P., Chorianopoulos, K., Jensen, J.F. (eds.) EuroITV 2007. LNCS, vol. 4471, pp. 1–10. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  14. 14.
    Hua, X.-S., Li, S.: Interactive video authoring and sharing based on two-layer templates. In: HCM 2006: Proc. ACM Intl. Work. Human-centered Multimedia, pp. 65–74 (2006)Google Scholar
  15. 15.
    Hua, X.-S., Lu, L., Zhang, H.-J.: P-karaoke: personalized karaoke system. In: ACM MULTIMEDIA 2004, pp. 172–173 (2004)Google Scholar
  16. 16.
    Kirk, D., Sellen, A., Harper, R., Wood, K.: Understanding videowork. In: ACM CHI 2007, pp. 61–70 (2007)Google Scholar
  17. 17.
    Liu, K.-Y., Chen, H.-Y.: Exploring media correlation and synchronization for navigated hypermedia documents. In: ACM MULTIMEDIA 2005, pp. 61–70 (2005)Google Scholar
  18. 18.
    Madhwacharyula, C., Davis, M., Mulhem, P., Kankanhalli, M.: Metadata handling: A video perspective. ACM TOMCCAP 2(4), 358–388 (2006)CrossRefGoogle Scholar
  19. 19.
    Olsen, D., Taufer, T., Fails, J.: Screencrayons: annotating anything. In: ACM UIST 2004, pp. 165–174 (2004)Google Scholar
  20. 20.
    Pimentel, M., Baldochi, L., Cattelan, R.: Prototyping applications to document human experiences. IEEE Pervasive Computing 6(2), 93–100 (2007)CrossRefGoogle Scholar
  21. 21.
    Pimentel, M., Goularte, R., Cattelan, R., Santos, F., Teixeira, C.: Enhancing multimodal annotations with pen-based information. In: Workshop on New Techniques for Consuming, Managing, and Manipulating Interactive Digital Media at Home, pp. 207–213 (2007)Google Scholar
  22. 22.
    Pimentel, M., Prazeres, C., Ribas, H., Lobato, D., Teixeira, C.: Documenting the pen-based interaction. In: Brazilian WebMedia 2005, pp. 1–8 (2005)Google Scholar
  23. 23.
    Truong, B., Venkatesh, S.: Video abstraction: A systematic review and classification. ACM TOMCCAP 3(1), Article 3, 37 pages (2007)Google Scholar
  24. 24.
    Ullmer, B., Ishii, H., Glas, D.: mediablocks: physical containers, transports, and controls for online media. In: ACM SIGGRAPH 1998, pp. 379–386 (1998)Google Scholar
  25. 25.
    Ursu, M., Cook, J., Zsombori, V., Zimmer, R., Kegel, I., Williams, D., Thomas, M., Wyver, J., Mayer, H.: Conceiving shapeshifting tv: A computational language for truly-interactive tv. In: Cesar, P., Chorianopoulos, K., Jensen, J.F. (eds.) EuroITV 2007. LNCS, vol. 4471, pp. 96–106. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  26. 26.
    Weiser, M.: The computer for the 21st century. Scientific American 265(3), 94–104 (1991)CrossRefGoogle Scholar
  27. 27.
    Zigelbaum, J., Horn, M., Shaer, O., Jacob, R.: The tangible video editor: collaborative video editing with active tokens. In: TEI 2007: Proc. Intl. Conference on Tangible and Embedded Interaction, pp. 43–46 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Maria da Graça C. Pimentel
    • 1
  • Rudinei Goularte
    • 1
  • Renan G. Cattelan
    • 1
  • Felipe S. Santos
    • 1
  • Cesar Teixeira
    • 2
  1. 1.Universidade de São PauloBrazil
  2. 2.Universidade Federal de São CarlosBrazil

Personalised recommendations