Supporting Collaborative Workflows of Digital Multimedia Annotation

  • Cristian HofmannEmail author
  • Dieter W. Fellner
Conference paper


Collaborative annotation techniques for digital multimedia contents have found their way into a vast amount of areas of daily use as well as professional fields. Attendant research has issued a large number of research projects that can be assigned to different specific subareas of annotation. These projects focus on one or only few aspects of digital annotation. However, the whole annotation process as a operative unit has not sufficiently been taken into consideration, especially for the case of collaborative settings. In order to attend to that lack of research, we present a framework that supports multiple collaborative workflows related to digital multimedia annotation. In that context, we introduce an process-based architecture model, a formalized specification of collaborative annotation processes, and a concept for personalized workflow visualization and user assistance.


Video Segment Annotation Process Work Item Global Controller Process Visualization 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Agosti, M., Bonfiglio-Dosio, G.,Ferro, N.: A historical and contemporary study on annotations to derive key features for systems design. Int. J. Digit. Libr. 8(1), 1–19 (2007)CrossRefGoogle Scholar
  2. 2.
    Agosti, M., Ferro, N.: A formal model of annotations of digital content. ACM Trans. Inf. Syst. 26(1), 3 (2007)CrossRefGoogle Scholar
  3. 3.
    Bertini, M., Bimbo, A. D., Nunziati, W.: Automatic Annotation of Sport Video Content. Alberto Sanfeliu, Manuel Lazo-Cortés (ed.): CIARP, Springer, 1066–1078 (2005)Google Scholar
  4. 4.
    Bertino, E., Trombetta, A., Montesi, D.: Workflow Architecture for Interactive Video Management Systems. Distrib. Parallel Databases 11(1), 33–51 (2002)zbMATHCrossRefGoogle Scholar
  5. 5.
    Bischoff, K., Firan, C. S., Paiu, R.: Deriving music theme annotations from user tags. WWW ’09: Proceedings of the 18th international conference on World wide web, ACM, New York, USA, 1193–1194 (2009)Google Scholar
  6. 6.
    Bobrik, R., Bauer, T.: Towards Configurable Process Visualizations with Proviado. WETICE, IEEE Computer Society, pp. 367–369 (2007)Google Scholar
  7. 7.
    Bobrik, R., Reichert, M., Bauer, T.: View-Based Process Visualization. Gustavo Alonso, Peter Dadam, Michael Rosemann, ed., BPM, Springer, pp. 88–95 (2007)Google Scholar
  8. 8.
    Bobrik, R., Reichert, M, Bauer, T.: Requirements for the Visualization of System-Spanning Business Processes. DEXA Workshops, IEEE Computer Society, pp. 948–954 (2005)Google Scholar
  9. 9.
    Brugman, H., Russel, A.: Annotating Multi-media/Multi-modal resources with ELAN. Proceedings of the 4th International Conference on Language Resources and Language Evaluation (LREC 2004), European Language Resources Association, Paris, pp. 2065–2068 (2004)Google Scholar
  10. 10.
    Cadiz, J. J., Gupta, A, Grudin, J.: Using Web annotations for asynchronous collaboration around documents. CSCW ’00: Proceedings of the 2000 ACM conference on Computer supported cooperative work, ACM, New York, USA, pp. 309–318 (2000)Google Scholar
  11. 11.
    Constantopoulos, P., Doerr, M., Theodoridou, M., Tzobanakis, M.: On Information Organization in Annotation Systems. Intuitive Human Interfaces for Organizing and Accessing Intellectual Assets, pp. 189–200 (2004)Google Scholar
  12. 12.
    Costa, M., Correia, N., Guimaraes, N.: Annotations as multiple perspectives of video content. MULTIMEDIA ’02: Proceedings of the tenth ACM international conference on Multimedia, ACM, New York, USA, pp. 283–286 (2002)Google Scholar
  13. 13.
    Finke, M.: Unterstuetzung des kooperativen Wissenserwerbs durch Hypervideo-Inhalte. Universitäts- und Landesbibliothek Darmstadt (2005)Google Scholar
  14. 14.
    Frommholz, I., Brocks, H., Thiel, U., Neuhold, E. J., Iannone, L., Semeraro, G., Berardi, M., Ceci, M.: Document-Centered Collaboration for Scholars in the Humanities – The COLLATE System. ECDL ’03, Springer, pp. 434–445 (2003)Google Scholar
  15. 15.
    Gamma, E., Helm, R., Johnson, R., Vlissides, J.: Design Patterns. Elements of Reusable Object-Oriented Software, Addison-Wesley, Reading, MA (1995)Google Scholar
  16. 16.
    Gogouvitis, S. V., Kousiouris, G., Konstanteli, K., Polychniatis, T., Menychtas, A., Kyriazis, D., Varvarigou, T.: Realtime-enabled workflow management in service oriented infrastructures. AREA ’08: Proceeding of the 1st ACM workshop on Analysis and retrieval of events/actions and workflows in video streams, ACM, New York, USA, pp. 119–124 (2008)Google Scholar
  17. 17.
    Hagedorn, J., Hailpern, J., Karahalios, K. G.: VCode and VData: illustrating a new framework for supporting the video annotation workflow. AVI ’08: Proceedings of the working conference on Advanced visual interfaces’, ACM, New York, USA, pp. 317–321 (2008)Google Scholar
  18. 18.
    Halasz, F. G., Schwartz, M.: The Dexter Hypertext Reference Model. Communications of the ACM 37(2), 30–39 (1994)CrossRefGoogle Scholar
  19. 19.
    Havemann, S., Fellner, D. W.: Seven Research Challenges of Generalized 3D Documents. IEEE Comput. Graph. Appl. 27(3), 70–76 (2007)CrossRefGoogle Scholar
  20. 20.
    Hofmann, C., Hollender, N., Fellner, D. W.: Workflow-Based Architecture for Collaborative Video Annotation. A. Ant Ozok, Panayiotis Zaphiris (ed.), HCI (12), Springer, The Netherlands, pp. 33–42 (2009)Google Scholar
  21. 21.
    Hofmann, C., Hollender, N., Fellner, D. W.: A WORKFLOW MODEL FOR COLLABORATIVE VIDEO ANNOTATION – Supporting the Workflow of Collaborative Video Annotation and Analysis performed in Educational Settings. Proceedings of the International Conference on Computer Supported Education (CSEDU 09), INSTICC Press, Lissabon, Portugal, pp. 199–204 (2009)Google Scholar
  22. 22.
    Hollender, N., Hofmann, C., Deneke, M.: Principles to reduce extraneous load in web-based generative learning settings. Workshop on Cognition and the Web 2008, pp. 7–14 (2008)Google Scholar
  23. 23.
    Kadobayashi, R., Lombardi, J., McCahill, M. P., Stearns, H., Tanaka, K., Kay, A.: Annotation authoring in collaborative 3D virtual environments. ICAT ’05: Proceedings of the 2005 international conference on Augmented tele-existence, ACM, New York, USA, pp. 255–256 (2005)Google Scholar
  24. 24.
    Leoni, M.; Aalst, W. M. & Hofstede, A. H.: Visual Support for Work Assignment in Process-Aware Information Systems. BPM ’08: Proceedings of the 6th International Conference on Business Process Management, Springer-Verlag, Berlin, Heidelberg, pp. 67–83 (2008)Google Scholar
  25. 25.
    Lin, C.Y., Tseng, B. L., Smith, J. R.: Video collaborative annotation forum: Establishing ground-truth labels on large multimedia datasets. Proceedings of the TRECVID 2003 Workshop (2003)Google Scholar
  26. 26.
    Marshall, C. C.: Toward an ecology of hypertext annotation. HYPERTEXT ’98: Proceedings of the ninth ACM conference on Hypertext and hypermedia: links, objects, time and space—structure in hypermedia systems, ACM, New York, USA, pp. 40–49 (1998)Google Scholar
  27. 27.
    Marshall, C. C., Brush, A. J. B.: Exploring the relationship between personal and public annotations. JCDL ’04: Proceedings of the 4th ACM/IEEE-CS joint conference on Digital libraries, ACM, New York, USA, pp. 349–357 (2004)Google Scholar
  28. 28.
    Marshall, C. C., Ruotolo, C.: Reading-in-the-small: a study of reading on small form factor devices. JCDL ’02: Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries, ACM, New York, USA, pp. 56–64 (2002)Google Scholar
  29. 29.
    Mikova, M., Janik, T.: Analysis of elements supporting health in physical education: Methodological approach of video study. Janík T. Wagner R. Mužík, V., ed.,’Mužík, V., Janík, T., Wagner, R. (ed.) Neue Herausforderungen im Gesundheitsbereich an der Schule. Was kann der Sportunterricht dazu beitragen?, MU, Brno, pp. 248–260 (2006)Google Scholar
  30. 30.
    Pea, R.,Hoffert, E.: Video Research in the Learning Sciences. Goldman, R., Pea, R., Barron, B., Derry, S.J. (ed.) Video workflow in the learning sciences: Prospects of emerging technologies for augmenting work practices. Lawrence Erlbaum, London, pp. 427–460 (2007)Google Scholar
  31. 31.
    Pea, R., Mills, M., Rosen, J., Dauber, K., Effelsberg, W., Hoffert, E. The Diver Project: Interactive Digital Video Repurposing. IEEE MultiMedia 11(1), 54–61 (2004)CrossRefGoogle Scholar
  32. 32.
    Reif, G.: Semantische Annotation. Semantic Web - Wege zur vernetzten Wissensgesellschaft 5(4), 405–418 (2006)MathSciNetGoogle Scholar
  33. 33.
    Richter, K., Finke, M., Hofmann, C., Balfanz, D.: Hypervideo. Pagani, M. (ed.) Encyclopedia of Multimedia Technology and Networking, 2nd ed., Idea Group Pub., USA, pp. 641–647 (2009)Google Scholar
  34. 34.
    Schaetzle, R.: Workflow-Management – ein ereignisbasierter Ansatz. PhD thesis, Universitat Karlsruhe (TH) (2000)Google Scholar
  35. 35.
    Seidel, T., Prenzel, M., Kobarg, M. (Eds.): How to run a video study. Technical report of the IPN Video Study. Waxmann, Münster (2005)Google Scholar
  36. 36.
    Sesink, W., Goeller, S., Roeßling, G., Hofmann, D.: emargo: Eine Digitale Randspalte zum Selbststudium (nicht nur) der Informatik. Proceedings der Pre-Conference Workshops der 5. e-Learning Fachtagung Informatik (DeLFI 2007), Logos Verlag, Berlin, pp. 101–108 (2007)Google Scholar
  37. 37.
    Sliski, T. J., Billmers, M. P., Clarke, L. A., Osterweil, L. J.: An architecture for flexible, evolvable process-driven user-guidance environments, SIGSOFT Softw. Eng. Notes 26(5), 33–43 (2001)CrossRefGoogle Scholar
  38. 38.
    Stahl, E., Finke, M., Zahn, C.: Knowledge Acquisition by Hypervideo Design: An Instructional Program for University Courses. Journal of Educational Multimedia and Hypermedia 15(3), 285–302 (2006)Google Scholar
  39. 39.
    Streit, A., Pham, B., Brown, R.: Visualization Support for Managing Large Business Process Specifications. Business Process Management, 3649, 205–219 (2005)CrossRefGoogle Scholar
  40. 40.
    Volkmer, T., Smith, J. R., Natsev, A.: A web-based system for collaborative annotation of large image and video collections: an evaluation and user study. MULTIMEDIA ’05: Proceedings of the 13th annual ACM international conference on Multimedia, ACM, New York, USA, pp. 892–901 (2005)Google Scholar
  41. 41.
    Wang, M., Zhou, X., Chua, T.-S.: Automatic image annotation via local multi-label classification. CIVR ’08: Proceedings of the 2008 international conference on Content-based image and video retrieval, ACM, New York, USA, pp. 17–26 (2008)Google Scholar
  42. 42.
    Workflow Management Coalition Terminology & Glossary. Document Number WFMC-TC-1011, Issues 3.0, Technical report (1999)Google Scholar
  43. 43.
    Zheng, Q., Booth, K., McGrenere, J.: Co-authoring with structured annotations. CHI ’06: Proceedings of the SIGCHI conference on Human Factors in computing systems, ACM, New York, USA, pp. 131–140 (2006)Google Scholar

Copyright information

© Springer London 2010

Authors and Affiliations

  1. 1.Interactive Graphics Systems GroupFraunhofer Institute for Computer Graphics Research/TU DarmstadtDarmstadtGermany

Personalised recommendations