Digital Annotations: a Formal Model and its Applications

  • Nicola Ferro

Abstract

We discuss various issues and viewpoints concerning the annotation of digital contents, such as textual documents, images, and multimedia documents in general. The discussion shows how fragmentary the picture is about the annotation and how its definition changes according to the different applicative contexts in which it is used. Therefore, we propose a formal model of the annotation which provides us with a unified and integrated picture on the annotation which takes into account the different viewpoints and uses of it. Finally, we present various possible application areas of the proposed formal model and we introduce the next steps we can undertake by using it as a starting point

Keywords

annotation digital content foundations hypertext information management system 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Abiteboul, S., Agrawal, R., Bernstein, P., Carey, M., Ceri, S., Croft, B., DeWitt, D., Franklin, M., Garcia-Molina, H., Gawlick, D., Gray, J., Haas, L., Halevy, A., Hellerstein, J., Ioannidis, Y., Kersten, M., Pazzani, M., Lesk, M., Maier, D., Naughton, J., Schek, H.J., Sellis, T., Silberschatz, A., Stonebraker, M., Snodgrass, R., Ullman, J.D., Weikum, G., Widom, J., Zdonik, S.: The Lowell Database Research Self-Assessment. Communications of the ACM (CACM) 48(5), 111–118 (2005)CrossRefGoogle Scholar
  2. 2.
    Agosti, M., Albrechtsen, H., Ferro, N., Frommholz, I., Hansen, P., Orio, N., Panizzi, E., Pejtersen, A.M., Thiel, U.: DiLAS: a Digital Library Annotation Service. In: J.F. Boujut (ed.) Proc. International Workshop on Annotation for Collaboration – Methods, Tools, and Practices (IWAC 2005), pp. 91–101. CNRS - Programme sociètè de l’information (2005)Google Scholar
  3. 3.
    Agosti, M., Benfante, L., Orio, N.: IPSA: A Digital Archive of Herbals to Support Scientific Research. In: T.M.T. Sembok, H.B. Zaman, H. Chen, S.R. Urs, S.H. Myaeng (eds.) Proc. 6th International Conference on Asian Digital Libraries – Digital Libraries: Technology and Management of Indigenous Knowledge (ICADL 2003), pp. 253–264. Lecture Notes in Computer Science (LNCS) 2911, Springer, Heidelberg, Germany (2003)Google Scholar
  4. 4.
    Agosti, M., Berretti, S., Brettlecker, G., del Bimbo, A., Ferro, N., Fuhr, N., Keim, D., Klas, C.P., Lidy, T., Norrie, M., Ranaldi, P., Rauber, A., Schek, H.J., Schreck, T., Schuldt, H., Signer, B., Springmann, M.: DelosDLMS – the Integrated DELOS Digital Library Management System. In: C. Thanos, F. Borri (eds.) DELOS Conference 2007 Working Notes, pp. 71–80. ISTI-CNR, Gruppo ALI, Pisa, Italy (2007)Google Scholar
  5. 5.
    Agosti, M., Bonfiglio-Dosio, G., Ferro, N.: A Historical and Contemporary Study on Annotations to Derive Key Features for Systems Design. International Journal on Digital Libraries http://dx.doi.org/10.1007/s00799-007-0010-0 (2007)Google Scholar
  6. 6.
    Agosti, M., Colotti, R., Gradenigo, G.: A Two-Level Hypertext Retrieval Model for Legal Data. In: E.A. Fox (ed.) Proc. 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1991), pp. 316–325. ACM Press, New York, USA (1991)CrossRefGoogle Scholar
  7. 7.
    Agosti, M., Coppotelli, T., Ferro, N., Pretto, L.: Exploiting Relevance Assessment for the Creation of an Experimental Test Collection to Evaluate Systems that Use Annotations. In: C. Thanos, F. Borri (eds.) DELOS Conference 2007 Working Notes, pp. 195–202. ISTI-CNR, Gruppo ALI, Pisa, Italy (2007)Google Scholar
  8. 8.
    Agosti, M., Ferro, N.: Annotations: Enriching a Digital Library. In: T. Koch, I.T. Sølvberg (eds.) Proc. 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003), pp. 88–100. Lecture Notes in Computer Science (LNCS) 2769, Springer, Heidelberg, Germany (2003)Google Scholar
  9. 9.
    Agosti, M., Ferro, N.: An Information Service Architecture for Annotations. In: M. Agosti, H.J. Schek, C. Türker (eds.) Digital Library Architectures: Peer-to-Peer, Grid, and Service-Orientation, Pre-proceedings of the 6th Thematic Workshop of the EU Network of Excellence DELOS, pp. 115–126. Edizioni Libreria Progetto, Padova, Italy (2004)Google Scholar
  10. 10.
    Agosti, M., Ferro, N.: A System Architecture as a Support to a Flexible Annotation Service. In: C. Türker, M. Agosti, H.J. Schek (eds.) Peer-to-Peer, Grid, and Service-Orientation in Digital Library Architectures: 6th Thematic Workshop of the EU Network of Excellence DELOS. Revised Selected Papers, pp. 147–166. Lecture Notes in Computer Science (LNCS) 3664, Springer, Heidelberg, Germany (2005)Google Scholar
  11. 11.
    Agosti, M., Ferro, N.: Annotations as Context for Searching Documents. In: F. Crestani, I. Ruthven (eds.) Proc. 5th International Conference on Conceptions of Library and Information Science – Context: nature, impact and role, pp. 155–170. Lecture Notes in Computer Science (LNCS) 3507, Springer, Heidelberg, Germany (2005)Google Scholar
  12. 12.
    Agosti, M., Ferro, N.: Search Strategies for Finding Annotations and Annotated Documents: the FAST Service. In: H. Legind Larsen, G. Pasi, D. Ortiz-Arroyo, T. Andreasen, H. Christiansen (eds.) Proc. 7th International Conference on Flexible Query Answering Systems (FQAS 2006), pp. 270–281. Lecture Notes in Artificial Intelligence (LNAI) 4027, Springer, Heidelberg, Germany (2006)CrossRefGoogle Scholar
  13. 13.
    Agosti, M., Ferro, N.: A Formal Model of Annotations of Digital Content. ACM Transactions on Information Systems (TOIS) 26(1), 1–55 (2008 (to appear))Google Scholar
  14. 14.
    Agosti, M., Ferro, N., Frommholz, I., Panizzi, E., Putz, W., Thiel, U.: Integration of the DiLAS Annotation Service into Digital Library Infrastructures. In: A. Blandford, J. Gow (eds.) Proc. 1st International Workshop on Digital Libraries in the Context of Users’ Broader Activities (DL-CUBA 2006), pp. 1–4. http://www.uclic.ucl.ac.uk/events/dl-cuba2006/ [last visited 2007, March 23] (2006)Google Scholar
  15. 15.
    Agosti, M., Ferro, N., Frommholz, I., Thiel, U.: Annotations in Digital Libraries and Collaboratories – Facets, Models and Usage. In: R. Heery, L. Lyon (eds.) Proc. 8th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2004), pp. 244–255. Lecture Notes in Computer Science (LNCS) 3232, Springer, Heidelberg, Germany (2004)Google Scholar
  16. 16.
    Agosti, M., Ferro, N., Orio, N.: Annotating Illuminated Manuscripts: an Effective Tool for Research and Education. In: M. Marlino, T. Sumner, F. Shipman (eds.) Proc. 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), pp. 121–130. ACM Press, New York, USA (2005)CrossRefGoogle Scholar
  17. 17.
    Agosti, M., Ferro, N., Orio, N.: Graph-based Automatic Suggestion of Relationships among Images of Illuminated Manuscripts. In: H.M. Haddad, K.M. Liebrock, R. Chbeir, M.J. Palakal, S. Ossowski, K. Yetongnoon, R.L. Wainwright, C. Nicolle (eds.) Proc. 21st ACM Symposium on Applied Computing (SAC 2006), pp. 1063–1067. ACM Press, New York, USA (2006)CrossRefGoogle Scholar
  18. 18.
    Agosti, M., Ferro, N., Orio, N.: Annotations as a Tool for Disclosing Hidden Relationships between Illuminated Manuscripts. In: Proc. 10th Congress of the Italian Association for Artificial Intelligence. Artificial Intelligence and Human-Oriented Computing (AI*IA 2007). Lecture Notes in Computer Science (LNCS), Springer, Heidelberg, Germany (2007)Google Scholar
  19. 19.
    Agosti, M., Ferro, N., Panizzi, E., Trinchese, R.: Annotation as a Support to User Interaction for Content Enhancement in Digital Libraries. In: A. Celentano, P. Mussio (eds.) Proc. Working Conference on Advanced Visual Interfaces (AVI 2006), pp. 151–154. ACM Press, New York, USA (2006)CrossRefGoogle Scholar
  20. 20.
    Agosti, M., Smeaton, A. (eds.): Information Retrieval and Hypertext. Kluwer Academic Publishers, Norwell (MA), USA (1996)Google Scholar
  21. 21.
    Berners-Lee, T.: Universal Resource Identifiers in WWW. RFC 1630 (1994)Google Scholar
  22. 22.
    Berners-Lee, T., Fielding, R., Irvine, U.C., Masinter, L.: Uniform Resource Identifiers (URI): Generic Syntax. RFC 2396 (1998)Google Scholar
  23. 23.
    Bhagwat, D., Chiticariu, L., Tan, W.C., Vijayvargiya, G.: An Annotation Management System for Relational Databases. In: M.A. Nascimento, M.T. Özsu, D. Kossmann, R.J. Miller, J.A. Blakeley, K.B. Schiefer (eds.) Proc. 30th International Conference on Very Large Data Bases (VLDB 2004), pp. 900–911. Morgan Kaufmann (2004)Google Scholar
  24. 24.
    Bottoni, P., Civica, R., Levialdi, S., Orso, L., Panizzi, E., Trinchese, R.: MADCOW: a Multimedia Digital Annotation System. In: M.F. Costabile (ed.) Proc. Working Conference on Advanced Visual Interfaces (AVI 2004), pp. 55–62. ACM Press, New York, USA (2004)CrossRefGoogle Scholar
  25. 25.
    Bottoni, P., Levialdi, S., Rizzo, P.: An Analysis and Case Study of Digital Annotation. In: N. Bianchi-Berthouze (ed.) Proc. 3rd International Workshop on Databases in Networked Information Systems (DNIS 2003), pp. 216–230. Lecture Notes in Computer Science (LNCS) 2822, Springer, Heidelberg, Germany (2003)Google Scholar
  26. 26.
    Buneman, P., Khanna, S., Tajima, K., Tan, W.C.: Archiving Scientific Data. ACM Transactions on Database Systems (TODS) 29(1), 2–42 (2004)CrossRefGoogle Scholar
  27. 27.
    Buneman, P., Khanna, S., Tan, W.C.: Why and Where: A Characterization of Data Provenance. In: J. Van den Bussche, V. Vianu (eds.) Proc. 8th International Conference on Database Theory (ICDT 2001), pp. 316–330. Lecture Notes in Computer Science (LNCS) 1973, Springer, Heidelberg, Germany (2001)Google Scholar
  28. 28.
    Buneman, P., Khanna, S., Tan, W.C.: On Propagation of Deletions and Annotations Through Views. In: S. Abiteboul, P.G. Kolaitis, L. Popa (eds.) Proc. 21st ACM SIGMOD–SIGACT–SIGART Symposium on Principles of Database Systems (PODS 2002), pp. 150–158. ACM Press, New York, USA (2002)Google Scholar
  29. 29.
    Canova, M.G.: La tradizione europea degli erbari miniati e la scuola veneta. In: Di sana pianta. Erbari e taccuini di sanità: le radici storiche della nuova farmacologia, pp. 21–28. Panini, Modena, Italy (1988)Google Scholar
  30. 30.
    Cleverdon, C.W.: The Cranfield Tests on Index Languages Devices. In: K. Spärck Jones, P. Willett (eds.) Readings in Information Retrieval, pp. 47–60. Morgan Kaufmann Publisher, Inc., San Francisco, California, USA (1997)Google Scholar
  31. 31.
    Constantopoulos, P., Doerr, M., Theodoridou, M., Tzobanakis, M.: On Information Organization in Annotation Systems. In: G. Grieser, Y. Tanaka (eds.) Proc. International Workshop on Intuitive Human Interfaces for Organizing and Accessing Intellectual Assets, pp. 189–200. Lecture Notes in Computer Science (LNCS) 3359, Springer, Heidelberg, Germany (2004)Google Scholar
  32. 32.
    Davis, J.R., Huttenlocher, D.P.: Shared Annotation for Cooperative Learning. In: J.L. Schnase, E.L. Cunnius (eds.) Proc. 1st International Conference on Computer Support for Collaborative Learning (CSCL 1995), pp. 84–88. Lawrence Erlbaum Associates Inc., Mahwah (NJ), USA (1995)Google Scholar
  33. 33.
    Ferro, N.: Formal Model and Conceptual Architecture of the Annotation Service for Dynamic Ubiquitous Knowledge Environments. PhD thesis, Department of Information Engineering. University of Padua, Italy (2004)Google Scholar
  34. 34.
    Frommholz, I., Brocks, H., Thiel, U., Neuhold, E., Iannone, L., Semeraro, G., Berardi, M., Ceci, M.: Document-Centered Collaboration for Scholars in the Humanities – The COLLATE System. In: T. Koch, I.T. Sølvberg (eds.) Proc. 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003), pp. 434–445. Lecture Notes in Computer Science (LNCS) 2769, Springer, Heidelberg, Germany (2003)Google Scholar
  35. 35.
    Frommholz, I., Fuhr, N.: Probabilistic, Object-oriented Logics for Annotation-based Retrieval in Digital Libraries. In: G. Marchionini, M.L. Nelson, C.C. Marshall (eds.) Proc. 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2006), pp. 55–64. ACM Press, New York, USA (2006)CrossRefGoogle Scholar
  36. 36.
    Giovè Marchioli, N.: Gli strumenti del sapere. I manoscritti padovani tra tipizzazioni generali e peculiarità locali. In: F. Piovan, L. Sitran Rea (eds.) Studenti, Università, città nella storia padovana. Atti del convegno (Padova, 6-8 febbraio 1998), pp. 47–71. Centro per la storia dell’Università di Padova. Contributi, 35, Lint, Trieste, Italia (2001)Google Scholar
  37. 37.
    Golder, S., Huberman, B.A.: Usage Patterns of Collaborative Tagging Systems. Journal of Information Science 32(2), 198–208 (2006)CrossRefGoogle Scholar
  38. 38.
    Golovchinsky, G., Price, M.N., Schilit, B.N.: From Reading to Retrieval: Freeform Ink Annotations as Queries. In: F. Gey, M. Hearst, R. Tong (eds.) Proc. 22nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1999), pp. 19–25. ACM Press, New York, USA (1999)CrossRefGoogle Scholar
  39. 39.
    Gonçalves, M.A., Fox, E.A., Watson, L.T., Kipp, N.A.: Streams, Structures, Spaces, Scenarios, Societies (5S): A Formal Model for Digital Libraries. ACM Transactions on Information Systems (TOIS) 22(2), 270–312 (2004)CrossRefGoogle Scholar
  40. 40.
    Groth, D.P., Streefkerk, K.: Provenance and Annotation for Visual Exploration Systems. IEEE Transactions On Visualization And Computer Graphics 12(6), 1500–1510 (2006)CrossRefGoogle Scholar
  41. 41.
    Halasz, F.G.: Reflections on NoteCards: Seven Issues for the Next Generation of Hypermedia Systems. Communications of the ACM (CACM) 31(7), 836–852 (1988)CrossRefGoogle Scholar
  42. 42.
    Halasz, F.G., Moran, T.P., Trigg, R.H.: Notecards in a Nutshell. In: J.M. Carroll, P.P. Tanner (eds.) Proc. Conference on Human Factors in Computing Systems and Graphics Interface (CHI 1987), pp. 45–52. ACM Press, New York, USA (1987)CrossRefGoogle Scholar
  43. 43.
    Handschuh, S., Staab, S. (eds.): Annotation for the Semantic Web. IOS Press, Amsterdam, The Netherlands (2003)MATHGoogle Scholar
  44. 44.
    Hanks, P. (ed.): Collins Dictionary of the English Language. William Collins Sons & Co. Ltd., Glasgow, UK (1979)Google Scholar
  45. 45.
    Hull, D.: Using Statistical Testing in the Evaluation of Retrieval Experiments. In: R. Korfhage, E. Rasmussen, P. Willett (eds.) Proc. 16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 1993), pp. 329–338. ACM Press, New York, USA (1993)CrossRefGoogle Scholar
  46. 46.
    Hwang, W.Y., Wang, C.Y., Sharples, M.: A study of multimedia annotation of Web-based materials. Computers & Education 48(4), 680–699 (2007)CrossRefGoogle Scholar
  47. 47.
    IEI: Enciclopedia Italiana di scienze, lettere ed arti, Vol. XVII (GIAP–GS). Istituto della Enciclopedia Italiana, Istituto Poligrafico dello Stato, Roma, Italia (1951)Google Scholar
  48. 48.
    IEI: Vocabolario della lingua italiana, Vol. II (D–L). Istituto della Enciclopedia Italiana, Arti Grafiche Ricordi, Monotipia Olivieri, Milano, Italia (1987)Google Scholar
  49. 49.
    Ioannidis, Y., Maier, D., Abiteboul, S., Buneman, P., Davidson, S., Fox, E.A., Halevy, A., Knoblock, C., Rabitti, F., Schek, H.J., Weikum, G.: Digital library information-technology infrastructures. International Journal on Digital Libraries 5(4), 266–274 (2005)CrossRefGoogle Scholar
  50. 50.
    Kahan, J., Koivunen, M.R.: Annotea: an open RDF infrastructure for shared Web annotations. In: V.Y. Shen, N. Saito, M.R. Lyu, M.E. Zurko (eds.) Proc. 10th International Conference on World Wide Web (WWW 2001), pp. 623–632. ACM Press, New York, USA (2001)CrossRefGoogle Scholar
  51. 51.
    Marshall, C.C.: Annotation: from Paper Books to the Digital Library. In: R.B. Allen, E. Rasmussen (eds.) Proc. 2nd ACM International Conference on Digital Libraries (DL 1997), pp. 233–240. ACM Press, New York, USA (1997)Google Scholar
  52. 52.
    Marshall, C.C.: Toward an Ecology of Hypertext Annotation. In: R. Akscyn (ed.) Proc. 9th ACM Conference on Hypertext and Hypermedia (HT 1998): links, objects, time and space-structure in hypermedia systems, pp. 40–49. ACM Press, New York, USA (1998)Google Scholar
  53. 53.
    Marshall, C.C., Brush, A.J.B.: From Personal to Shared Annotations. In: L. Terveen, D. Wixon (eds.) Proc. Conference on Human Factors and Computing Systems (CHI 2002) – Extended Abstracts on Human Factors in Computer Systems, pp. 812–813. ACM Press, New York, USA (2002)CrossRefGoogle Scholar
  54. 54.
    Marshall, C.C., Brush, A.J.B.: Exploring the Relationship between Personal and Public Annotations. In: H. Chen, H. Wactlar, C.C. Chen, E.P. Lim, M. Christel (eds.) Proc. 4th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2004), pp. 349–357. ACM Press, New York, USA (2004)CrossRefGoogle Scholar
  55. 55.
    Nagao, K.: Digital Content Annotation and Transcoding. Artech House, Norwood (MA), USA (2003)Google Scholar
  56. 56.
    Navarro, G., Baeza-Yates, R.: Proximal Nodes: A Model to Query Document Databases by Content and Structure. ACM Transactions on Information Systems (TOIS) 15(4), 400–435 (1997)CrossRefGoogle Scholar
  57. 57.
    NISO: ANSI/NISO Z39.88 - 2004 – The OpenURL Framework for Context-Sensitive Services. National Information Standards Organization (NISO). http://www.niso.org/standards/standard_detail.cfm?std_id=783 [last visited 2007, March 23] (2005)Google Scholar
  58. 58.
    Ovsiannikov, I., Arbib, M.A., Mcneill, T.H.: Annotation Technology. International Journal of Human-Computer Studies 50, 329–362 (1999)CrossRefGoogle Scholar
  59. 59.
    Paskin, N. (ed.): The DOI Handbook – Edition 4.4.1. International DOI Foundation (IDF). http://dx.doi.org/10.1000/186 [last visited 2007, March 23] (2006)Google Scholar
  60. 60.
    Phelps, T.A., Wilensky, R.: Multivalent Annotations. In: C. Peters, C. Thanos (eds.) Proc. 1st European Conference on Research and Advanced Technology for Digital Libraries (ECDL 1997), pp. 287–303. Lecture Notes in Computer Science (LNCS) 1324, Springer, Heidelberg, Germany (1997)CrossRefGoogle Scholar
  61. 61.
    van Rijsbergen, C.J.: Information Retrieval, 2nd edn. Butterworths, London, England (1979)Google Scholar
  62. 62.
    Rocci, L.: Vocabolario greco italiano, 34 edizione. Società Editrice Dante Alighieri, Italia (1989)Google Scholar
  63. 63.
    Salatiele: Ars notariae. In: G. Orlandelli (ed.) Opere dei maestri, Vol. 2. Giuffrè, Milano, Italia (1961)Google Scholar
  64. 64.
    Salton, G., McGill, M.J.: Introduction to Modern Information Retrieval. McGraw-Hill, New York, USA (1983)MATHGoogle Scholar
  65. 65.
    Shipman, F., Price, M.N., Marshall, C.C., Golovchinsky, G.: Identifying Useful Passages in Documents based on Annotation Patterns. In: T. Koch, I.T. Sølvberg (eds.) Proc. 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003), pp. 101–112. Lecture Notes in Computer Science (LNCS) 2769, Springer, Heidelberg, Germany (2003)Google Scholar
  66. 66.
    Stein, L.D., Eddy, S., Dowell, R.: Distributed Sequence Annotation System (DAS) – Version 1.53. http://www.biodas.org/documents/spec.html [last visited 2007, March 23] (2002)Google Scholar
  67. 67.
    Thiel, U., Brocks, H., Frommholz, I., Dirsch-Weigand, A., Keiper, J., Stein, A., Neuhold, E.J.: COLLATE – A collaboratory supporting research on historic European films. International Journal on Digital Libraries 4(1), 8–12 (2004)Google Scholar
  68. 68.
    W3C: HTML 4.01 Specification – W3C Recommendation 24 December 1999. http://www.w3.org/TR/html4/ [last visited 2007, March 23] (1999)Google Scholar
  69. 69.
    W3C: Annotea Project. http://www.w3.org/2001/Annotea/ [last visited 2007, March 23] (2005)Google Scholar
  70. 70.
    W3C: Semantic Web. http://www.w3.org/2001/sw/ [last visited 2007, March 23] (2007)Google Scholar
  71. 71.
    Xi, W., Zhang, B., Chen, Z., Lu, Y., Yan, S., Ma, W.Y., Fox, E.A.: Link Fusion: A Unified Link Analysis Framework for Multi-Type Interrelated Data Objects. In: S. Feldman, M. Uretsky, M. Najork, C. Wills (eds.) Proc. 13th International Conference on World Wide Web (WWW 2004), pp. 319–327. ACM Press, New York, USA (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Nicola Ferro
    • 1
  1. 1.Department of Information EngineeringUniversity of PaduaVia Gradenigo 6/aItaly

Personalised recommendations