Managing Full-indexed Audiovisual Documents: A New Perspective for the Humanities


The digitization of library documents and archives increasingly extends to audiovisual (AV) document repositories. As a consequence, new computer-aided techniques are being devised, providing opportunities for new uses of AV documents. As scholars work mainly by reading, annotating, reusing, and producing documents they are directly concerned by these changes. The first part of this article describes AV document use in the humanities, as well as the current and future influence computers might have on evolving practices. After establishing that “full-indexing” (indexing of the content for random access to any segment of an AV document) is a necessary condition if scholars are to develop new practices in using AV material, we will focus on the specific problems raised by AV indexing as opposed to text indexing, followed by a discussion of related AV indexing projects as well as standardization issues. The third part will propose a representation model for the description of AV material (AI-Strata) and an exchange format of AV annotations (AEDI), based on a free segmentation approach. An example of annotation is also provided. The last part is devoted to a discussion regarding potential long-term influences of digital AV indexing techniques on scholarly uses of AV documents.

This is a preview of subscription content, log in to check access.


  1. Aguierre-Smith, T. G. “If You Could See what I Mean... Descriptions of Video in an Anthropologist's Video Notebook”. Master's thesis, University of California, Berkeley, 1992.

    Google Scholar 

  2. Aguierre Smith, T. G. and G. Davenport. “The Stratification System, a Design Environment for Random Access Video”. In: Proc. Network and Operating System Support for Digital Audio and Video — 8th International Workshop. La Jolla, 1992.

  3. André, J., R. Furuta, and V. Quint. Structured Documents. Cambridge University Press, 1989.

  4. Auffret, G. and B. Bachimont. “Audiovisual Cultural Heritage: from TV and Radio Archiving to Hypermedia Publishing”. In: European Conference on Research and Advanced Technology for Digital Libraries. Paris, France, 1999.

  5. Auffret, G., J. Carrive, O. Chevet, T. Dechilly, R. Ronfard and B. Bachimont. ‘Audiovisual-based Hypermedia Authoring: Using Structured Representations for Efficient Access to AV Documents’'. In ACM Hypertext '99. Eds. K. Tochtermann, J. Westbomke, U. K. Wiil and J. J. Leggett. Darmstadt, 1999, pp. 169–178.

  6. Auroux, S. La révolution technologique de la grammatisation. Liege, Belgium: Mardaga. In French, 1994.

    Google Scholar 

  7. Bachimont, B. “Herméneutique matéielle et Artéfacture: des machines qui pensent aux machines qui donnent à penser”. Ph.D. thesis, Ecole Polytechnique, France. In French, 1996.

    Google Scholar 

  8. Bordwell, D. The Cinema of Eisenstein. Harvard University Press, 1993.

  9. Burnard, L. and C. Sperberg-McQueen. TEI P3: Guidelines for Electronic Text Encoding for Interchange. Lou Burnard and C.M. Sperberg-McQueen, 1994.

  10. Bush, V. “As We May Think”. The Atlantic, 176(1) (1945), 101–108.

    Google Scholar 

  11. Chahuneau, F., C. Lécluse, B. Stiegler and J. Virbel. “Prototyping the ultimate tool for scholarly qualitative research on texts”. In 8th Annual Conference of the UW Centre for the New Oxford English Dictionary and Text Research. Waterloo, 1992.

  12. Chang, S., J. Smith, M. Beigi and A. Benitez. “Visual Information Retrieval from Large Distributed Online Repositories”. Communications of the ACM 40(12) (1997), 63–71.

    Google Scholar 

  13. Christel, M. “Addressing the Contents of Video in a Digital Library”. In Electronic Proceedings of the ACM Workshop on Effective Abstraction in Multimedia. San Francisco, California, 1995.

  14. Corridoni, J. M., A. Del Bimbo, D. Lucarella and H. Wenxue. “Multi-perspective Navigation of Movies”. Journal of Visual Languages and Computing 7 (1996), 445–466.

    Google Scholar 

  15. Davis, M. “Media Streams: An Iconic Visual Language for Video Annotation”. In Proceedings of the 1993 IEEE Symposium on Visual Languages. Bergen, Norway, 1993, pp. 196–203.

  16. Denel, F., G. Péjut, and J.-M. Rodes. Le dépot légal de la radio et de la télévision. Paris: INA-publications. In French, 1994.

    Google Scholar 

  17. Ferro, M. and J. Planchais. Les médias et l'histoire. Paris: CFPJ ed. In French, 1997.

    Google Scholar 

  18. Flickner, M., H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, G. M., H. J., L. D., P. D., S. D. and Y. P. “Query by Image and Video Content: The QBIC System”. IEEE Computer 28(9) (1995).

  19. Fox, E. A. and G. Marchionini. “Toward a Worldwide Digital Library”. Communications of the ACM 41(4) (1998), 28–32.

    Google Scholar 

  20. Furuta, R. “What Can Digital Libraries Teach Us about Hypertext?”. SIGLINK Newsletter 6/3 (1997), 7–9.

    Google Scholar 

  21. Goldfarb, C. F. The SGML Handbook. Oxford: Clarendon Press, 1990.

    Google Scholar 

  22. Goody, J. The Domestication of the Savage Mind. Cambridge University Press, 1977.

  23. Grosky, W. “Managing Multimedia Information In Database Systems”. Communications of the ACM 40(12) (1997), 73–80.

    Google Scholar 

  24. Gupta, A., S. Santini, and R. Jain. “In Search of Information in Visual MediaŠŠ. Communications of the ACM 40(12) (1997), 35–42.

    Google Scholar 

  25. Harrison, H. W. The FIAP Cataloguing Rules for Film Archives. FIAF, 1991.

  26. Hjesvold, R. and R. Midtstraum. “Modelling and Querying Video Data”. In 20th VLDB Conference. Santiago, Chile, 1994, pp. 686–694.

  27. ISO. ISO 10744:1992, Information Technology — Hypermedia/Time Based Structuring Language (HyTime). Geneva: ISO, 1992.

    Google Scholar 

  28. Jacquinot, G. Image et pédagogie: analyse sémiologique du film à intention didactique. Paris: Presses universitaires de France. In French, 1977.

    Google Scholar 

  29. Jacquinot, G. L'école devant les écrans. Paris: E.S.F. In French, 1985.

    Google Scholar 

  30. Jost, F. Un monde à notre image: énonciation, cinéma, télévision. Paris: Meridiens Klincksiek. In French, 1992.

    Google Scholar 

  31. Landow, G. P. Hypertext 2.0, The Convergence of Contemporary Critical Theory and Technology. Baltimore + London: The Johns Hopkins University Press, 1997.

    Google Scholar 

  32. Massey, M. and W. Bender. “Salient Stills: Process and Practice”. IBM Systems Journal 35(3–4) (1996), 557–573.

    Google Scholar 

  33. Metz, C. Essais sur la signification au cinéma I. Paris: Klincksieck. In French, 1968.

    Google Scholar 

  34. Metz, C. Essais sur Ia signification au cinéma II. Paris: Klincksieck. In French, 1972.

    Google Scholar 

  35. Minka, T. “An Image Database System that Learns From User Interaction”. Master's thesis, MIT, Cambridge, MA, 1996.

    Google Scholar 

  36. Mitchell, J., W. Pennebaker, C. Foog and D. L. Gall. MPEG Video Compression Standard. New York: Chapman and Hall, 1996.

    Google Scholar 

  37. Nastar, C., M. Mitschke, C. Meilhac and N. Boujemaa. “Surfimage: A Flexible Content-Based Image Retrieval System”. In ACM Multimedia 98. Bristol, 1998.

  38. Oomoto, E. and K. Tanaka. “OVID: Design and Implementation of a Video-Object Database System”. IEEE Transactions on Knowledge and Data Engineering 5(4), 1993, 629–643.

    Google Scholar 

  39. Paepcke, A., C.-C. K. Chang, T. Winograd and H. Garda-Molina. “Interoperability for Digital Libraries Worldwide”. Communications of the ACM 41/4, 1998, 33–42.

    Google Scholar 

  40. Prié, Y., A. Mille and J.-M. Pinon. “AI-STRATA: A User-centered Model for Content-based description and Retrieval of Audiovisual Sequences”. In Int. Advanced Multimedia Content Processing Conf., Vol. 1554 of LNCS, Springer-Verlag. Osaka, 1998.

    Google Scholar 

  41. Prié, Y., A. Mille and J.-M. Pinon. “A Context-Based Audiovisual Representation Model for Audiovisual Information Systems”. In International and Interdisciplinary Conference on Modeling and Using Context, Vol. 1688 of LNAI, Springer-Verlag. Trento, 1999.

    Google Scholar 

  42. Quint, V. and I. Vatton. “Making Structured Documents Active”. Electronic Publishing 7, 1994.

  43. Rosenberg, J. “The Structure of Hypertext Activity”. In ACM Hypertext '96, 1996.

  44. Sawhney, N., D. Balcom and I. Smith. “Authoring and Navigating Video in Space and Time”. IEEE Multimedia, 1997, pp. 30–39.

  45. Sheth, A. and W. Klas. Multimedia Data Management — Using Metadata to Integrate and Apply Digital Media, Chapt. Overview on Using Metadata to Manage Multimedia Data. McGraw-Hill.

  46. Simpson-Young, B. and K. Yap. “Work Process of Film and Television Researchers”. Technical Report 95/11, CSIRO Division of Information Technology, 1995.

  47. Stiegler, B. La technique et le temps I, La faute d'Epiméthée. Galilée. In French, 1994.

  48. Suchman, L. Plans and Situated Action, the Problem of Human-machine Communication. Cambridge University Press, 1987.

  49. Taniguchi, Y., A. Akutsu, Y. Tonomura, and H. Hamada. “Efficient Access Interface to Real-Time Incoming Video Based on Automatic Indexing”. In ACM Multimedia '95. San Fransisco, 1995, pp. 25–33.

  50. Virbel, J. “Annotation dynamique et lecture expérimentale: vers une nouvelle glose?”. Littérature 96 (1995), 91–105. In French.

    Google Scholar 

  51. Vygotsky, L. Mind in Society. Harvard Press, 1978.

  52. Yeo, B. and M. Yeung. “Retrieving and Visualizing Video”. Communications of the ACM 40(12) (1997), 43–52.

    Google Scholar 

  53. Yeung, M., B. Yeo and B. Liu. “Extracting Story Unit from Long Programs for Video Browsing and Navigation”. In Int. Conf. on Multimedia Computing and Systems. Vienna, Austria, 1996.

  54. Zhang, H., C. S. S. Low, and J. Wu. “Video Parsing, Retrieval and Browsing: An Integrated and Content-based Solution”. In ACM Multimedia '95. San Fransisco, 1995, pp. 15–24.

Download references

Author information



Rights and permissions

Reprints and Permissions

About this article

Cite this article

Auffret, G., Prié, Y. Managing Full-indexed Audiovisual Documents: A New Perspective for the Humanities. Computers and the Humanities 33, 319–344 (1999).

Download citation

  • AEDI
  • AI-Strata
  • indexing
  • modeling
  • scholarly use of audio-visual documents
  • standardization