Computers and the Humanities

, Volume 33, Issue 4, pp 319–344 | Cite as

Managing Full-indexed Audiovisual Documents: A New Perspective for the Humanities

  • Gwendal Auffret
  • Yannick Prié


The digitization of library documents and archives increasingly extends to audiovisual (AV) document repositories. As a consequence, new computer-aided techniques are being devised, providing opportunities for new uses of AV documents. As scholars work mainly by reading, annotating, reusing, and producing documents they are directly concerned by these changes. The first part of this article describes AV document use in the humanities, as well as the current and future influence computers might have on evolving practices. After establishing that “full-indexing” (indexing of the content for random access to any segment of an AV document) is a necessary condition if scholars are to develop new practices in using AV material, we will focus on the specific problems raised by AV indexing as opposed to text indexing, followed by a discussion of related AV indexing projects as well as standardization issues. The third part will propose a representation model for the description of AV material (AI-Strata) and an exchange format of AV annotations (AEDI), based on a free segmentation approach. An example of annotation is also provided. The last part is devoted to a discussion regarding potential long-term influences of digital AV indexing techniques on scholarly uses of AV documents.

AEDI AI-Strata indexing modeling scholarly use of audio-visual documents standardization 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Aguierre-Smith, T. G. “If You Could See what I Mean... Descriptions of Video in an Anthropologist's Video Notebook”. Master's thesis, University of California, Berkeley, 1992.Google Scholar
  2. Aguierre Smith, T. G. and G. Davenport. “The Stratification System, a Design Environment for Random Access Video”. In: Proc. Network and Operating System Support for Digital Audio and Video — 8th International Workshop. La Jolla, 1992.Google Scholar
  3. André, J., R. Furuta, and V. Quint. Structured Documents. Cambridge University Press, 1989.Google Scholar
  4. Auffret, G. and B. Bachimont. “Audiovisual Cultural Heritage: from TV and Radio Archiving to Hypermedia Publishing”. In: European Conference on Research and Advanced Technology for Digital Libraries. Paris, France, 1999.Google Scholar
  5. Auffret, G., J. Carrive, O. Chevet, T. Dechilly, R. Ronfard and B. Bachimont. ‘Audiovisual-based Hypermedia Authoring: Using Structured Representations for Efficient Access to AV Documents’'. In ACM Hypertext '99. Eds. K. Tochtermann, J. Westbomke, U. K. Wiil and J. J. Leggett. Darmstadt, 1999, pp. 169–178.Google Scholar
  6. Auroux, S. La révolution technologique de la grammatisation. Liege, Belgium: Mardaga. In French, 1994.Google Scholar
  7. Bachimont, B. “Herméneutique matéielle et Artéfacture: des machines qui pensent aux machines qui donnent à penser”. Ph.D. thesis, Ecole Polytechnique, France. In French, 1996.Google Scholar
  8. Bordwell, D. The Cinema of Eisenstein. Harvard University Press, 1993.Google Scholar
  9. Burnard, L. and C. Sperberg-McQueen. TEI P3: Guidelines for Electronic Text Encoding for Interchange. Lou Burnard and C.M. Sperberg-McQueen, 1994.Google Scholar
  10. Bush, V. “As We May Think”. The Atlantic, 176(1) (1945), 101–108.Google Scholar
  11. Chahuneau, F., C. Lécluse, B. Stiegler and J. Virbel. “Prototyping the ultimate tool for scholarly qualitative research on texts”. In 8th Annual Conference of the UW Centre for the New Oxford English Dictionary and Text Research. Waterloo, 1992.Google Scholar
  12. Chang, S., J. Smith, M. Beigi and A. Benitez. “Visual Information Retrieval from Large Distributed Online Repositories”. Communications of the ACM 40(12) (1997), 63–71.Google Scholar
  13. Christel, M. “Addressing the Contents of Video in a Digital Library”. In Electronic Proceedings of the ACM Workshop on Effective Abstraction in Multimedia. San Francisco, California, 1995.Google Scholar
  14. Corridoni, J. M., A. Del Bimbo, D. Lucarella and H. Wenxue. “Multi-perspective Navigation of Movies”. Journal of Visual Languages and Computing 7 (1996), 445–466.Google Scholar
  15. Davis, M. “Media Streams: An Iconic Visual Language for Video Annotation”. In Proceedings of the 1993 IEEE Symposium on Visual Languages. Bergen, Norway, 1993, pp. 196–203.Google Scholar
  16. Denel, F., G. Péjut, and J.-M. Rodes. Le dépot légal de la radio et de la télévision. Paris: INA-publications. In French, 1994.Google Scholar
  17. Ferro, M. and J. Planchais. Les médias et l'histoire. Paris: CFPJ ed. In French, 1997.Google Scholar
  18. Flickner, M., H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, G. M., H. J., L. D., P. D., S. D. and Y. P. “Query by Image and Video Content: The QBIC System”. IEEE Computer 28(9) (1995).Google Scholar
  19. Fox, E. A. and G. Marchionini. “Toward a Worldwide Digital Library”. Communications of the ACM 41(4) (1998), 28–32.Google Scholar
  20. Furuta, R. “What Can Digital Libraries Teach Us about Hypertext?”. SIGLINK Newsletter 6/3 (1997), 7–9.Google Scholar
  21. Goldfarb, C. F. The SGML Handbook. Oxford: Clarendon Press, 1990.Google Scholar
  22. Goody, J. The Domestication of the Savage Mind. Cambridge University Press, 1977.Google Scholar
  23. Grosky, W. “Managing Multimedia Information In Database Systems”. Communications of the ACM 40(12) (1997), 73–80.Google Scholar
  24. Gupta, A., S. Santini, and R. Jain. “In Search of Information in Visual MediaŠŠ. Communications of the ACM 40(12) (1997), 35–42.Google Scholar
  25. Harrison, H. W. The FIAP Cataloguing Rules for Film Archives. FIAF, 1991.Google Scholar
  26. Hjesvold, R. and R. Midtstraum. “Modelling and Querying Video Data”. In 20th VLDB Conference. Santiago, Chile, 1994, pp. 686–694.Google Scholar
  27. ISO. ISO 10744:1992, Information Technology — Hypermedia/Time Based Structuring Language (HyTime). Geneva: ISO, 1992.Google Scholar
  28. Jacquinot, G. Image et pédagogie: analyse sémiologique du film à intention didactique. Paris: Presses universitaires de France. In French, 1977.Google Scholar
  29. Jacquinot, G. L'école devant les écrans. Paris: E.S.F. In French, 1985.Google Scholar
  30. Jost, F. Un monde à notre image: énonciation, cinéma, télévision. Paris: Meridiens Klincksiek. In French, 1992.Google Scholar
  31. Landow, G. P. Hypertext 2.0, The Convergence of Contemporary Critical Theory and Technology. Baltimore + London: The Johns Hopkins University Press, 1997.Google Scholar
  32. Massey, M. and W. Bender. “Salient Stills: Process and Practice”. IBM Systems Journal 35(3–4) (1996), 557–573.Google Scholar
  33. Metz, C. Essais sur la signification au cinéma I. Paris: Klincksieck. In French, 1968.Google Scholar
  34. Metz, C. Essais sur Ia signification au cinéma II. Paris: Klincksieck. In French, 1972.Google Scholar
  35. Minka, T. “An Image Database System that Learns From User Interaction”. Master's thesis, MIT, Cambridge, MA, 1996.Google Scholar
  36. Mitchell, J., W. Pennebaker, C. Foog and D. L. Gall. MPEG Video Compression Standard. New York: Chapman and Hall, 1996.Google Scholar
  37. Nastar, C., M. Mitschke, C. Meilhac and N. Boujemaa. “Surfimage: A Flexible Content-Based Image Retrieval System”. In ACM Multimedia 98. Bristol, 1998.Google Scholar
  38. Oomoto, E. and K. Tanaka. “OVID: Design and Implementation of a Video-Object Database System”. IEEE Transactions on Knowledge and Data Engineering 5(4), 1993, 629–643.Google Scholar
  39. Paepcke, A., C.-C. K. Chang, T. Winograd and H. Garda-Molina. “Interoperability for Digital Libraries Worldwide”. Communications of the ACM 41/4, 1998, 33–42.Google Scholar
  40. Prié, Y., A. Mille and J.-M. Pinon. “AI-STRATA: A User-centered Model for Content-based description and Retrieval of Audiovisual Sequences”. In Int. Advanced Multimedia Content Processing Conf., Vol. 1554 of LNCS, Springer-Verlag. Osaka, 1998.Google Scholar
  41. Prié, Y., A. Mille and J.-M. Pinon. “A Context-Based Audiovisual Representation Model for Audiovisual Information Systems”. In International and Interdisciplinary Conference on Modeling and Using Context, Vol. 1688 of LNAI, Springer-Verlag. Trento, 1999.Google Scholar
  42. Quint, V. and I. Vatton. “Making Structured Documents Active”. Electronic Publishing 7, 1994.Google Scholar
  43. Rosenberg, J. “The Structure of Hypertext Activity”. In ACM Hypertext '96, 1996.Google Scholar
  44. Sawhney, N., D. Balcom and I. Smith. “Authoring and Navigating Video in Space and Time”. IEEE Multimedia, 1997, pp. 30–39.Google Scholar
  45. Sheth, A. and W. Klas. Multimedia Data Management — Using Metadata to Integrate and Apply Digital Media, Chapt. Overview on Using Metadata to Manage Multimedia Data. McGraw-Hill.Google Scholar
  46. Simpson-Young, B. and K. Yap. “Work Process of Film and Television Researchers”. Technical Report 95/11, CSIRO Division of Information Technology, 1995.Google Scholar
  47. Stiegler, B. La technique et le temps I, La faute d'Epiméthée. Galilée. In French, 1994.Google Scholar
  48. Suchman, L. Plans and Situated Action, the Problem of Human-machine Communication. Cambridge University Press, 1987.Google Scholar
  49. Taniguchi, Y., A. Akutsu, Y. Tonomura, and H. Hamada. “Efficient Access Interface to Real-Time Incoming Video Based on Automatic Indexing”. In ACM Multimedia '95. San Fransisco, 1995, pp. 25–33.Google Scholar
  50. Virbel, J. “Annotation dynamique et lecture expérimentale: vers une nouvelle glose?”. Littérature 96 (1995), 91–105. In French.Google Scholar
  51. Vygotsky, L. Mind in Society. Harvard Press, 1978.Google Scholar
  52. Yeo, B. and M. Yeung. “Retrieving and Visualizing Video”. Communications of the ACM 40(12) (1997), 43–52.Google Scholar
  53. Yeung, M., B. Yeo and B. Liu. “Extracting Story Unit from Long Programs for Video Browsing and Navigation”. In Int. Conf. on Multimedia Computing and Systems. Vienna, Austria, 1996.Google Scholar
  54. Zhang, H., C. S. S. Low, and J. Wu. “Video Parsing, Retrieval and Browsing: An Integrated and Content-based Solution”. In ACM Multimedia '95. San Fransisco, 1995, pp. 15–24.Google Scholar

Copyright information

© Kluwer Academic Publishers 1999

Authors and Affiliations

  • Gwendal Auffret
    • 1
  • Yannick Prié
    • 2
  1. 1.INA, DRPBry/Marne Cedex
  2. 2.INSA-LyonVilleurbanne Cedex

Personalised recommendations