Integrating Commonsense Knowledge into the Semantic Annotation of Narrative Media Objects

  • Mario Cataldi
  • Rossana Damiano
  • Vincenzo Lombardo
  • Antonio Pizzo
  • Dario Sergi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6934)


In this paper we present an innovative approach for semantic annotation of narrative media objects (video, text, audio, etc.) that integrates vast commonsense ontological knowledge to a novel ontology-based model of narrative, Drammar (focused on the dramatic concepts of ‘character’ and ‘action’), to permit the annotation of their narrative features.

We also describe the annotation workflow and propose a general architecture that guides the annotation process and permits annotation-based reasoning and search operations. We finally illustrate the proposed annotation model through real examples.


Media annotation narrative annotation ontology 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bratman, M.E., Israel, D.J., Pollack, M.E.: Plans and resource-bounded practical reasoning. Computational Intelligence 4, 349–355 (1988)CrossRefGoogle Scholar
  2. 2.
    Bruner, J.: The narrative construction of reality. Critical Inquiry 18(1), 1–21 (1991)CrossRefGoogle Scholar
  3. 3.
    Carroll, N.: Beyond Esthetics: Philosophical Essays. Cambridge University Press, New York (2001)CrossRefGoogle Scholar
  4. 4.
    Carroll, N. (ed.): Special Issue on Narrative, Journal of Aesthetics and Art Criticism, vol. 67. Wiley Blackwell (2009)Google Scholar
  5. 5.
    Daras, P., Semertzidis, T., Makris, L., Strintzis, M.: Similarity content search in content centric networks. In: Proceedings of the International Conference on Multimedia, pp. 775–778. ACM, New York (2010)Google Scholar
  6. 6.
    Dennett, D.C.: The Intentional Stance. The MIT Press, Cambridge (1987)Google Scholar
  7. 7.
    Esslin, M.: The Field of Drama. Methuen, London (1988(1987))Google Scholar
  8. 8.
    Giovannelli, A.: In Sympathy with Narrative Character. Journal of Aesthetics and Art Criticism 67, 83–95 (2009)CrossRefGoogle Scholar
  9. 9.
    Gratch, J., Marsella, S.: The architectural role of emotion in cognitive systems. Integrated Models of Cognition Systems, 230 (2007)Google Scholar
  10. 10.
    Jewell, M.O., Lawrence, K.F., Tuffield, M.M., Prugel-Bennett, A., Millard, D.E., Nixon, M.S., Schraefel, M.C., Shadbolt, N.R.: Ontomedia: An ontology for the representation of heterogeneous media. In: Multimedia Information Retrieval Workshop (MMIR 2005) SIGIR. ACM SIGIR (2005)Google Scholar
  11. 11.
    Jewell, M., Lawrence, K., Tuffield, M., Prugel-Bennett, A., Millard, D., Nixon, M., Shadbolt, N.: OntoMedia: An ontology for the representation of heterogeneous media. In: Proceeding of SIGIR Workshop on Mutlimedia Information Retrieval. ACM SIGIR (2005)Google Scholar
  12. 12.
    Kipper, K.: VerbNet: A broad-coverage, comprehensive verb lexicon. Ph.D. thesis, University of Pennsylvania (2005)Google Scholar
  13. 13.
    Kiryakov, A., Popov, B., Terziev, I., Manov, D., Ognyanoff, D.: Semantic annotation, indexing, and retrieval. Web Semantics: Science, Services and Agents on the World Wide Web 2(1), 49–79 (2004)CrossRefGoogle Scholar
  14. 14.
    Lavandier, Y.: La dramaturgie. Le clown et l’enfant, Cergy (1994)Google Scholar
  15. 15.
    Lombardo, V., Damiano, R.: Semantic annotation of narrative media objects. Multimedia Tools and Applications, 1–33 (2011),, doi:10.1007/s11042-011-0813-2
  16. 16.
    Melo, G.D., Suchanek, F., Pease, A.: Integrating yago into the suggested upper merged ontology. In: Proceedings of the 2008 20th IEEE International Conference on Tools with Artificial Intelligence, vol. 01, pp. 190–193. IEEE Computer Society, Washington, DC (2008)CrossRefGoogle Scholar
  17. 17.
    Moor, A.D.: Ontology-guided meaning negotiation in communities of practice. In: Proc. of the Workshop on the Design for Large-Scale Digital Communities at the 2nd International Conference on Communities and Technologies, pp. 21–28 (2005)Google Scholar
  18. 18.
    Ortony, A., Clore, G., Collins, A.: The Cognitive Structure of Emotions. Cambridge University Press, Cambridge (1988)CrossRefGoogle Scholar
  19. 19.
    Pease, A., Niles, I., Li, J.: The suggested upper merged ontology: A large ontology for the semantic web and its applications. In: Working Notes of the AAAI 2002 Workshop on Ontologies and the Semantic Web (2002)Google Scholar
  20. 20.
    Prince, G.: A Dictionary of Narratology. University of Nebraska Press (2003)Google Scholar
  21. 21.
    Richard, B., Prié, Y., Calabretto, S.: Towards a unified model for audiovisual active reading. In: Tenth IEEE International Symposium on Multimedia, pp. 673–678 (December 2008),
  22. 22.
    Rimmon-Kenan, S.: Narrative Fiction: Contemporary Poetics. Routledge, New York (1983)CrossRefGoogle Scholar
  23. 23.
    Ryan, M.L.: Narrative Across Media: The Language of Storytelling. University of Nebraska Press (2004)Google Scholar
  24. 24.
    Seger, L.: Creating Unforgettable Characters. Henry Holt and Company, New York (1990)Google Scholar
  25. 25.
    Suchanek, F.M., Kasneci, G., Weikum, G.: Yago: A Core of Semantic Knowledge. In: 16th International World Wide Web Conference (WWW 2007). ACM Press, New York (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Mario Cataldi
    • 1
  • Rossana Damiano
    • 1
  • Vincenzo Lombardo
    • 1
  • Antonio Pizzo
    • 2
  • Dario Sergi
    • 3
  1. 1.Dipartimento di Informatica and CIRMAUniversità di TorinoItaly
  2. 2.Dipartimento Dams and CIRMAUniversità di TorinoItaly
  3. 3.Show.itTorinoItaly

Personalised recommendations