An Approach for a Personal Information Management System for Photos of a Lifetime by Exploiting Semantics

  • Khalid Latif
  • Khabib Mustofa
  • A. Min Tjoa
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4080)


Photo collections are one of the promising sources to tell story of life in this digital era. In this paper we present our work on organizing photos of a lifetime by exploiting semantic annotations. The complexity in using semantic technology is managed by introducing an annotation template corresponding to who, when, where, and what. Semantics of each dimension are semi-automatically annotated following the ontology for personal information. The story telling is done by exploiting these semantics to form trails of the photos. The notion of landmarks is used for this purpose which also ensures effective navigation in the lifetime photo-space.


Personal Photo Semantic Annotation Photo Collection Address Book Photo Content 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ahmad, M., Hoang, H.H., Karim, S., Khusro, S., Lanzenberger, M., Latif, K., Michlmayr, E., Mustofa, K., Nguyen, H.T., Rauber, A., Schatten, A., Tho, M.N., Tjoa, A.M.: Semanticlife - a framework for managing information of a human lifetime. In: Proceedings of 6th International Conference on Information Integration and Web-based Applications & Services, Jakarta, Indonesia. OCG Press (2004)Google Scholar
  2. 2.
    Aleman-Meza, B., Halaschek-Wiener, C., Arpinar, B., Ramakrishnan, C., Sheth, A.: Ranking complex relationships on the semantic web. IEEE Internet Computing 9(3), 37–44 (2005)CrossRefGoogle Scholar
  3. 3.
    Aris, A., Gemmell, J., Lueder, R.: Exploiting location and time for photo search and storytelling in mylifebits. Technical Report MSR-TR-2004-102, Microsoft Research (2004)Google Scholar
  4. 4.
    Bloehdorn, S., Petridis, K., Saathoff, C., Simou, N., Tzouvaras, V., Avrithis, Y., Handschuh, S., Kompatsiaris, Y., Staab, S., Strintzis, M.: Semantic annotation of images and videos for multimedia analysis. In: Gómez-Pérez, A., Euzenat, J. (eds.) ESWC 2005. LNCS, vol. 3532, pp. 592–607. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  5. 5.
    Bush, V.: As we may think. The Atlantic Monthly (1945)Google Scholar
  6. 6.
    Gemmell, J., Bell, G., Lueder, R., Drucker, S., Wong, C.: Mylifebits: Fulfilling the memex vision. In: Proceedings of ACM Multimedia (2002)Google Scholar
  7. 7.
    Girgensohn, A., Adcock, J., Cooper, M., Foote, J., Wilcox, L.: Simplifying the management of large photo collections. In: Proceedings of Human-Computer Interaction. IOS Press, Amsterdam (2003)Google Scholar
  8. 8.
    Halaschek-Wiener, C., Schain, A., Golbeck, J., Grove, M., Parsia, B., Hendler, J.: A flexible approach for managing digital images on the semantic web. In: Proceedings of 5th International Workshop on Knowledge Markup and Semantic Annotation, Galway, Ireland (2005)Google Scholar
  9. 9.
    Hollink, L., Schreiber, G., Wielemaker, J., Wielinga, B.: Semantic annotation of image collections. In: Proceedings of Workshop on Knowledge Markup and Semantic Annotation (2003)Google Scholar
  10. 10.
    Kalyanpur, A., Hendler, J., Parsia, B., Golbeck, J.: Smore-semantic markup, ontology, and rdf editor,
  11. 11.
    Kang, H., Shneiderman, B.: Visualization methods for personal photo collections: Browsing and searching in the photofinder. In: Proceedings of IEEE International Conference on Multimedia and Expo, pp. 1539–1542 (2000)Google Scholar
  12. 12.
    Latif, K., Tjoa, A.M.: Combining context ontology and landmarks for personal information management. In: Proceedings of IEEE International Conference on Computing & Informatics, Kuala Lumpur, Malaysia (2006)Google Scholar
  13. 13.
    van Ossenbruggen, J., Troncy, R., Stamou, G., Pan, J.: Image annotation on the semantic web. Technical report, W3C Semantic Web Best Practices Working Group (2006),
  14. 14.
    Ringel, M., Cutrell, E., Dumais, S., Horvitz, E.: Milestones in time: The value of landmarks in retrieving information from personal stores. In: Proceedings of 9th International Conference on Human-Computer Interaction, Zurich (2003)Google Scholar
  15. 15.
    Schneiderman, B., Kang, H.: Direct annotation: A drag-and-drop strategy for labeling photos. In: Proceedings International Conference on Information Visualisation, London, England (2000)Google Scholar
  16. 16.
    Sorrows, M.E.: Recall of Landmarks in Information Space. Phd dissertation, School of Information Sciences, University of Pittsburgh (2004)Google Scholar
  17. 17.
    Wurman, R.S., Sume, D., Leifer, L.: Information Anxiety 2. Que (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Khalid Latif
    • 1
  • Khabib Mustofa
    • 1
  • A. Min Tjoa
    • 1
  1. 1.Institute of Software Technology & Interactive SystemsVienna University of TechnologyViennaAustria

Personalised recommendations