MetaXa—Context- and Content-Driven Metadata Enhancement for Personal Photo Books

  • Susanne Boll
  • Philipp Sandhaus
  • Ansgar Scherp
  • Sabine Thieme
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4351)

Abstract

Making a photo book as a special gift to your beloved can be very time-consuming. One has to carefully select and arrange the pictures nicely over the pages of a previously bought photo book. In these days, photo finisher companies are able to directly print and bind a nice photo book from a selected set of images. But for the users of the software that comes with the album creation, the selection and arrangement of pictures in the album still remains a tedious task. What is missing are easy and good suggestions which pictures to select and how to arrange them into a personal photo book. A higher availability of metadata with the pictures could enable a content-driven and context-driven selection and make album creation better and easier. With MetaXa, we propose a flexible, component-based software architecture that iteratively allows for the multimodal extraction and enhancement of metadata for personal media content. The enhancement process is realized by extraction and enhancement components that each contribute to a well-defined annotation task. Depending on the application domain different components can be configured into a specific instance. With MetaXa, it is hence easy to reuse certain annotation algorithms in different scenarios and to alter a setup by adding or replacing certain enhancement components. MetaXa has been applied to the domain of photo book creation by our project partner CeWe Color and evaluated on a large set of consumer photos.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    ACDSee Systems Int., Inc. acdsee Pro (2006), http://www.acdsystems.com
  2. 2.
    Apple Inc. iPhoto (2006), http://www.apple.com/de/ilife/iphoto/
  3. 3.
    Boll, S.: Image and video retrieval from a user-centered mobile multimedia perspective. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, Springer, Heidelberg (2005)CrossRefGoogle Scholar
  4. 4.
    Boutell, M.R., Luo, J.: Beyond pixels: Exploiting camera metadata for photo classification. Pattern Recognition 38(6) (2005)Google Scholar
  5. 5.
    Cooper, M., Foote, J., Girgensohn, A., Wilcox, L.: Temporal event clustering for digital photo collections. ACM Trans. Multim. Comp. Comm. Appl. 1(3) (2005)Google Scholar
  6. 6.
    GfK Group for CeWe Color. Usage behavior digital photography (2006)Google Scholar
  7. 7.
    Google, Inc. Picasa (2006), http://picasa.google.com/
  8. 8.
    Graham, A., Garcia-Molina, H., Paepcke, A., Winograd, T.: Time as essence for photo browsing through personal digital libraries. In: Proc. of the 2nd ACM/IEEE-CS Joint Conf. on Digital Libraries, ACM Press, New York (2002)Google Scholar
  9. 9.
    International Radio Consultative Committee (ITU). Encoding parameters of digital television for studios. Technical Report 601, CCIR (1982)Google Scholar
  10. 10.
    Jähne, B.: Digital Image Processing, 6th edn. Springer, Heidelberg (2006)Google Scholar
  11. 11.
    JEITA. Exif version 2.2. Technical report (April 2002)Google Scholar
  12. 12.
    Lahti, Westermann, Palola, Peltola, Vildjiounaite: Context-aware mobile capture and sharing of video clips. In: Handbook of Research on Mobile Multimedia, Idea Publishing (2006)Google Scholar
  13. 13.
    Luo, J., Boutell, M., Brown, C.: Pictures are not taken in a vacuum. IEEE Signal Processing Magazine 23(2) (2006)Google Scholar
  14. 14.
    Martinet, J., Chiaramella, Y., Mulhem, P.: A model for weighting image objects in home photographs. In: Proc. of the 14th ACM Int. Conf. on Information and knowledge management, ACM Press, New York (2005)Google Scholar
  15. 15.
    Mulhem, P., Lim, J.-H.: Home photo retrieval: Time matters. In: Proc. of the 2nd Int. Conf. on Image and Video Retrieval, Springer, Heidelberg (2003)Google Scholar
  16. 16.
    Naaman, M., Harada, S., Wang, Q.-Y., Paepcke, A.: Adventures in space and time: Browsing personal collections of geo-referenced digital photographs. Technical report, Standford University, InfoLab (2004)Google Scholar
  17. 17.
    Naaman, M., Song, Y.J., Paepcke, A., Garcia-Molina, H.: Automatic organization for digital photographs with geographic coordinates. In: Proc. of the 4th ACM/IEEE-CS Joint Conf. on Digital Libraries, ACM Press, New York (2004)Google Scholar
  18. 18.
    Naaman, M., Yeh, R.B., Garcia-Molina, H., Paepcke, A.: Leveraging context to resolve identity in photo albums. In: Proc. of the 5th ACM/IEEE-CS joint Conf. on Digital Libraries, ACM Press, New York (2005)Google Scholar
  19. 19.
    Mulhem, W.K.L.P., Lim, J.H., Kankanhalli, M.: Advances in Digital Home Image Albums, ch. 9. Idea Publishing (2003)Google Scholar
  20. 20.
    Pigeau, A., Gelgon, M.: Building and tracking hierarchical geographical & temporal partitions for image collection management on mobile devices. In: Proc. of the 13th annual ACM Int. Conf. on Multimedia, ACM Press, New York (2005)Google Scholar
  21. 21.
    Platt, J.C.: Autoalbum: Clustering digital photographs using probabilistic model merging. In: Proc. of the IEEE Workshop on Content-based Access of Image and Video Libraries, IEEE Computer Society Press, Los Alamitos (2000)Google Scholar
  22. 22.
    Platt, J.C., Czerwinski, M., Field, B.A.: Phototoc: Automatic clustering for browsing personal photographs. Technical report, Microsoft Research (2002)Google Scholar
  23. 23.
    Rodden, K., Wood, K.R.: How do people manage their digital photographs? In: Proc. of the SIGCHI Conf. on Human factors in comp. systems, ACM, New York (2003)Google Scholar
  24. 24.
    Scherp, A., Boll, S.: Context-driven smart authoring of multimedia content with xsmart. In: Proc. of the 13th annual ACM Int. Conf. on Multimedia, pp. 802–803. ACM Press, New York (2005)CrossRefGoogle Scholar
  25. 25.
    Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12) (2000)Google Scholar
  26. 26.
    Szyperski, C., Gruntz, D., Murer, S.: Component Software: Beyond Object-Oriented Programming, 2nd edn. Addison-Wesley, Reading (2002)Google Scholar
  27. 27.
    Tan, T., Chen, J., Mulhem, P., Kankanhalli, M.: Smartalbum: a multi-modal photo annotation system. In: Proc. of the 10th ACM Int. Conf. on Multimedia, ACM Press, New York (2002)Google Scholar
  28. 28.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition (2001)Google Scholar
  29. 29.
    Wenyin, L., Sun, Y., Zhang, H.: Mialbum - a system for home photo management using the semi-automatic image annotation approach. In: Proc. of the 8th ACM Intl. Conf. on Multimedia, ACM Press, New York (2000)Google Scholar
  30. 30.
    Zhang, L., Chen, L., Li, M., Zhang, H.: Automated annotation of human faces in family albums. In: Proc. of the 11th ACM Int. Conf. on Multimedia, ACM Press, New York (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Susanne Boll
    • 1
  • Philipp Sandhaus
    • 2
  • Ansgar Scherp
    • 2
  • Sabine Thieme
    • 3
  1. 1.University of OldenburgGermany
  2. 2.Institute for Information TechnologyOFFISOldenburgGermany
  3. 3.CeWe Color AG & Co. OHGGermany

Personalised recommendations