Abstract
Temporal information has been regarded as a key vehicle for sorting and grouping home photos into albums associated with events. While time-based browsing might be adequate for relatively small photo collection, query and retrieval would be very useful to find relevant photos of an event in large collection. In this paper, we propose the use of temporal events for organizing and representing home photos using structured document formalism and hence a new way to retrieve photos of an event using both image content and temporal context. We describe a hierarchical model of temporal events and the algorithm to construct it from a collection of home photos. In particular, we compute metadata of a node from the metadata of its children recursively to facilitate content-based and context-based matching between a query and an event. With semantic content representation extracted using Visual Keywords and Extended Conceptual Graphs, we demonstrate the effectiveness of photo retrieval on 2400 time-stamped heterogeneous home photos with very promising results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
S.-F. Chang and J. Smith, Searching for Images and Videos on the World-Wide Web, Technical Report #459-96-25, Columbia Univ., Aug. 1996.
Y. Chiaramella and P. Mulhem and F. Fourel, A Model for Multimedia Information Retrieval, Technical Report 4-96, FERMI ESPRIT BRA 8134, 1996.
Cox, M. Miller, T. Minka, T. Papathomas, and P. N. Yianilos, The Bayesian Image Retrieval System, PicHunter: Theory, Implementation and Psychophysical Experiments, IEEE Tran. on Image Processing 9(1): 20–37, 2000.
N. Craswell, D. Hawking and S. Robertson, Effective site finding using link anchor information, ACM SIGIR, New Orleans, 2001.
R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis, John Wiley & Sons, 1973.
M. Dunlop, Multimedia Information Retrieval, PhD thesis, Department of Computer Science, University of Glasgow, 1991.
A. Graham, H. Garcia-Molina, A. Paepcke and T. Winograd, Time as an Essence for Photo Browsing Through Personal Digital Libraries, ACM JCDL, USA, pp.326–335, 2002.
M. Lalmas, Dempster-Shafer’s Theory of Evidence Applied to Structured Documents Modelling Uncertainty, ACM SIGIR, USA, pp.110–118, 1997.
M. Marchiori, The Quest for Correct Information on the Web: Hyper Search Engines, 6 th Intl. World Wide Web Conference, California, U.S.A., pp.265–276, 1997.
P. Mulhem and J.H. Lim, Symbolic photo content-based retrieval, ACM CIKM, McLean, VA, USA, Nov. 4–9, pp. 94–101, 2002.
S. H. Myaeng, D.-H. Juang, M.-S. Kim and Z.-C. Zhoo, A Flexible Model for Retrieval of SGML Documents, ACM SIGIR, Australia, pp. 138–145, 1998.
J. Platt, Auto Album: Clustering Digital Photographs Using Probabilistic Model Merging, IEEE Workshop on Content-Based Access of Image and Video Libraries 2000, pp. 96–100, 2000.
J. C. Platt, M. Czerwinski, B. Field, PhotoTOC: Automatic Clustering for Browsing Personal Photographs, Microsoft Research Technical Report MSRTR-2002-17, (2002).
W. H. Press, B. P. Flannery, S. A. Teukolsky, W. T. Vetterling, Cubic Spline Interpolation, Sub-Chapter 3.3 of Numerical Recipes in C — The Art of Scientific Computing, Second Edition, Cambridge Universoty Press, 1993, pp. 113–117.
K. Rodden, How do people organise their photograpghs? BCS IRSG 21st Annual Colloquium on Information Retrieval Research, Glasgow, April 1999.
K. Rodden and K. Wood, How People Manage Their Digital Photos? ACM CHI, USA, 2003 (to appear).
J. Sowa. Conceptual Structures: Information Processing in Mind and Machine. Addison-Wesley Publisher, 1984.
Y. Sun, H. Zhang, L. Zhang and M. Li, MyPhotos — A System for Home Management and Processing, ACM Multimedia, France, pp. 81–83, 2002.
R. Wilkinson, Effective Retrieval of Structured Documents, ACM SIGIR 1994, Ireland, pp.311–327, 1994.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mulhem, P., Lim, JH. (2003). Home Photo Retrieval: Time Matters. In: Bakker, E.M., Lew, M.S., Huang, T.S., Sebe, N., Zhou, X.S. (eds) Image and Video Retrieval. CIVR 2003. Lecture Notes in Computer Science, vol 2728. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45113-7_32
Download citation
DOI: https://doi.org/10.1007/3-540-45113-7_32
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40634-1
Online ISBN: 978-3-540-45113-6
eBook Packages: Springer Book Archive