Abstract
Human-computer interaction is a decisive factor in effective content-based access to large image repositories. In current image retrieval systems the user refines his query by selecting example images from a relevance ranking. Since the top ranked images are all similar, user feedback often results in rearrangement of the presented images only.
For better incorporation of user interaction in the retrieval process, we have developed the Filter Image Browsing method. It also uses feedback through image selection. However, it is based on differences between images rather than similarities. Filter Image Browsing presents overviews of relevant parts of the database to users. Through interaction users then zoom in on parts of the image collection. By repeatedly limiting the information space, the user quickly ends up with a small amount of relevant images. The method can easily be extended for the retrieval of multimedia objects.
For evaluation of the Filter Image Browsing retrieval concept, a user simulation is applied to a pictorial database containing 10,000 images acquired from the World Wide Web by a search robot. The simulation incorporates uncertainty in the definition of the information need by users. Results show Filter Image Browsing outperforms plain interactive similarity ranking in required effort from the user. Also, the method produces predictable results for retrieval sessions, so that the user quickly knows if a successful session is possible at all. Furthermore, the simulations show the overview techniques are suited for applications such as hand-held devices where screen space is limited.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
J.R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R. Jain, and C.-F. Shu, “Virage image search engine: An open framework for image management,” in Proceedings SPIE: Storage and Retrieval for Image and Video Databases IV, San Diego, CA, 1996, pp. 76–87.
I.J. Cox, M.L. Miller, S.M. Omohundro, and P.N. Yianilos, “PicHunter: Bayesian relevance feedback for image retrieval,” in Proceedings of ICPR' 96, Vienna, Austria, 1996, pp. 361–369.
I.J. Cox, M.L. Miller, S.M. Omohundro, and P.N. Yianilos, “Target testing and the PicHunter bayesian multimedia retrieval system,” in Proceedings of the Advanced Digital Libraries (ADL'96) Forum,Washington D.C., 1996, pp. 66–75.
D.R. Cutting, D.R. Karger, J.O. Pedersen, and J.W. Tukey, “Scatter/gather: A cluster-based approach to browsing large document collections,” in Proceedings of SIGIR'92, Copenhagen, Denmark, 1992.
R. Fagin and E.L. Wimmers, “Incorporating user preferences in multimedia queries,” in Proceedings 6th International Conference Database Theory—ICDT' 97, F.N. Afrati and P. Kolaitis (Eds.), Delphi: Greece, 1997, pp. 247–261.
M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, “Query by image and video content: The QBIC system,” IEEE Computer, Vol. 28, No. 9, pp. 23–32, 1995.
T. Gevers and A.W.M. Smeulders, “Pictoseek: A content-based image search engine for the world wide web,” in Proceedings of VISUAL'97, San Diego, CA, 1997.
J. Goldstein and J. Carbonell, “The use of MMR, diversity-based reranking in document reranking and summarization,” in TWLT 14, Language Technology in Multimedia Information Retrieval, D. Hiemstra, F.M.G. De Jong, and K. Netter (Eds.), Enschede: The Netherlands, 1998, pp. 153–166.
W.I. Grosky, “Multimedia information systems,” IEEE Multimedia, Vol. 1, No. 1, pp. 12–24, 1994.
R. Jain, “Infoscopes: Multimedia information systems,” in Multimedia Systems and Techniques, B. Furht (Ed.), Kluwer Academic Publishers: Boston, 1996, pp. 217–253.
A. Pentland, R.W. Picard, and S. Sclaroff, “Photobook: Content-based manipulation of image databases,” in Multimedia Tools and Applications, B. Furht (Ed.), Kluwer Academic Publishers: Boston, 1996, pp. 43–80.
Y. Rubner, C. Tomasi, and L. Guibas, “Adaptive color-image embeddings for database navigation,” in Proceedings of the 3rd Asian Conference on Computer Vision (ACCV98), Hong Kong, 1998, pp. 104–111.
Y. Rui, T.S. Huang, and S.-F. Chang, “Image retrieval: Current techniques, promising directions and open issues,” Journal of Visual Communication and Image Representation, Vol. 10, pp. 1–23, 1999.
Y. Rui, T.S. Huang, Michael Ortega, and Sharad Mehrotra, “Relevance feedback: A power tool in interactive content-based image retrieval,” IEEE Trans on Circuits and Systems for Video Technology, Vol. 8, No. 5, pp. 644–655, 1998.
G. Salton and M.J. McGill, “Introduction to Modern Information Retrieval, McGraw-Hill: New York, 1983.
S. Santini and R. Jain, “Beyond query by example,” in Proceedings of the SixthACMInternational Multimedia Conference, Bristol, England, 1998, pp. 345–350.
J. R. Smith and S.-F. Chang, “An image and video search engine for the world-wide web,” in Proceedings SPIE: Storage and Retrieval for Image and Video Databases V, San Jose, CA, 1997, pp. 84–95.
J.R. Smith and S.-F. Chang, “Visually searching the web for content,” IEEE Multimedia, Vol. 4, No. 3, pp. 12–20, 1997.
J. Vendrig, M. Worring, and A.W.M. Smeulders, “Filter image browsing,” Technical Report 5, Intelligent Sensory Information Systems, Faculty WINS, Universiteit van Amsterdam, http:carol.wins.uva.nl/~vendrig/papers/isis_5.ps.gz, 1998.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Vendrig, J., Worring, M. & Smeulders, A.W. Filter Image Browsing: Interactive Image Retrieval by Using Database Overviews. Multimedia Tools and Applications 15, 83–103 (2001). https://doi.org/10.1023/A:1011367820253
Issue Date:
DOI: https://doi.org/10.1023/A:1011367820253