Query by Visual Example: Assessing the Usability of Content-Based Image Retrieval System User Interfaces

  • Colin C. Venters
  • Richard J. Hartley
  • Matthew D. Cooper
  • William T. Hewitt
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2195)

Abstract

This paper reports a study designed to investigate the requirements of a user interface for a content-based image retrieval system, and presents the preliminary results of an inquiry into the usability of the query by visual example paradigm. Twenty eight evaluation sessions were conducted to test the usability of two user interfaces. The study was segmented by image type, user group and use function. Usability was measured using a combination of both objective and subjective measuring instruments: benchmark tasks, critical incidents, and the Questionnaire for User Interface Satisfaction (QUIS). Preliminary findings suggest that both user interfaces had an overall positive usability score, although there were a number of areas that would improve the overall score. The results also indicate that the efficacy of some currently used features are questionable.

Keywords

User Interface Query Image Evaluation Session Image Retrieval System Representative Task 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Fidel, R., Challenges in Indexing Electronic Text and Images. ASIS, 1994, p. 3.Google Scholar
  2. 2.
    Del Bimbo, A., Visual Information Retrieval, Morgan Kaufmann, 1999.Google Scholar
  3. 3.
    Eakins, J. P., and Graham, M. E., Content-Based Image Retrieval, JTAP. 1999, pp. 1–63.Google Scholar
  4. 4.
    Rui, Y. and Huang, T. S. Chang, S-F., Image Retrieval: Current Techniques, Promising Directions, and Open Issues. Journal of Visual Communication and Image Representation, 10, (1), 1999, pp. 39–62.CrossRefGoogle Scholar
  5. 5.
    ibid, pp. 39-62.Google Scholar
  6. 6.
    Gudivada, V. N., and Raghaven, V. V., Content-Based Image Retrieval Systems, IEEE Computer, September, 1995, pp. 18–22.Google Scholar
  7. 7.
    Shaw, D., The Human-Computer Interface for Information Retrieval, ASIS, 1991.Google Scholar
  8. 8.
    Del Bimbo, 1999. op. cit.Google Scholar
  9. 9.
    Niblack, W., Barber, R., Equitz, W. Flickner, M. Glasman, E. Petkovic, D. Yanker, P. Faloutsos, C. Taubin, G. The QBIC Project: Querying Images By Content Using Color, Texture and Shape. In: Proceedings of Storage and Retrieval for Image and Video Databases. San Jose, California, USA, SPIE, 1993.Google Scholar
  10. 10.
    Korfhage, R., Information Storage &Retrieval. Wiley, 1997.Google Scholar
  11. 11.
    Gupta, A. and Jain, R.., Visual Information Retrieval, Communications of the ACM, 40 (5), 1997, pp. 71–79.CrossRefGoogle Scholar
  12. 12.
    Batley, S. (1989) Visual Information Retrieval: Browsing Strategies in Pictorial Databases. In: Proceedings of the 12th Online Information Meeting, 6th-8th December 1989, London, England, p. 373–381.Google Scholar
  13. 13.
    Lai, T-S., Tait, J, and McDonald, S., A User-Centred Evaluation of Visual Search Methods for CBIR, CIR2000: The Challenge of Image Retrieval: 3rd UK Conference on Image Retrieval, Brighton, 4-5 May 2000Google Scholar
  14. 14.
    Ford, J., (1975) Paradigms and Fairytales: An Introduction to the Science of Meanings, Routledge & Kegan Paul, p.238.Google Scholar
  15. 15.
    Graham, M E & Eakins, J P. ARTISAN: A Prototype Retrieval System for Trademark Images. Vine, no.107, 1998, 73–80.Google Scholar
  16. 16.
    Bogdan, R., (1992) Qualitative Research for Education, 2nd edition, Simon & Schuster, pp. 72–75.Google Scholar
  17. 17.
    Salton, G., and McGill, M. J., Introduction to Modern Information Retrieval, Computer Science Series, McGraw-Hill Book Company, 1983Google Scholar
  18. 18.
    Nielsen, J., Usability Engineering, AP Professional, 1993.Google Scholar
  19. 19.
    Chin, J. P., et al. Development of an Instrument Measuring Satisfaction of the Human Computer Interface. Proceedings of CHI Conference on Human Factors in Computing Systems, New York, 1988.Google Scholar
  20. 20.
    Hix, D., and Hartson, H. R., Developing User Interfaces: Ensuring Usability Through Product & Process. Wiley, 1993.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2001

Authors and Affiliations

  • Colin C. Venters
    • 1
  • Richard J. Hartley
    • 2
  • Matthew D. Cooper
    • 1
  • William T. Hewitt
    • 1
  1. 1.Manchester Visualization Centre, Manchester ComputingUniversity of ManchesterManchesterEngland, UK
  2. 2.Department of Information & Communication, Geoffrey Manton BuildingManchester Metropolitan UniversityManchesterEngland, UK

Personalised recommendations