Skip to main content

From Textual to Visual Image Searching: User Experience of Advanced Image Search Tool

  • Conference paper
  • First Online:
Linking Theory and Practice of Digital Libraries (TPDL 2023)

Abstract

This paper reports findings from a study focusing on user experience of image search tool utilizing content-based image retrieval methods. Previous studies have indicated challenges in textual image search especially in the historical domain. As a part of the project, a prototype tool was created for searching digitized historical images based on their visual contents to provide support for user needs identified in earlier studies. The tool was tested by 15 participants who evaluated their user experience with User Experience Scale and by verbal feedback. Our results indicate that participants derived benefits from the search capabilities provided by the tool, which went beyond relying on textual image descriptions. However, problems occurred, for example, in evaluating the search results and in user skills. Results also emphasize the value of intellectually produced metadata for image searching and use. Therefore, future developments should focus on creating hybrid systems supporting both textual and visual image searching.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chassanoff, A.M.: Historians’ experiences using digitized archival photographs as evidence. Am. Arch. 81(1), 135–164 (2018). https://doi.org/10.17723/0360-9081-81.1.135

  2. Late, E., Ruotsalainen, H., Kumpulainen, S.: Searching images from open photograph archive. Search tactics and faced barriers in historical research. Int. J. Dig. Libr. (2023)

    Google Scholar 

  3. Roberts, H.E.: A picture is worth a thousand words: Art indexing in electronic databases. J. Am. Soc. Inform. Sci. Technol. 52(11), 911–916 (2001). https://doi.org/10.1002/asi.1145

    Article  Google Scholar 

  4. Cho, H., Pham, M., Leonard, K.N., Urban, A.C.: A systematic literature review on image information needs and behaviors. J. Doc. 78(2), 207–227 (2022). https://doi.org/10.1108/JD-10-2020-0172

    Article  Google Scholar 

  5. Lund, H., Bogers, T., Larsen, B., Lykke, M.: CHAOS: user-driven development of a metadata scheme for radio broadcast archives. In: Proceedings of the iConference 2013, pp. 990–994 (2013). https://doi.org/10.9776/13510

  6. Männistö, A., Seker, M., Iosifidis, A., Raitoharju, J.: Automatic Image Content Extraction: Operationalizing Machine Learning in Humanistic Photographic Studies of Large Visual Archives. arXiv:2204.02149 (2022)

  7. Late, E., Ruotsalainen, H., Kumpulainen, S.: In a perfect world. exploring the desires and realities for digitized historical image archives. Accepted for publication in the Proceedings of the ASIST Conference. Wiley, London (2023)

    Google Scholar 

  8. Beaudoin, J.: Content-based image retrieval methods and professional image users. J. Am. Soc. Inf. Sci. 67(2), 350–365 (2016). https://doi.org/10.1002/asi.23387

    Article  Google Scholar 

  9. Kumpulainen, S., Ruotsalainen, H.: Searching wartime photograph archive for serious leisure purposes. In International Conference on Theory and Practice of Digital Libraries, pp. 81–92. Springer, Italy (2022). https://doi.org/10.1007/978-3-031-16802-4_7

  10. Beaudoin, J.: A framework of image use among archaeologists, architects, art historians and artists. J. Doc. 70(1), 119–147 (2014). https://doi.org/10.1108/JD-12-2012-0157

    Article  Google Scholar 

  11. O’Brien, H.L., Cairns, P., Hall, M.: A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. Int. J. Hum Comput Stud. 112, 28–39 (2018). https://doi.org/10.1016/j.ijhcs.2018.01.004

    Article  Google Scholar 

  12. Menard, E., Khashman, N.: Image retrieval behaviours: users are leading the way to a new bilingual search interface. Library Hi Tech 32(1), 50–68 (2014). https://doi.org/10.1108/LHT-06-2013-0067

    Article  Google Scholar 

  13. GITHUB. https://github.com/mertseker-dev/advanced_image_search_tool

  14. Borlund, P.: A study of the use of simulated work task situations in interactive information retrieval evaluations. J. Doc. 72(3), 394–413 (2016). https://doi.org/10.1108/JD-06-2015-0068

    Article  Google Scholar 

  15. Korkeamäki, L., Keskustalo, H., Kumpulainen, S.: Task information types related to data gathering in media studies. J. Doc. 78(7), 528–545 (2022). https://doi.org/10.1108/JD-04-2022-0082

    Article  Google Scholar 

  16. Barbuti, N.: From digital cultural heritage to digital culture: evolution in digital humanities. In: Proceedings of the 1st International Conference on Digital Tools and Uses Congress (DTUC 2018). Association for Computing Machinery, New York, Article 21, pp. 1–3 (2018)

    Google Scholar 

Download references

Acknowledgements

We thank all the research participants for their valuable contributions. This work was conducted in IPALIA project supported by the Intelligent Society Profiling Action funded by Academy of Finland. Research was partly funded by the Academy of Finland grant number 351247.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Elina Late .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Late, E., Ruotsalainen, H., Seker, M., Raitoharju, J., Männistö, A., Kumpulainen, S. (2023). From Textual to Visual Image Searching: User Experience of Advanced Image Search Tool. In: Alonso, O., Cousijn, H., Silvello, G., Marrero, M., Teixeira Lopes, C., Marchesin, S. (eds) Linking Theory and Practice of Digital Libraries. TPDL 2023. Lecture Notes in Computer Science, vol 14241. Springer, Cham. https://doi.org/10.1007/978-3-031-43849-3_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-43849-3_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-43848-6

  • Online ISBN: 978-3-031-43849-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics