A Sketch-Based User Interface for Image Search Using Sample Photos
In this paper, we present a sketch-based user interface for a content-based image search using sample photos. Our sketch-based user interface diverts a part of the images and their color extracted from sample photos, which are obtained from image resources, such as an image search result, to a sketch, and supports a user to draw a more practical sketch as a query. This feature of the proposed sketch-based user interface allows a user to make a sketch-based query according to the thought and image of the user by painting and decorating the sketch using fragments of images snipped from sample photos and their colors. Thus, the proposed sketch-based user interface can help a user to make a sketch for the image retrieval by leveraging objects and colors that actually appear in images and photos. In the experiment using our prototype, we evaluated the feasibility of our approach.
KeywordsContent-based image retrieval Interaction design Query by sketch User interface Sample photos
- 3.Klinger, E., Starkweather, D.: The open source perceptual hash library. http://www.phash.org. (Accessed Dec 2015)
- 4.Ashley, J., Flickner, M., Hafner, J., Lee, D., Niblack, W., Petkovic, D.: The query by image content (QBIC) system. In: Proceedings of the 1995 ACM SIGMOD International Conference on Management of Data (SIGMOD 1995), p. 475 (1995)Google Scholar
- 6.Springmann, M., Kopp, D., Schuldt, H.: QbS: searching for known images using user-drawn sketches. In: Proceedings of the International Conference on Multimedia Information Retrieval (MIR 2010), pp. 417–420 (2010)Google Scholar
- 8.He, X., Ma, W.-Y., King, O., Li, M., Zhang, H.: Learning and inferring a semantic space from user’s relevance feedback for image retrieval. In: Proceedings of the Tenth ACM International Conference on Multimedia (MULTIMEDIA 2002), pp. 343–346 (2002)Google Scholar