Abstract
In order to evaluate the effectiveness of a color-sketch retrieval system for a given multimedia database, tedious evaluations involving real users are required as users are in the center of query sketch formulation. However, without any prior knowledge about the bottlenecks of the underlying sketch-based retrieval model, the evaluations may focus on wrong settings and thus miss the desired effect. Furthermore, users have usually no clues or recommendations to draw color-sketches effectively. In this paper, we aim at a preliminary analysis to identify potential bottlenecks of a flexible color-sketch retrieval model. We present a formal framework based on position-color feature signatures, enabling comprehensive simulations of users drawing a color sketch.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
In the original paper [4], the dual form \(f^q_j(x) = \frac{x - \delta _{min}}{\delta _{max} - \delta _{min}}\) was defined, modelling similarities as distances.
References
Barthel, K.U., Hezel, N., Mackowiak, R.: Navigating a graph of scenes for exploring large video collections. In: Tian, Q., Sebe, N., Qi, G.-J., Huet, B., Hong, R., Liu, X. (eds.) MMM 2016. LNCS, vol. 9517, pp. 418–423. Springer, Cham (2016). doi:10.1007/978-3-319-27674-8_43
Beecks, C.: Distance based similarity models for content based multimedia retrieval. Ph.D. thesis, RWTH Aachen University (2013)
Blažek, A., Lokoč, J., Kuboň, D.: Video hunter at VBS 2017. In: Proceedings of 23rd International Conference MultiMedia Modeling, MMM 2017, Reykjavik, Iceland, 4–6 January 2017, Part II, pp. 493–498 (2017)
Blažek, A., Lokoč, J., Skopal, T.: Video retrieval with feature signature sketches. In: Traina, A.J.M., Traina, C., Cordeiro, R.L.F. (eds.) SISAP 2014. LNCS, vol. 8821, pp. 25–36. Springer, Cham (2014). doi:10.1007/978-3-319-11988-5_3
Bui, T., Collomosse, J.P.: Scalable sketch-based image retrieval using color gradient features. In: 2015 IEEE International Conference on Computer Vision Workshop, ICCV Workshops 2015, Santiago, Chile, 7–13 December 2015, pp. 1012–1019 (2015)
Cobârzan, C., Schoeffmann, K., Bailer, W., Hürst, W., Blazek, A., Lokoc, J., Vrochidis, S., Barthel, K.U., Rossetto, L.: Interactive video search tools: a detailed analysis of the video browser showdown 2015. Multimedia Tools Appl. 76(4), 5539–5571 (2017)
Flickner, M., Sawhney, H.S., Ashley, J., Huang, Q., Dom, B., Gorkani, M., Hafner, J., Lee, D., Petkovic, D., Steele, D., Yanker, P.: Query by image and video content: the QBIC system. IEEE Comput. 28(9), 23–32 (1995)
Krulis, M., Lokoc, J., Skopal, T.: Efficient extraction of clustering-based feature signatures using GPU architectures. Multimedia Tools Appl. 75(13), 8071–8103 (2016)
Parui, S., Mittal, A.: Similarity-invariant sketch-based image retrieval in large databases. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8694, pp. 398–414. Springer, Cham (2014). doi:10.1007/978-3-319-10599-4_26
Robertson, S.: Understanding inverse document frequency: on theoretical arguments for IDF. J. Documentation 60(5), 503–520 (2004)
Rossetto, L., Giangreco, I., Tanase, C., Schuldt, H., Dupont, S., Seddati, O.: Enhanced retrieval and browsing in the IMOTION system. In: Proceedings of MultiMedia Modeling - 23rd International Conference, MMM 2017, Reykjavik, Iceland, 4–6 January 2017, Part II, pp. 469–474 (2017)
Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vis. 40(2), 99–121 (2000)
Saavedra, J.M., Barrios, J.M.: Sketch based image retrieval using learned keyshapes (LKS). In: Proceedings of the British Machine Vision Conference 2015, BMVC 2015, Swansea, UK, 7–10 September 2015, pp. 164.1–164.11 (2015)
Schoeffmann, K., Hudelist, M.A., Huber, J.: Video interaction tools: a survey of recent work. ACM Comput. Surv. 48(1), 14:1–14:34 (2015)
Acknowledgments
This research has been supported by Czech Science Foundation project (GAČR) 15-08916S and the Research Grants Council of the Hong Kong Special Administrative Region, China (CityU 11210514).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Lokoč, J., Phuong, A.N., Vomlelová, M., Ngo, CW. (2017). Color-Sketch Simulator: A Guide for Color-Based Visual Known-Item Search. In: Cong, G., Peng, WC., Zhang, W., Li, C., Sun, A. (eds) Advanced Data Mining and Applications. ADMA 2017. Lecture Notes in Computer Science(), vol 10604. Springer, Cham. https://doi.org/10.1007/978-3-319-69179-4_53
Download citation
DOI: https://doi.org/10.1007/978-3-319-69179-4_53
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-69178-7
Online ISBN: 978-3-319-69179-4
eBook Packages: Computer ScienceComputer Science (R0)