Abstract
The paper first addresses the main issues in current content-based image retrieval to conclude that the largest factors of innovations are found in the large size of the datasets, the ability to segment an image softly, the interactive specification of the user’s wish, the sharpness and invariant capabilities of features, and the machine learning of concepts. Among these everything gets better every year apart from the need for annotation which gets worse with every increase in the dataset size. Therefore, we direct our attention to the question what fraction of images needs to be labeled to get an almost similar result compared to the case when all images would have been labeled by annotation? And, how can we design an interactive annotation scheme where we put up for annotation those images which are most informative in the definition of the concept (boundaries)? It appears that we have developed an random followed by a sequential annotation scheme which requires annotating 1% equal to 25 items in a dataset of 2500 faces and non-faces to yield an almost identical boundary of the face-concept compared to the situation where all images would have been labeled. This approach for this dataset has reduced the effort of annotation by 99%.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Campbell, C., Cristianini, N., Smola, A.: Query learning with large margin classifiers. In: Proc. 17th International Conf. on Machine Learning, pp. 111–118. Morgan Kaufmann, CA (2000)
Cohn, D.A., Ghahramani, Z., Jordan, M.I.: Active learning with statistical models. Journal of Artificial Intelligence research 4, 129–145 (1996)
Geusebroek, J.M., van den Boomgaard, R., Smeulders, A.W.M., Geerts, H.: Color invariance. IEEE Trans. on PAMI 23(12), 1338–1350 (2001)
Gevers, T., Smeulders, A.W.M.: Pictoseek: Combining color and shape invariant features for image retrieval. IEEE Trans. on Image Processing 9(1), 102 (2000)
Kaufman, L., Rousseeuw, P.J.: Finding groups in data: An introduction to cluster analysis. JohnWiley & Sons, West Sussex (1990)
Lewis, D.D., Gale, W.A.: A sequential algorithm for training text classifiers. In: Croft, W.B., van Rijsbergen, C.J. (eds.) Proceedings of SIGIR 1994, 17th ACM International Conference on Research and Development in Information Retrieval, pp. 3–12. Springer, Heidelberg (1994)
Lowe, D.G.: Object recognition from local scale-invariant features. In: Proc. IEEE Conf. on Computer Vision, pp. 1150–1157 (1999)
Mundy, J.L., Zisserman, A.: Geometric Invariance in Computer Vision. MIT Press, Cambridge (1992)
Papageorgiou, C., Poggio, T.: A trainable system for object detection. Int. J. Computer Vision 38(1), 15–33 (2000)
Pham, T.V., Worring, M., Smeulders, A.W.M.: Face detection by aggregated Bayesian network classifiers. Pattern Recogn. Letters 23(4), 451–461 (2002)
Schmid, C., Mohr, R., Bauckhage, C.: Evaluation of interest point detectors. Int. J. Computer Vision 37(2), 151–172 (2000)
Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.C.: Content-based image retrieval at the end of the early years. IEEE Trans. on PAMI 22(12), 1349–1380 (2000)
Sung, K.K., Poggio, T.: Example-based learning for view-based human face detection. IEEE Trans. on PAMI 20(1), 39–51 (1998)
Tong, S., Chang, E.: Support vector machine active learning for image retrieval. In: Proceedings of the 9th ACM int. conf. on Multimedia, pp. 107–118 (2001)
Tong, S., Koller, D.: Support vector machine active learning with applications to text classification. Journal of Machine Learning Research 2, 45–66 (2001)
Tuytelaars, T., Turina, A., Van Gool, L.J.: Noncombinatorial detection of regular repetitions under perspective skew. IEEE Trans. on PAMI 25(4), 418–432 (2003)
Vapnik, V.N.: Statistical Learning Theory. Wiley, Chichester (1998)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Computer Vision 57(2), 137–154 (2004)
Worring, M., Smeulders, A.W.M., Santini, S.: Interaction in content-based retrieval: an evaluation of the state-of-the-art. In: Laurini, R. (ed.) VISUAL 2000. LNCS, vol. 1929, pp. 26–36. Springer, Heidelberg (2000)
Zhang, T., Oles, F.J.: Text categorization based on regularized linear classification methods. Information Retrieval 4(1), 5–31 (2001)
Zhu, J., Hastie, T.: Kernel logistic regression and the import vector machine. In: Advances in Neural Information Processing Systems (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nguyen, H.T., Smeulders, A. (2004). Everything Gets Better All the Time, Apart from the Amount of Data. In: Enser, P., Kompatsiaris, Y., O’Connor, N.E., Smeaton, A.F., Smeulders, A.W.M. (eds) Image and Video Retrieval. CIVR 2004. Lecture Notes in Computer Science, vol 3115. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-27814-6_8
Download citation
DOI: https://doi.org/10.1007/978-3-540-27814-6_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-22539-3
Online ISBN: 978-3-540-27814-6
eBook Packages: Springer Book Archive