PAKDD 2014: Advances in Knowledge Discovery and Data Mining pp 122-133 | Cite as
Machine Learning Approaches for Interactive Verification
Abstract
Interactive verification is a new problem, which is closely related to active learning, but aims to query as many positive instances as possible within some limited query budget. We point out the similarity between interactive verification and another machine learning problem called contextual bandit. The similarity allows us to design interactive verification approaches from existing contextual bandit approaches. We compare the performance of those approaches on interactive verification. In particular, we propose to adopt the upper confidence bound (UCB) algorithm, which has been widely used for the contextual bandit, to solve the interactive verification problem. Experiment results demonstrate that UCB reaches superior performance for interactive verification on many real-world datasets.
Keywords
active learning contextual bandit upper confidence boundPreview
Unable to display preview. Download preview PDF.
References
- Auer, P., Cesa-Bianchi, N., Fischer, P., Informatik, L.: Finite-time analysis of the multi-armed bandit problem. Machine Learning 2-3, 235–256 (2000)Google Scholar
- Langford, J., Zhang, T.: The epoch-greedy algorithm for contextual multi-armed bandits. In: Proceedings of the Conference on Neural Information Processing Systems (2007)Google Scholar
- Lewis, D.D., Gale, W.A.: A sequential algorithm for training text classifiers. In: Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 3–12 (1994)Google Scholar
- Li, L., Chu, W., Langford, J., Schapire, R.E.: A contextual-bandit approach to personalized news article recommendation. In: Proceedings of the International Conference on World Wide Web, pp. 661–670 (2010)Google Scholar
- Li, M., Zhou, Z.H.: Improve computer-aided diagnosis with machine learning techniques using undiagnosed samples. IEEE Transactions on Systems, Man, and Cybernetics, Part A 37(6), 1088–1098 (2007)CrossRefGoogle Scholar
- Rangayyan, R.M., Fabio, J.A., Desautels, J.L.: A review of computer-aided diagnosis of breast cancer: Toward the detection of subtle signs. Journal of the Franklin Institute 344(3-4), 312–348 (2007)CrossRefMATHGoogle Scholar
- Sabato, S., Sarwate, A.D., Srebro, N.: Auditing: Active learning with outcome-dependent query costs. In: Proceedings of the Conference on Neural Information Processing Systems (2013)Google Scholar
- Settles, B.: Active learning literature survey. Tech. rep., University of Wisconsin–Madison (2009)Google Scholar
- Tong, S., Koller, D.: Support vector machine active learning with applications to text classification. Journal of Machine Learning Research 2, 45–66 (2001)Google Scholar
- Walsh, T.J., Szita, I., Diuk, C., Littman, M.L.: Exploring compact reinforcement-learning representations with linear regression. In: Proceedings of the Conference on Uncertainty in Artificial Intelligence, pp. 591–598 (2009)Google Scholar