Transductive Confidence Machines for Pattern Recognition

  • Kostas Proedrou
  • Ilia Nouretdinov
  • Volodya Vovk
  • Alex Gammerman
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2430)


We propose a new algorithm for pattern recognition that outputs some measures of “reliability” for every prediction made, in contrast to the current algorithms that output “bare” predictions only. Our method uses a rule similar to that of nearest neighbours to infer predictions; thus its predictive performance is close to that of nearest neighbours, while the measures of confidence it outputs provide practically useful information for individual predictions.


  1. 1.
    Cristianini, N., & Shawe-Taylor, J. (2000). An Introduction to Support Vector Machines and Other Kernel-based Methods. Cambridge: Cambridge University Press.Google Scholar
  2. 2.
    Fraser, D. A. (1976). Non-parametric methods in statistics. New York: Wiley.Google Scholar
  3. 3.
    King, R. D., Feng, C., & Sutherland, A. (1995). Statlog: Comparison of classification algorithms on large real-world problems. Applied Artificial Intelligence, 9(3), pp 259–287.CrossRefGoogle Scholar
  4. 4.
    Li, M., & Vitányi, P. (1997). An introduction to Kolmogorov complexity and its applications (2nd edn.). New York: Springer.zbMATHGoogle Scholar
  5. 5.
    Melluish, T., Saunders, C., Nouretdinov, I., & Vovk, V. (2001). Comparing the Bayes and typicalness frameworks. In Proceedings of ECML’2001.Google Scholar
  6. 6.
    Nouretdinov, I., Melluish, T., Vovk V. (2001). Ridge Regression Confidence Machine. In Proceedings of the 18th International Conference on Machine Learning.Google Scholar
  7. 7.
    Nouretdinov, I., Vovk, V., Vyugin, M., & Gammerman, A. (2001). Pattern recognition and density estimation under the general iid assumption. In Proceedings of the Fourteenth Annual Conference on Computational Learning Theory and Fifth European Conference on Computational Learning Theory.Google Scholar
  8. 8.
    Papadopoulos, H., Proedrou, K., Vovk, V., Gammerman, A. (2002). Inductive Confidence Machines for Regression.. In Proceedings of ECML’2002.Google Scholar
  9. 9.
    Vapnik, V. (1998). Statistical Learning Theory. New York: Wiley.zbMATHGoogle Scholar
  10. 10.
    Vovk, V., & Gammerman, A. (2002). Algorithmic Theory of Randomness and its Computer Applications. Manuscript.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Kostas Proedrou
    • 1
  • Ilia Nouretdinov
    • 1
  • Volodya Vovk
    • 1
  • Alex Gammerman
    • 1
  1. 1.Department of Computer Science, Royal HollowayUniversity of LondonEghamEngland

Personalised recommendations