Abstract
Some recent work in computational learning theory has focused on the complexity of teaching by examples. In this paper we study two combinatorial measures expressing the number of examples needed to teach any consistent learner, called teaching dimension and universal teaching dimension. We give a general lower bound on the teaching dimension that improves previous results, relate the teaching complexity measures to some learning complexity measures and combinatorial parameters, and compute bounds on the teaching dimension(s) of natural Boolean concept classes. We also observe an analogy between the teaching model and some problems in the fault detection research, and make use of some results achieved within that framework.
Supported by an Universidad Complutense de Madrid fellowship awarded by the A. Dŭbcek Center, Comenius University, Bratislava, and by the ALTEC (Algorithms for Future Technologies) project of the EC Cooperative Action IC1000.
This is a preview of subscription content, log in via an institution.
Preview
Unable to display preview. Download preview PDF.
References
D. Angluin, “Queries and Concept Learning”, Machine Learning 2 (1988) 319–342.
M. Anthony, G. Brightwell, D. Cohen and J. Shawe-Taylor, “On Exact Specification by Examples”, in: Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory (COLT'92), ACM Press, New York, NY, 1992, pp. 311–318.
A. Blum, P. Chalasani and J. Jackson, “On Learning Embedded Symmetric Concepts” in: Proceedings of the 6th Annual ACM Conference on Computational Learning Theory (COLT'93), ACM Press, New York, NY, 1993, pp. 337–346.
M. A. Breuer and A. D. Friedman, Diagnosis & Reliable Design of Digital Systems, Computer Science Press, Rockville, MD, 1976.
N. H. Bshouty and R. Cleve, “On the Exact Learning of Formulas in Parallel”, in: Proceedings of the 33rd Annual Symposium on Foundations of Computer Science (FOCS'92), IEEE Computer Society Press, Los Alamitos, CA, 1992, pp. 513–522.
I. A. Chegis and S. V. Yablonskii, “Logical Methods of Control of the Work of Electrical Circuits”, Trudy Matematicheskogo Instituta Akad. Nauk SSSR Imeni V. A. Steklova 51 (1958) 270–360 (in Russian).
A. D. Friedman and P. R. Menon, Fault Detection in Digital Circuits, Prentice-Hall, Englewood Cliffs, NJ, 1971.
S. A. Goldman and M. J. Kearns, “On the Complexity of Teaching”, in: Proceedings of the 4th Annual Workshop on Computational Learning Theory (COLT'91), Morgan Kaufmann, San Mateo, CA, 1991, pp. 303–314.
S. A. Goldman, M. J. Kearns, and R. E. Schapire, “Exact Identification of Read-Once Formulas Using Fixed Points of Amplification Functions”, SIAM Journal on Computing 22(4) (1993) 705–726.
S. A. Goldman and H. D. Mathias, “Teaching a Smarter Learner”, in: Proceedings of the 6th Annual ACM Conference on Computational Learning Theory (COLT'93), ACM Press, New York, NY, 1993, pp. 67–76.
T. Hegedüs, “On Training Simple Neural Networks and Small-Weight Neurons”, in: Proceedings of the 1st European Conference on Computational Learning Theory (EuroCOLT'93), Royal Holloway, University of London, December 1993, Oxford University Press, to appear.
J. Jackson and A. Tomkins, “A Computational Model of Teaching”, in: Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory (COLT'92), ACM Press, New York, NY, 1992, pp. 319–326.
W. Maass and Gy. Turán, “Lower Bound Methods and Separation Results for On-Line Learning Models”, Machine Learning 9 (1992) 107–145.
A. Shinohara and S. Miyano, “Teachability in Computational Learning”, New Generation Computing 2 (1991) 337–347.
N. A. Solovev, Tests (theory, design, application), Nauka, Novosibirsk, 1978 (in Russian).
S. V. Yablonskii, “Test in Cybernetics”, in: Mathematical Encyclopedia, vol. 5 [SluYa], (I. M. Vinogradov, ed.), Sovet. Entsiklopediya, Moscow, 1985, pp. 342–346 (in Russian).
S. V. Yablonskii and I. A. Chegis, “On Tests for Electrical Circuits”, Uspekhi Matematicheskikh Nauk 10(4) (1955) 182–184 (in Russian).
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1994 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hegedüs, T. (1994). Combinatorial results on the complexity of teaching and learning. In: Prívara, I., Rovan, B., Ruzička, P. (eds) Mathematical Foundations of Computer Science 1994. MFCS 1994. Lecture Notes in Computer Science, vol 841. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-58338-6_86
Download citation
DOI: https://doi.org/10.1007/3-540-58338-6_86
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-58338-7
Online ISBN: 978-3-540-48663-3
eBook Packages: Springer Book Archive