Combining Models of Approximation with Partial Learning
In Gold’s framework of inductive inference, the model of partial learning requires the learner to output exactly one correct index for the target object and only the target object infinitely often. Since infinitely many of the learner’s hypotheses may be incorrect, it is not obvious whether a partial learner can be modified to “approximate” the target object.
Fulk and Jain (Approximate inference and scientific method. Information and Computation 114(2):179–191, 1994) introduced a model of approximate learning of recursive functions. The present work extends their research and solves an open problem of Fulk and Jain by showing that there is a learner which approximates and partially identifies every recursive function by outputting a sequence of hypotheses which, in addition, are also almost all finite variants of the target function.
The subsequent study is dedicated to the question how these findings generalise to the learning of r.e. languages from positive data. Here three variants of approximate learning will be introduced and investigated with respect to the question whether they can be combined with partial learning. Following the line of Fulk and Jain’s research, further investigations provide conditions under which partial language learners can eventually output only finite variants of the target language.
KeywordsTarget Object Target Language Recursive Function Inductive Inference Learning Criterion
Unable to display preview. Download preview PDF.
- 2.Bārzdiņs̆, J.: Two theorems on the limiting synthesis of functions. In: Theory of Algorithms and Programs, vol. 1, pp. 82–88. Latvian State University (1974) (in Russian)Google Scholar
- 6.Gao, Z., Jain, S., Stephan, F.: On conservative learning of recursively enumerable languages. In: Bonizzoni, P., Brattka, V., Löwe, B. (eds.) CiE 2013. LNCS, vol. 7921, pp. 181–190. Springer, Heidelberg (2013) Google Scholar
- 9.Jain, S., Osherson, D., Royer, J.S., Sharma, A.: Systems that learn: an introduction to learning theory. MIT Press (1999)Google Scholar
- 11.Martin, E., Osherson, D.N.: Elements of scientific inquiry. MIT Press (1998)Google Scholar
- 13.Osherson, D.N., Stob, M., Weinstein, S.: Systems that learn: an introduction to learning theory for cognitive and computer scientists. MIT Press (1986)Google Scholar
- 14.Rogers, Jr., H.: Theory of recursive functions and effective computability. MIT Press (1987)Google Scholar