Prior Knowledge in Learning Finite Parameter Spaces
We propose a new framework for computational analysis of language acquisition in a finite parameter space, for instance, in the “principles and parameters” approach to language. The prior knowledge multi-armed bandit algorithm abstracts the idea of a casino of slot machines in which a player has to play machines in order to find out how good they are, but where he has some prior knowledge that some machines are likely to have similar rates of reward. Each grammar is represented as an arm of a bandit machine with the mean-reward function drawn from a Gaussian Process specified by a covariance function between grammars. We test our algorithm on a ten-parameter space and show that the number of iterations required to identify the target grammar is much smaller than the number of all the possible grammars that the learner would have to explore if he was searching exhaustively the entire parameter space.
KeywordsCovariance Alan Venezuela
Unable to display preview. Download preview PDF.
- 1.Auer, P., Cesa-Bianchi, N., Fischer, P.: Finite-time analysis of the multiarmed bandit problem. Machine Learning (47), 235–256 (2002)Google Scholar
- 2.Bubeck, S., Munos, R., Stoltz, G., Szepesvari, S.: Online optimization in x-armed bandits. In: Proceedings of NIPS (2008)Google Scholar
- 3.Chomsky, N.: Aspects of the Theory of Syntax. MIT Press, Cambridge (1965)Google Scholar
- 4.Chomsky, N.: Lectures on government and binding. Foris, Dordrecht (1981)Google Scholar
- 5.Davis, S.M.: Syllable onsets as a factor in stress rules. Phonology (5), 1–19 (1988)Google Scholar
- 7.Gibson, T., Wexler, K.: Triggers. Linguistic Inguiry 25(4), 407–474 (1994)Google Scholar
- 9.Hale, K., Keyser, J.: On argument structure and the lexical expression of syntactic relations. In: Hale, K., Keyser, J. (eds.) The view from building 20, pp. 53–110. MIT Press, Cambridge (1993)Google Scholar
- 10.Hayes, B.: Metrical Stress Theory: Principles and Case Studies. The University of Chicago Press, Chicago (1995)Google Scholar
- 11.Kleinberg, R., Slivkins, A., Upfal, E.: Multi-Armed Bandits in Metric Spaces. In: Proceedings of STOC (2008)Google Scholar
- 13.Niyogi, P.: The Computational Nature of Language Learning and Evolution. MIT Press, Cambridge (2006)Google Scholar
- 15.Wang, Y., Audibert, J., Munos, R.: Algorithms for infinitely many-armed bandits. In: Proceedings of NIPS (2008)Google Scholar