Research on Language and Computation

, Volume 8, Issue 2–3, pp 169–207 | Cite as

Computational Models of Learning the Raising-Control Distinction

Article

Abstract

We consider the task of learning three verb classes: raising (e.g., seem), control (e.g., try) and ambiguous verbs that can be used either way (e.g., begin). These verbs occur in sentences with similar surface forms, but have distinct syntactic and semantic properties. They present a conundrum because it would seem that their meaning must be known to infer their syntax, and that their syntax must be known to infer their meaning. Previous research with human speakers pointed to the usefulness of two cues found in sentences containing these verbs: animacy of the sentence subject and eventivity of the predicate embedded under the main verb. We apply a variety of algorithms to this classification problem to determine whether the primary linguistic data is sufficiently rich in this kind of information to enable children to resolve the conundrum, and whether this information can be extracted in a way that reflects distinctive features of child language acquisition. The input consists of counts of how often various verbs occur with animate subjects and eventive predicates in two corpora of naturalistic speech, one adult-directed and the other child-directed. Proportions of the semantic frames are insufficient. A Bayesian attachment model designed for a related language learning task does not work well at all. A hierarchical Bayesian model (HBM) gives significantly better results. We also develop and test a saturating accumulator that can successfully distinguish the three classes of verbs. Since the HBM and saturating accumulator are successful at the classification task using biologically realistic calculations, we conclude that there is sufficient information given subject animacy and predicate eventivity to bootstrap the process of learning the syntax and semantics of these verbs.

Keywords

Bayesian inference Child language acquisition Clustering Control Raising Syntax Unsupervised learning 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Alishahi, A., & Stevenson, S. (2005a). The acquisition and use of argument structure constructions: A Bayesian model. In Proceedings of the ACL 2005 workshop on psychocomputational models of human language acquisition.Google Scholar
  2. Alishahi, A., & Stevenson, S. (2005b). A probabilistic model of early argument structure acquisition. In Proceedings of the 27th annual meeting of the cognitive science society.Google Scholar
  3. Alishahi A., Stevenson S. (2008) A Computational model of early argument structure acquisition. Cognitive Science 32: 789–834CrossRefGoogle Scholar
  4. Becker M. (2005a) Learning verbs without arguments: The problem of raising verbs. Journal of Psycholinguistic Research 34: 165–191CrossRefGoogle Scholar
  5. Becker, M. (2005b). Raising, control and the subset principle. In J. Alderete, C.-H. Han, & A. Kochetov (Eds.), Proceedings of WCCFL 24 (pp. 52–60). Somerville, MA: Cascadilla Press.Google Scholar
  6. Becker M. (2006) There began to be a learnability puzzle. Linguistic Inquiry 37: 441–456CrossRefGoogle Scholar
  7. Becker, M., & Estigarribia, B. (2010). Drawing inferences about novel raising and control verbs. Poster presented at GALANA 4. University of Toronto.Google Scholar
  8. Berry M. W., Browne M., Langville A. N., Pauca V. P., Plemmons R. J. (2007) Algorithms and applications for approximate nonnegative matrix factorization. Computational Statistics & Data Analysis 52: 155–173CrossRefGoogle Scholar
  9. Boley D. (1998) Principal direction divisive partitioning. Data Mining and Knowledge Discovery 2: 325–344CrossRefGoogle Scholar
  10. Bowerman M. (1982) Evaluating competing linguistic models with language acquisition data: Implications of developmental errors with causative verbs. Quaderni di Semantica 3: 5–66Google Scholar
  11. Bresnan, J., Carletta, J., Crouch, R., Nissim, M., Steedman, M., & Wasow, T., et al. (2002). Paraphrase analysis for improved generation, link project. Stanford, CA: HRCR Edinburgh-CLSI Stanford.Google Scholar
  12. Brown R. (1973) A first language. Harvard University Press, Cambridge, MAGoogle Scholar
  13. Chomsky N. (1959) Review of verbal behavior. Language 35: 26–58CrossRefGoogle Scholar
  14. Chomsky N. (1981) Lectures on government and binding: The Pisa lectures. Mouton de Gruyter, New YorkGoogle Scholar
  15. Deneve S. (2008a) Bayesian spiking neurons I: Inference. Neral Computation 20: 91–117CrossRefGoogle Scholar
  16. Deneve S. (2008b) Bayesian spiking neurons II: Learning. Neral Computation 20: 118–145CrossRefGoogle Scholar
  17. Devore J. L. (1991) Probability and statistics for engineering and the sciences (3rd ed.) Duxbury Press, Belmont, CAGoogle Scholar
  18. Dowty D. (1991) Thematic proto-roles and argument selection. Language 67: 547–619CrossRefGoogle Scholar
  19. Fisher C., Gleitman H., Gleitman L. R. (1991) On the semantic content of subcategorization frames. Cognitive Psychology 23: 331–392CrossRefGoogle Scholar
  20. Gelman A., Carlin J. B., Stern H. S., Rubin D. B. (2004) Bayesian data analysis (2nd ed.). Chapman & Hall/CRC, LondonGoogle Scholar
  21. Gleitman L. (1990) The structural sources of verb meanings. Language Acquisition 1: 3–55CrossRefGoogle Scholar
  22. Gomez, R., & Gerken, L. (1997). Artificial grammar learning in one-year-olds: Evidence for generalization to new structure. In E. Hughes, M. Hughes, & A. Greenhill (Eds.), Proceedings of BUCLD 21 (pp. 194–204).Google Scholar
  23. Hirsch C., Wexler K. (2007) The late development of raising: What children seem to think about seem. In: Davies W. D., Dubinsky S. (eds) New horizons in the analysis of control and raising. Springer, Dordrecht, pp 35–70CrossRefGoogle Scholar
  24. Hudson-Kam C., Newport E. (2005) Regularizing unpredictable variation: The roles of adult and child learners in language formation and change. Language Learning and Development 1: 151–196CrossRefGoogle Scholar
  25. Keenan, E. (1976). Toward a universal definition of subjects. In C. Li (Ed.), Subject and topic. New York: Academic Press.Google Scholar
  26. Kemp C., Perfors A., Tenenbaum J. B. (2007) Learning overhypotheses with hierarchical bayesian models. Developmental Science 10: 307–321CrossRefGoogle Scholar
  27. Lederer A., Gleitman H., Gleitman L. (1995) Verbs of a feather flock together: Semantic information in the structure of maternal speech. In: Tomasello M., Merriman W. E. (eds) Beyond names for things: Young children’s acquisition of verbs. Lawrence Erlbaum Associates Inc, Hillsdale, NJ, pp 277–297Google Scholar
  28. Lee D. D., Seung H. S. (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401: 788–791CrossRefGoogle Scholar
  29. Levin B., Rappaport Hovav M. (2005) Argument realization. Cambridge University Press, New YorkCrossRefGoogle Scholar
  30. Lidz J., Henry G., Gleitman L. R. (2004) Kidz in the ’hood: Syntactic bootstrapping and the mental lexicon. In: Hall D. G., Waxman S. (eds) Weaving a lexicon. MIT Press, Cambridge, MA, pp 603–636Google Scholar
  31. MacWhinney B. (2000) The child language data exchange system. Lawrence Erlbaum Associates, Mahwah, NJGoogle Scholar
  32. Marcus G. (1993) Negative evidence in language acquisition. Cognition 46: 53–85CrossRefGoogle Scholar
  33. Merlo P., Stevenson S. (2001) Automatic verb classification based on statistical distribution of argument structure. Computational Linguistics 27: 373–408CrossRefGoogle Scholar
  34. Paatero P., Tapper U. (1994) Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values. Environmetrics 5: 111–126CrossRefGoogle Scholar
  35. Perfors A., Tennenbaum J. B., Wonnacott E. (2010) Variability, negative evidence, and the acquisition of verb argument constructions. Journal of Child Language 37: 607–642CrossRefGoogle Scholar
  36. Perlmutter D. M. (1970) The Two verbs begin. In: Jacobs R. A., Rosenbaum P. S. (eds) Readings in English transformational grammar. Waltham Mass, Ginn, pp 107–119Google Scholar
  37. Rohde, D. L. T. (2005). Tgrep2 user manual. Manuscript.Google Scholar
  38. Rumelhart, D. E., & McClelland, J. L. (1986). On learning the past tenses of English verbs. In J. L. McClelland, D. E. Rumelhart, & the PDP research group (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition (Vol. 2, Chap. 18). Cambridge, MA: MIT Press.Google Scholar
  39. Saffran J., Aslin R., Newport E. (1996) Statistical learning by 8-month-old infants. Science 274: 1926–1928CrossRefGoogle Scholar
  40. Schulte im Walde S. (2009) The induction of verb frames and verb classes from corpora. In: Lüdeling A., Kytö M. (eds) Corpus linguistics: An international handbook. Walter de Gruyter, BerlinGoogle Scholar
  41. Taylor, A., Marcus, M., & Santorini, B. (2003). The PENN treebank: An overview. In: A. Anne (Ed.), Treebanks: The state of the art on syntactically annotated corpora. Dordrecht: Kluwer.Google Scholar
  42. Yang C. (2002) Knowledge and learning in natural language. Oxford University Press, New YorkGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  1. 1.Department of MathematicsCollege of CharlestonCharlestonUSA
  2. 2.Linguistics DepartmentUniversity of North CarolinaChapel HillUSA

Personalised recommendations