Skip to main content

Connectionist Bilingual Representation

  • Chapter
Foundations of Bilingual Memory

Abstract

As a globalized village, we have more bilingual than monolingual speakers today in the world (Grosjean and Li 2013, Chap. 1).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Altarriba, J., & Basnight-Brown, D. M. (2007). Methodological considerations in performing semantic and translation priming experiments across languages. Behavior Research Methods, 39, 1–18.

    Article  PubMed  Google Scholar 

  • Association for Psychological Science. (2012). Bilingual minds. http://www.psychologicalscience.org/index.php/publications/journals/pspi/pspi-archive/media-coverage-bilingual.

  • Bialystok, E. (2001). Bilingualism in development: Language, literacy, and cognition. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Clahsen, H., & Felser, C. (2006). Grammatical processing in language learners. Applied Psycholinguistics, 27, 3–42.

    Article  Google Scholar 

  • Dale, P. S., & Fenson, L. (1996). Lexical development norms for young children. Behavior Research Methods, Instruments, & Computers, 28, 125–127.

    Article  Google Scholar 

  • Diamond, J. (2010). The benefits of multilingualism. Science, 330, 332–333.

    Article  PubMed  Google Scholar 

  • de Groot, A. M. B. (1992). Bilingual lexical representation: A closer look at conceptual representations. In R. Frost & L. Katz (Eds.), Orthography, phonology, morphology, and meaning (pp. 389–412). Amsterdam: Elsevier.

    Chapter  Google Scholar 

  • Dijkstra, T., & van Heuven, W. J. B. (1998). The BIA model and bilingual word recognition. In J. Grainger & A. M. Jacobs (Eds.), Localist connectionist approaches to human cognition. (pp. 189–226). Mahwah: Erlbaum.

    Google Scholar 

  • Dijkstra, T., & van Heuven, W. J. B. (2002). The architecture of the bilingual word recognition system: From identification to decision. Bilingualism: Language and Cognition, 5, 175–197.

    Google Scholar 

  • Dimitropoulou, M., Duñabeitia, J. A., & Carreiras, M. (2011). Two words, one meaning: Evidence of automatic co-activation of translation equivalents. Frontiers in Psychology, 188, 1-20

    Google Scholar 

  • Dong, Y., Gui, S., & MacWhinney, B. (2005). Shared and separate meanings in the bilingual mental lexicon. Bilingualism: Language and Cognition, 8, 221–238.

    Article  Google Scholar 

  • Elman, J. (1990). Finding structure in time. Cognitive Science, 14, 179–211.

    Article  Google Scholar 

  • Elman, J., Bates, A., Johnson, A., Karmiloff-Smith, A., Parisi, D., & Plunkett, K. (1996). Rethinking innateness: A connectionist perspective on development. Cambridge: MIT Press.

    Google Scholar 

  • Finkbeiner, M., Forster, K., Nicol, J., & Nakamura, K. (2004). The role of polysemy in masked semantic and translation priming. Journal of Memory and Language, 51, 1–22.

    Article  Google Scholar 

  • French, R. M. (1998). A simple recurrent network model of bilingual memory. In M. A. Gernsbacher & S. J. Derry (Eds.), Proceedings of the 20th Annual Conference of the Cognitive Science Society (pp. 368–373). Mahwah: Erlbaum.

    Google Scholar 

  • French, R. M., & Jacquet, M. (2004). Understanding bilingual memory. Trends in Cognitive Science, 8, 87–93.

    Article  Google Scholar 

  • Gollan, T. H., Montoya, R. I., Fennema-Notestine, C., & Morris, S. K. (2005). Bilingualism affects picture naming but not picture classification. Memory & Cognition, 33, 1220–1234.

    Article  Google Scholar 

  • Grosjean, F., & Li, P. (2013). The psycholinguistics of bilingualism. New York: Wiley.

    Google Scholar 

  • Hebb, D. (1949). The organization of behavior: A neuropsychological theory. New York: Wiley.

    Google Scholar 

  • Hernandez, A., & Li, P. (2007). Age of acquisition: Its neural and computational mechanisms. Psychological Bulletin, 133, 638–650.

    Article  PubMed  Google Scholar 

  • Hernandez, A., Li, P., & MacWhinney, B. (2005). The emergence of competing modules in bilingualism. Trends in Cognitive Sciences, 9, 220–225.

    Article  PubMed  PubMed Central  Google Scholar 

  • James, D., & Miikkulainen, R. (1995). SARDNET: A self-organizing feature map for sequences. In G. Tesauro, D. S. Touretzky, & T. K. Leen (Eds.), Advances in neural information processing systems (pp. 577–584). Cambridge: MIT Press.

    Google Scholar 

  • Kohonen, T. (2001). Self-organizing maps (3rd ed.). Berlin: Springer.

    Book  Google Scholar 

  • Kroll, J., & Stewart, E. (1994). Category interference in translation and picture naming: Evidence for asymmetric connection between bilingual memory representations. Journal of Memory and Language, 33, 149–174.

    Article  Google Scholar 

  • Li, P. (2002). Bilingualism is in dire need of formal models. Bilingualism: Language and Cognition, 5, 213.

    Article  Google Scholar 

  • Li, P. (Ed.). (2013). Computational modeling of bilingualism: How can models tell us more about the bilingual mind? (Special issue). Bilingualism: Language and Cognition, 16, 241–366.

    Article  Google Scholar 

  • Li, P., & Farkas, I. (2002). A self-organizing connectionist model of bilingual processing. In R. R. Heredia & J. Altarriba (Eds.), Bilingual sentence processing (pp. 59–85). North-Holland: Elsevier.

    Chapter  Google Scholar 

  • Li, P., & MacWhinney, B. (2002). PatPho: A phonological pattern generator for neural networks. Behavior Research Methods, Instruments & Computers, 34, 408–415.

    Article  Google Scholar 

  • Li, P., & Zhao, X. (2012). Connectionism. In M. Aronoff (Ed.), Oxford Bibliographies Online: Linguistics. New York: Oxford University Press.

    Google Scholar 

  • Li, P., Farkas, I., & MacWhinney, B. (2004). Early lexical development in a self-organizing neural network. Neural Networks, 17, 1345–1362.

    Article  PubMed  Google Scholar 

  • Li, P., Zhao, X., & MacWhinney, B. (2007). Dynamic self-organization and early lexical development in children. Cognitive Science: A Multidisciplinary Journal, 31, 581–612.

    Article  Google Scholar 

  • MacWhinney, B. (2000). The CHILDES project: Tools for analyzing talk. Hillsdale: Lawrence Erlbaum.

    Google Scholar 

  • MacWhinney, B. (2012). The logic of the Unified Model. In S. Gass & A. Mackey (Eds.), The Routledge handbook of second language acquisition (pp. 211–227). New York: Routledge.

    Google Scholar 

  • McClelland, J. L. (2009). The place of modeling in cognitive science. Topics in Cognitive Science, 1, 11–28.

    Article  PubMed  Google Scholar 

  • McClelland, J., & Rumelhart, D. (1981). An interactive activation model of context effects in letter perception: Part 1. An account of basic findings. Psychological Review, 88, 375–407.

    Article  Google Scholar 

  • Miller, G. A. (1990). WordNet: An on-line lexical database. International Journal of Lexicography, 3, 235–312.

    Article  Google Scholar 

  • Paivio, A., & Desrochers, A. (1980). A dual-coding approach to bilingual memory. Canadian Journal of Psychology, 34, 388–399.

    Article  Google Scholar 

  • Pavlenko, A. (2009). Conceptual representation in the bilingual lexicon and second language vocabulary learning. In A. Pavlenko (Ed.), The bilingual mental lexicon: Interdisciplinary approaches (pp. 125–160). Tonawanda: Multilingual Matters.

    Google Scholar 

  • Potter, M. C., So, K. F., von Eckardt, B., & Feldman, I. B. (1984). Lexical and conceptual representation in beginning and proficient bilinguals. Journal of Verbal Learning and Verbal Behavior, 23, 23–38.

    Article  Google Scholar 

  • Plunkett, K., & Marchman, V. (1991). U-shaped learning and frequency effects in a multi-layered perceptron: Implications for child language acquisition. Cognition, 38, 43–102.

    Article  PubMed  Google Scholar 

  • Regier, T. (2005). The emergence of words: Attentional learning in form and meaning. Cognitive Science, 29, 819–865.

    Article  PubMed  Google Scholar 

  • Rumelhart, D., Hinton, G., & Williams, R. (1986). Learning internal representations by error propagation. In D. Rumelhart, J. McClelland, & the PDP Research Group (Eds.), Parallel distributed processing: Explorations in the microstructures of cognition (Vol. 1, pp. 318–362). Cambridge: MIT Press.

    Google Scholar 

  • Tardif, T., Gelman, S. A., & Xu, F. (1999). Putting the “noun bias” in context: A comparison of English and Mandarin. Child Development, 70, 620–635.

    Article  Google Scholar 

  • Thomas, M. S. C. (1997). Connectionist networks and knowledge representation: The case of bilingual lexical processing. PhD thesis, Oxford University.

    Google Scholar 

  • Ullman, M. T. (2001). A neurocognitive perspective on language: The declarative/procedural model. Nature Reviews Neuroscience, 2, 717–726.

    Article  PubMed  Google Scholar 

  • Wang, X., & Forster, K. I. (2010). Masked translation priming with semantic categorization: Testing the Sense Model. Bilingualism: Language and Cognition, 13, 327–340.

    Article  Google Scholar 

  • Zhao, X., & Li, P. (2009a). The acquisition of lexical and grammatical aspect in a developmental lexicon model. Linguistics: An Interdisciplinary Journal of the Language Sciences, 47, 1075–1112.

    Article  Google Scholar 

  • Zhao, X., & Li, P. (2009b). An online database of phonological representations for Mandarin Chinese. Behavior Research Methods, 41, 575–583.

    Article  Google Scholar 

  • Zhao, X., & Li, P. (2010). Bilingual lexical interactions in an unsupervised neural network model. International Journal of Bilingual Education and Bilingualism, 13, 505–524.

    Article  Google Scholar 

  • Grosjean, F., & Li, P. (2013). The psycholinguistics of bilingualism. New York: Wiley (See Chapter 7, 8 & 10).

  • Li, P. (Ed.). (2013). Computational modeling of bilingualism: How can models tell us more about the bilingual mind? Bilingualism: Language and Cognition, 16, 241–366. (Special Issue)

    Google Scholar 

  • Li, P. (2009). Lexical organization and competition in first and second languages: Computational and neural mechanisms. Cognitive Science, 33, 629–664.

    Article  PubMed  Google Scholar 

  • Spitzer, M. (1999). The mind within the net: Models of learning, thinking, and acting. Cambridge: MIT Press.

    Google Scholar 

Suggested Readings

  • Elman, J., Bates, A., Johnson, A., Karmiloff-Smith, A., Parisi, D., & Plunkett, K. (1996). Rethinking innateness: A connectionist perspective on development. Cambridge: MIT Press.

    Google Scholar 

Internet Sites Related to Connectionism and Bilingualism

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Appendices

List of Keywords and Concepts

Age of acquisition (AoA), Backpropagation, Bilingual interactive activation (BIA), Bilingual lexical representation, Bilingual simple recurrent network (BSRN), Bilingual single network (BSN), Computational modeling, Connectionism, Connectionist models, Cross-language lexical competition, Cross-language priming, Developmental lexicon (DevLex), Emergentist theories, Hebbian learning, output layer, Interactive activation, Nodes, Parallel distributed processing (PDP), Self-organizing map (SOM), Self-organizing model of bilingual processing (SOMBIP), Sequential activation retention and decay network (SARDNET), Sequential learning, Simple recurrent network (SRN), Simultaneous learning

Thought Questions

  1. 1.

    What are the classic models of bilingual lexical memory? How are they related and different from one another?

  2. 2.

    How does the Bilingual Interactive Activation (BIA) model contribute to our understanding of bilingual representation?

  3. 3.

    Why do we need to build computational models of bilingual lexical representation? Can computationally implemented models provide more insights that verbal models cannot?

  4. 4.

    How is connectionist representation different from traditional verbal models of lexical representation?

  5. 5.

    Why do we highlight the importance of developmental changes in connectionist models, and how can we take advantage of the learning principles in these models for understanding bilingual representation?

  6. 6.

    What are the basic ingredients of a connectionist model? How is learning simulated in these models?

  7. 7.

    Can the DevLex-II model simulate L1 and L2 lexical competition? How does it do so?

  8. 8.

    Can the DevLex-II model simulate cross-language semantic priming? How does it do so?

  9. 9.

    What does it mean that the L2 is parasitic on the L1 representation, and how is this notion reflected in the computational model?

  10. 10.

    What insights can we gain from these models with regard to the critical period hypothesis? Are there fundamental architectural changes in these models that would lend support to a critical period hypothesis based on biological changes across developmental stages?

Applied Issues in Learning and Memory in the Acquisition of an L2 and Vocabulary Learning

Our simulation results may shed some light on bilingual education. For example, our simulation demonstrated that late L2 learners often have compact and fuzzy representations of L2 items in their lexical memory, which leads to competitions and confusions among L2 words during L2 lexical production/retrieval. To reduce such errors, L2 learners and teachers should focus on training on identifying/distinguishing the subtle conceptual differences of similar L2 words. Training of this type may help L2 learners create clearer L2 mental representations of the lexicon.

Suggested Projects

Students can use the Contextual SOM package (available at http://blclab.org) to derive semantic information from multiple languages and represent them in self-organizing maps. Once representations from each language are derived, the student can also use these to simulate cross-language priming effects, following the procedures outlined in Zhao and Li (2013). Students can also explore a variety of other connectionist architectures as presented in the Special Issue on Computational Modeling of Bilingualism (Li 2013).

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Li, P., Zhao, X. (2014). Connectionist Bilingual Representation. In: Heredia, R., Altarriba, J. (eds) Foundations of Bilingual Memory. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-9218-4_4

Download citation

Publish with us

Policies and ethics