Advertisement

Educational Technology Research and Development

, Volume 63, Issue 5, pp 709–726 | Cite as

Lost in second life: virtual embodiment and language learning via multimodal communication

  • Sarah Pasfield-Neofitou
  • Hui Huang
  • Scott Grant
Research Article

Abstract

Increased recognition of the role of the body and environment in cognition has taken place in recent decades in the form of new theories of embodied and extended cognition. The growing use of ever more sophisticated computer-generated 3D virtual worlds and avatars has added a new dimension to these theories of cognition. Both developments provide new opportunities for exploring new ways of facilitating language acquisition in the foreign language classroom environment. In this article, through two case studies we examine student interaction in a virtual environment customised for foreign language learning to examine “virtually” embodied and extended cognition. Our examination identifies two particular features of this combination of mind, (virtual) body and (virtual) environment that further underline the potential of 3D virtual worlds as sites for embodied and extended cognition: students often do not distinguish between themselves and their avatars; the boundaries between the real and virtual environments are highly (cognitively) permeable.

Keywords

Embodied cognition Virtual worlds Avatars Non-player character SLA 

References

  1. Adam, H., & Galinsky, A. (2012). Enclothed cognition. Journal of Experimental Social Psychology, 48, 918–925.CrossRefGoogle Scholar
  2. Atkinson, D. (2010). Extended, embodied cognition and second language acquisition. Applied Linguistics, 31(5), 599–622.Google Scholar
  3. Bar-Hillel, Y. (1960). The Present Status of Automatic Translation of Languages. Advances in Computers, 1, 91–163.CrossRefGoogle Scholar
  4. Barrett, L. (2011). Beyond the Brain: How the Body and the Environment Shape Cognition. New Jersey: Princeton University Press.Google Scholar
  5. Barsalou, L. W. (1999). Language comprehension: Archival memory or preparation for situated action? Discourse Processes, 28, 61–80.CrossRefGoogle Scholar
  6. Barsalou, L. W. (2008). Grounded cognition. Annual Review of Psychology, 59, 617–645.CrossRefGoogle Scholar
  7. Black, D. (2014). Embodiment and Mechanisation: Reciprocal understanding of body and machine from the renaissance to the present. Surrey: Ashgate.Google Scholar
  8. Bonda, E., Petrides, M., Frey, S., & Evans, A. (1994). Frontal cortex involvement in organised sequences of hand movements: Evidence from a positron emission topography study. Society for Neurosciences Abstracts, 20, 353.Google Scholar
  9. Brooks, R. A. (2002). Flesh and machines: How robots will change us. New York: Pantheon.Google Scholar
  10. Clark, A. (1998). Embodied, distributed, and situated cognition. In W. Bechtel & G. Graham (Eds.), Companion to Cognitive Science. Malden: Blackwell.Google Scholar
  11. Clark, A., & Chalmers, D. (1998). The extended mind. Analysis, 58, 7–19.CrossRefGoogle Scholar
  12. Cline, E. (2011). Ready player one. New York: Crown Publishers.Google Scholar
  13. Clinton, K.A. (2006). Being-in-the-Digital-World: How videogames engage our pre-linguistic sense-making abilities (Unpublished doctoral dissertation, University of Wisconsin-Madison, 2006).Google Scholar
  14. Dewey, J. (1910). How We Think. Boston: D.C. Heath & Co.CrossRefGoogle Scholar
  15. Dewey, J. (1968). Experience and Education. New York: Collier Books.Google Scholar
  16. Dijkstra, K., Kaschak, M., & Zwaan, R. (2007). Body posture facilitates retrieval of autobiographical memories. Cognition, 102, 139–149.CrossRefGoogle Scholar
  17. Eerland, A., Guadalupe, T., & Zwaan, R. (2011). Leaning to the left makes the Eiffel Tower seem smaller: posture-modulated estimation. Psychological Science, 22, 1511–1514.CrossRefGoogle Scholar
  18. Evans, V., & Green, M. (2006). Cognitive Linguistics: An introduction. Edinburgh: Edinburgh University Press.Google Scholar
  19. Ferdig, R. E., & de Freitas, S. (Eds.). (2012). Interdisciplinary advancements in gaming, simulations and virtual environments: Emerging trends. Hershey, PA: IGI Global.Google Scholar
  20. Fillmore, C. J. (1982). Frame Semantics, in Linguistics in the Morning Calm. Seoul, Hanshin: The Linguistic Society of Korea.Google Scholar
  21. Gee, J. P. (1995). First language acquisition as a guide for theories of learning and pedagogy. Linguistics and Education, 6, 331–354.CrossRefGoogle Scholar
  22. Gibbs, R. (2006). Embodiment and Cognitive Science. Cambridge: Cambridge University Press.Google Scholar
  23. Glenberg, A. M. (1997). What memory is for. Behavioral and Brain Sciences, 20, 1–55.Google Scholar
  24. Glenberg, A. M., & Robertson, D. A. (1999). Indexical understanding of instructions. Discourse Processes, 28, 1–26.CrossRefGoogle Scholar
  25. Goodwin, C. (2003). The body in action. In J. Coupland & R. Gwin (Eds.), Discourse, the Body and Identity. London: Palgrave-MacMillan.Google Scholar
  26. Grady, J. E. (1997). Foundations of Meaning: Primary Metaphors and Primary Scenes (A Dissertation Submitted in Partial Satisfaction of the Requirements for the Degree of Doctor of Philosophy in Linguistics in the Graduate Division of the University of California, Berkeley: University Microfilms, 1997).Google Scholar
  27. Grady, J. (2005). Primary metaphors as inputs into conceptual integration. Journal of Pragmatics, 37: 1595–1614 (http://www.sciencedirect.com/science/article/pii/S0378216605000652).
  28. Grant, S., & Clerehan, R. (2011). Finding the discipline: Assessing student activity in Second Life. Australasian Journal of Educational Technology, 27(Special Issue, 5), 813–828.Google Scholar
  29. Grant, S., & Huang, H. (2012). Learning a second language in second life. In T. Islam, O. Lee, J. Peterson, & M. Piscioneri (Eds.), Effectively implementing information communication technology in higher education in the Asia-Pacific region. Hauppauge, NY: Nova Science Publishers, Inc.Google Scholar
  30. Grant, S., Huang, H., & Pasfield-Neofitou, S. (2013). Language learning in virtual worlds: The role of foreign language and technical anxiety. Journal of Virtual Worlds Research, 6(1), 1–9.Google Scholar
  31. Gregory, S., Lee, M. J. W., Ellis, A., Gregory, S., Wood, D., Hillier, M., & McKeown, L. (2010). Australian higher education institutions transforming the future of teaching and learning through 3D virtual worlds. Paper presented at the curriculum, technology & transformation for an unknown future: Proceedings of the 27th ASCILITE Conference, Brisbane, Australia.Google Scholar
  32. Hanna, B., & de Nooy, J. (2003). A funny thing happened on the way to the forum: Electronic discussion and foreign language learning. Language Leaning and Technology, 7(1), 71–85.Google Scholar
  33. Haraway, D. J. (1991). Simians, Cyborgs and Women. New York: Routledge.Google Scholar
  34. Hauk, O., Johnsrude, I., & Pulvermuller, F. (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301–307.CrossRefGoogle Scholar
  35. Hayles, N. K. (1999). How we became posthuman: Virtual bodies in cybernetics, literature, and informatics. Chicago: University of Chicago Press.Google Scholar
  36. Henderson, M., Huang, H., Grant, S. & Henderson, L. (2012). The impact of Chinese language lessons in a virtual world on university students’ self-efficacy beliefs. Australasian Journal of Educational Technology. 28(Special Issue, 3), 400–419.Google Scholar
  37. Huang, H., & Grant, S. (2010.) Cultural immersion and language study without stepping out of the country—A case study of teaching Ccinese in second life. In The 8th international conference of Chinese language pedagogy. Beijing: Foreign Language and Research Press.Google Scholar
  38. Ingold, T. (2000). The perception of the environment: Essays on livelihood, dwelling and skill. London: Routledge.CrossRefGoogle Scholar
  39. Iverson, J., & Thelan, E. (1999). Hand, mouth and brain: The dynamic emergence of speech and gesture. In R. Nunez & W. Freeman (Eds.), Reclaiming cognition: The primacy of action, intention, and emotion. Bowling Green, OH: Imprint Academic.Google Scholar
  40. Jacka, L., Gregory, S., Stokes-Thompson, F., McKeown Orwin, L., Farley, H., Ellis, A., et al. (2011). Changing worlds: Virtual worlds for higher degree research, supervision and networking (Symposium). In G. Williams, N. Brown, M. Pittard, & B. Cleland (Eds.), Changing demands, changing directions. Proceedings of the 28th ASCILITE conference. Hobart, Australia: University of Tasmania.Google Scholar
  41. Jeffrey, A., Grant, S., & Gregory, H. M. (2011). Multi-user virtual environments for international classroom collaboration: Practical approaches for teaching and learning in Second Life. In C. Wankel (Ed.), Teaching arts and science with the new social media (pp. 189–210). Bingley, UK: Emerald.Google Scholar
  42. Johnson, C. (1997). Metaphor vs. conflation in the acquisition of polysemy: The case of SEE. In M. K. Hiraga, C. Sinha, & E. Wilcox (Eds.), Cultural, typological and psychological issues in cognitive linguistics (Vol. 152). Amsterdam: John Benjamins.Google Scholar
  43. Johnson, M. (2007). The Meaning of the Body: Aesthetics of human understanding. Chicago: University of Chicago Press.CrossRefGoogle Scholar
  44. Johnson, M., & Rohrer, T. (2007). We are live creatures: Embodiment, American Pragmatism, and the cognitive organism. In T. Ziemke, et al. (Eds.), Body, Language and Mind. Berlin: Mouton de Gruyter.Google Scholar
  45. Koh, C., Tan, H. S., Tan, K. C., Fang, L., Fong, F. M., Kan, D., & Wee, M. L. (2010). Investigating the Effect of 3D Simulation Based Learning on the Motivation and Performance of Engineering Students. Journal of Engineering Education, 99(3), 237–251.CrossRefGoogle Scholar
  46. Lacan, J. (1977). Écrits. London: Tavistock.Google Scholar
  47. Lakoff, G. (2012). Explaining embodied cognition results. Topics in Cognitive Science, 4(4), 773–785.CrossRefGoogle Scholar
  48. Lakoff, G. J., & Johnson, M. (1980). Metaphors We Live by. Chicago: University of Chicago.Google Scholar
  49. Lakoff, G. J., & Johnson, M. (1999). Philosophy in the Flesh: The Embodied Mind and Its Challenge to Western Thought. New York: Basic Books.Google Scholar
  50. Lan, Y. J. (2014). Does second life improve Mandarin learning by overseas Chinese students? Language Learning & Technology, 18(2), 36–56.Google Scholar
  51. Lan, Y. J., Kan, Y.-H., Hsiao, I. Y. T., Yang, S. J. H., & Chang, K. E. (2013). Designing interaction tasks in Second Life for Chinese as a foreign language learners: A preliminary exploration. Australasian Journal of Educational Technology, 29(2), 184–202.Google Scholar
  52. Lewis, C. S. (1950). In P. Baynes (Ed.), The lion, the witch and the wardrobe; a story for children. London: Geoffrey Bles.Google Scholar
  53. Lobel, T. (2014). Sensation: The new science of physical intelligence. Melbourne: Scribe.Google Scholar
  54. McNerney, S. (2011). A brief guide to embodied cognition: Why you are not your brain. Scientific American. http://blogs.scientificamerican.com/guest-blog/2011/11/04/a-brief-guide-to-embodied-cognition-why-you-are-not-your-brain/.
  55. Merleau-Ponty, M. (2002). Phenomenology of Perception. London: Routledge.Google Scholar
  56. Miles, L., Nind, L., & Macrae, C. (2010). Moving through time. Psychological Science, 21, 222–223.CrossRefGoogle Scholar
  57. Multiverse. (2014, December 20). In Wikipedia, The Free Encyclopedia. Retrieved from December 22, 2014, http://en.wikipedia.org/w/index.php?title=Multiverse&oldid=638910457.
  58. Narayanan, S. S. (1997). Knowledge based Action Representations for Metaphor and Aspect (KARMA). Doctor of Philosophy, University of California at Berkeley, Berkeley. Retrieved from http://www1.icsi.berkeley.edu/~snarayan/thesis.pdf.
  59. Nguyen, T. T. (2009). Language and embodiment. VNU Journal of Science, Foreign Languages, 25(2009), 250–256.Google Scholar
  60. Pasfield-Neofitou. (2014). Language learning and socialization opportunities in game worlds: Trends in first and second language research. Language and Linguistics Compass, 8(7), 271–284.Google Scholar
  61. Puri, T. A. (2004). Dressing Lord Jagannatha in Silk: Cloth, Clothes, and Status1. Journal of Social Science, 8(2), 113–127.Google Scholar
  62. Rieser, J., Garing, A., & Young, M. (1994). Imagery, action and young children’s spatial orientation: It’s not being there that counts, it’s what one has in mind. Child Development, 45, 1043–1056.Google Scholar
  63. Rizzolatti, G., Sinigaglia, C., & Anderson, F. (2008). Mirrors in the Brain: How our minds share actions, emotions and experience. Oxford: Oxford University Press.Google Scholar
  64. Saikaluk, P., Pexman, P., Aguilera, L., Owen, W., & Sears, C. (2008). Evidence for the activation of sensorimotor information during visual word recognition: The body-object interaction effect. Cognition, 106, 433–443.CrossRefGoogle Scholar
  65. Semin, G., & Cacioppo, J. (2008). Grounding social cognition: Synchronization, coordination, and co-regulation. In G. Semin & E. Smith (Eds.), Embodied Grounding (pp. 119–147). Cambridge: Cambridge University Press.CrossRefGoogle Scholar
  66. Sharwood Smith, M. (1991). Second language acquisition and the cognitive enterprise. Plenary presentation, Second Language Research Forum. Los Angeles, 2 March 1991.Google Scholar
  67. Smith, A. (2014). Embodied Cognition: Thinking with your body. The Body Sphere. ABC National Radio http://www.abc.net.au/radionational/programs/bodysphere/thinking-with-your-body/5766910.
  68. Soares, D. (2008, April). Digital deixis: Multiple senses of self in an online role-playing game. Paper presented at the annual conference of the American Association of Applied Linguistics, Washington DC.Google Scholar
  69. Stephenson, N. (1992). Snow crash. New York: Bantam Books.Google Scholar
  70. Tron. (2014, December 15). In Wikipedia, The Free Encyclopedia. Retrieved from December 22, 2014 http://en.wikipedia.org/w/index.php?title=Tron&oldid=638258176.
  71. Turkle, S. (1984). The Second Self: Computers and the Human Being. New York: Simon and Schuster.Google Scholar
  72. Turkle, S. (1995). Life on the Screen: Identity in the age of the Internet. New York: Simon and Schuster.Google Scholar
  73. Wilson, A.D. (2013). Grounded vs. embodied cognition A (hopefully uncontentious) note on terminology. Notes from Two Scientific Psychologists http://psychsciencenotes.blogspot.com.au/2013/07/grounded-vs-embodied-cognition.html.
  74. Wilson, M. (2002). Six views of embodied cognition. Psychonomic Bulletin & Review, 9(4), 625–636.Google Scholar
  75. Wilson, A. D., & Golonka, S. (2013). Embodied cognition is not what you think it is. Frontiers in Psychology, 4(58 Article 58), 1–13.Google Scholar
  76. Wilson, R.A. and Foglia, L., “Embodied Cognition”, The Stanford Encyclopedia of Philosophy (Fall 2011 Edition), Edward N. Zalta (ed.), http://plato.stanford.edu/archives/fall2011/entries/embodied-cognition/.
  77. Zheng, D., Young, M. F., Wagner, M. M., & Brewer, R. A. (2009). Negotiation for Action: English language learning in game-based virtual worlds. The Modern Language Journal, 93(iv), 489–511.CrossRefGoogle Scholar

Copyright information

© Association for Educational Communications and Technology 2015

Authors and Affiliations

  1. 1.Monash UniversityMelbourneAustralia

Personalised recommendations