Skip to main content
SpringerLink
Log in

The effects of using mobile devices on language learning: a meta-analysis

  • Published:
Educational Technology Research and Development Aims and scope Submit manuscript

Abstract

Despite the rapid development of the field of Mobile-assisted Language Learning (MALL), research synthesis and systematic meta-analyses on MALL are still lacking. It remains unclear how effective mobile devices are for language learning under different conditions. Review studies on the overall effectiveness of the latest smart mobile devices are still scant. In order to evaluate the learning outcomes of MALL and the impact of moderator variables, we systematically searched journal articles, conference proceedings, and doctoral dissertations published during 2008–2018 and performed a meta-analysis based on a synthesis of 84 effect sizes from 80 experimental and quasi-experimental studies. A medium-to-high effect size of 0.722 was found for the overall effectiveness of using mobile devices for language learning. The findings indicate that the use of mobile devices for language learning is more effective than conventional methods. The effects of nine moderator variables were analyzed. The target language skill, target language and first/second language were found to be significant moderators. Implications for language teaching and research are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Agbatogun, A. (2014). Developing learners’ second language communicative competence through active learning: Clickers or communicative approach? Educational Technology & Society, 17(2), 257–269.

    Google Scholar 

  • Alemi, M., Sarab, M. R. A., & Lari, Z. (2012). Successful learning of academic word list via MALL: Mobile assisted language learning. International Education Studies, 5(6), 99–109.

    Google Scholar 

  • Andujar, A. (2016). Benefits of mobile instant messaging to develop ESL writing. System, 62, 63–76.

    Google Scholar 

  • Andújar-Vaca, A., & Cruz-Martínez, M. S. (2017). Mobile instant messaging: Whatsapp and its potential to develop oral skills. Comunicar, 25(50), 43–52.

    Google Scholar 

  • Asmali, M. (2018). Integrating technology into ESP classes: Use of student response system in English for specific purposes instruction. Teaching English with Technology, 18(3), 86–104.

    Google Scholar 

  • Binks, S. (2018). Testing enhances learning: A review of the literature. Journal of Professional Nursing, 34(3), 205–210.

    Google Scholar 

  • Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester: Wiley.

    Google Scholar 

  • Brown, J. S., Collins, A., & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32–42.

    Google Scholar 

  • Burston, J. (2013). Language learning technology MALL: Future directions for BYOD applications. The IALLT Journal for Language Learning Technologies, 43(2), 89–96.

    Google Scholar 

  • Burston, J. (2014a). The reality of MALL: Still on the fringes. CALICO Journal, 31(1), 103–125.

    Google Scholar 

  • Burston, J. (2014b). MALL: The pedagogical challenges. Computer Assisted Language Learning, 27(4), 344–357.

    Google Scholar 

  • Burston, J. (2015). Twenty years of MALL project implementation: A meta-analysis of learning outcomes. ReCALL, 27(1), 4–20.

    Google Scholar 

  • Chang, C. C. (2018). Outdoor ubiquitous learning or indoor CAL? Achievement and different cognitive loads of college students. Behaviour and Information Technology, 37(1), 38–49.

    Google Scholar 

  • Chen, C. M., & Chung, C. J. (2008). Personalized mobile English vocabulary learning system based on item response theory and learning memory cycle. Computers & Education, 51(2), 624–645.

    Google Scholar 

  • Chen Hsieh, J. S., Wu, W. C. V., & Marek, M. W. (2017). Using the flipped classroom to enhance EFL learning. Computer Assisted Language Learning, 30(1–2), 1–21.

    Google Scholar 

  • Cho, K., Lee, S., Joo, M.-H., & Becker, B. J. (2018). The effects of using mobile devices on student achievement in language learning: A meta-analysis. Education Sciences, 8(3), 105.

    Google Scholar 

  • Chou, P. N., Chang, C. C., & Lin, C. H. (2017). BYOD or not: A comparison of two assessment strategies for student learning. Computers in Human Behavior, 74, 63–71.

    Google Scholar 

  • Coe, R. (2002). It’s the effect size, stupid: What effect size is and why it is important. Paper presented at the British Educational Research Association Annual Conference, England 12–14 September 2002. Retrieved January 25, 2020, from https://www.leeds.ac.uk/educol/documents/00002182.htm.

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.

    Google Scholar 

  • Cook, V. (1973). The comparison of language development in native children and foreign adults. IRAL, 15, 1–20.

    Google Scholar 

  • Cook, V. (2010). The relationship between first and second language learning revisited. In E. Macaro (Ed.), The Continuum companion to second language acquisition (pp. 137–157). London: Continuum.

    Google Scholar 

  • de la Fuente, M. J. (2014). Learners’ attention to input during focus on form listening tasks: The role of mobile technology in the second language classroom. Computer Assisted Language Learning, 27(3), 261–276.

    Google Scholar 

  • DeCoster, J. (2004). Meta-analysis notes. Retrieved October 15, 2019, from http://www.stat-help.com.

  • Dickersin, K., Chan, S., Chalmers, T. C., Sacks, H. S., & Smith, H. (1987). Publication bias in clinical trials. Controlled Clinical Trials, 8, 348–353.

    Google Scholar 

  • Ducate, L., & Lomicka, L. (2013). Going mobile: Language learning with an ipod touch in intermediate French and German classes. Foreign Language Annals, 46(3), 445–468.

    Google Scholar 

  • Duman, G., Orhon, G., & Gedik, N. (2015). Research trends in mobile assisted language learning from 2000 to 2012. ReCALL, 27(2), 197–216.

    Google Scholar 

  • Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991). Publication bias in clinical research. The Lancet, 337(8746), 867–872.

    Google Scholar 

  • Ellis, R. (1994). The study of second language acquisition. Oxford: Oxford University Press.

    Google Scholar 

  • Godwin-Jones, R. (2016). Augmented reality and language learning: From annotated vocabulary to place-based mobile games. Language Learning & Technology, 20(3), 9–19.

    Google Scholar 

  • Godwin-Jones, R. (2017). Smartphones and language learning. Language Learning & Technology, 21(2), 3–17.

    Google Scholar 

  • Grgurovic, M., Chapelle, C., & Shelley, M. (2013). A meta-analysis of effectiveness studies on computer technology-supported language learning. ReCALL, 25(2), 165–198.

    Google Scholar 

  • Grimshaw, J., & Cardoso, W. (2018). Activate space rats! Fluency development in a mobile game-assisted environment. Language Learning & Technology, 22(3), 159–175.

    Google Scholar 

  • Herrington, A., Herrington, J., & Mantei, J. (2009). Design principles for mobile learning. In Herrington, J., Herrington, A., Mantei, J., Olney, I. & Ferry, B. (Eds.), New technologies, new pedagogies: Mobile learning in higher education (p. 138). Wollongong: Faculty of Education, University of Wollongong.

  • Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327, 557–560.

    Google Scholar 

  • Hung, H. T. (2017). Clickers in the flipped classroom: Bring your own device (BYOD) to promote student learning. Interactive Learning Environments, 25(8), 983–995.

    Google Scholar 

  • Hwang, G.-J., & Fu, Q.-K. (2019). Trends in the research design and application of mobile language learning: A review of 2007–2016 publications in selected SSCI journals. Interactive Learning Environments, 27(4), 567–581.

    Google Scholar 

  • Hwang, G. J., & Tsai, C. C. (2011). Research trends in mobile and ubiquitous learning: A review of publications in selected journals from 2001 to 2010. British Journal of Educational Technology, 42(4), 65–70.

    Google Scholar 

  • Hwang, W. Y., & Chen, H. S. L. (2013). Users’ familiar situational contexts facilitate the practice of EFL in elementary schools with mobile devices. Computer Assisted Language Learning, 26(2), 101–125.

    Google Scholar 

  • Hwang, W. Y., Chen, H. S. L., Shadiev, R., Huang, R. Y. M., & Chen, C. Y. (2014). Improving English as a foreign language writing in elementary schools using mobile devices in familiar situational contexts. Computer Assisted Language Learning, 27(5), 359–378.

    Google Scholar 

  • Kukulska-Hulme, A. (2009). Will mobile learning change language learning? ReCall, 21(2), 157–165.

    Google Scholar 

  • Kukulska-hulme, A., & Shield, L. (2008). An overview of mobile assisted language learning: From content delivery to supported collaboration and interaction. ReCALL, 20(3), 271–289.

    Google Scholar 

  • Lai, A. (2016). Mobile immersion: An experiment using mobile instant messenger to support second-language learning. Interactive Learning Environments, 24(2), 277–290.

    Google Scholar 

  • Lan, Y. J., & Lin, Y. T. (2016). Mobile seamless technology enhanced CSL oral communication. Educational Technology & Society, 19(3), 335–350.

    Google Scholar 

  • Levy, M., & Kennedy, C. (2005). Learning Italian via mobile SMS. In A. Kukulska-Hulme & J. Traxler (Eds.), Mobile learning: A handbook for educators and trainers (pp. 76–83). London: Taylor & Francis.

    Google Scholar 

  • Li, L., Chen, G., & Yang, S. (2013). Construction of cognitive maps to improve e-book reading and navigation. Computers & Education, 60(1), 32–39.

    Google Scholar 

  • Liakin, D., Cardoso, W., & Liakina, N. (2017). The pedagogical use of mobile speech synthesis (TTS): Focus on French liaison. Computer Assisted Language Learning, 30(3–4), 348–365.

    Google Scholar 

  • Lin, C. C. (2017). Learning English with electronic textbooks on tablet PCs. Interactive Learning Environments, 25(8), 1035–1047.

    Google Scholar 

  • Lin, C. J., & Hwang, G. J. (2018). A learning analytics approach to investigating factors affecting EFL students’ oral performance in a flipped classroom. Educational Technology & Society, 21(2), 205–219.

    Google Scholar 

  • Lin, J., & Lin, H. (2019). Mobile-assisted ESL/EFL vocabulary learning: A systematic review and meta-analysis. Computer Assisted Language Learning, 32(8), 878–919.

    Google Scholar 

  • Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Liu, T. Y., & Chu, Y. L. (2010). Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation. Computers & Education, 55(2), 630–643.

    Google Scholar 

  • Lu, M. (2008). Effectiveness of vocabulary learning via mobile phone. Journal of Computer Assisted Learning, 24(6), 515–525.

    Google Scholar 

  • Mahdi, H. S. (2018). Effectiveness of mobile devices on vocabulary learning. Journal of Educational Computing Research, 56(1), 134–154.

    Google Scholar 

  • Naismith, L., Sharples, M., Vavoula, G. & Lonsdale, P. (2004). Literature review in mobile technologies and learning. Bristol: University of Birmingham. (FutureLab Series, Report, 11). Retrieved October 20, 2019, from www.futurelab.org.uk/research/lit_reviews.htm.

  • Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157–159.

    Google Scholar 

  • Quinn, C. (2000). mLearning: mobile, wireless, in your pocket learning. LineZine. Retrieved October 20, 2019, from https://www.linezine.com/2.1/features/cqmmwiyp.htm.

  • Reinders, H., & Pegrum, M. (2017). Supporting language learning on the move: An evaluative framework for mobile language learning resources. In B. Tomlinson (Ed.), Second language acquisition research and materials development for language learning (pp. 116–141). (Second Language Acquisition Research Series). London: Routledge.

  • Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86(3), 638–641.

    Google Scholar 

  • Rubin, J. (1975). What the “good language learner” can teach us? TESOL Quarterly, 9(1), 41–51.

    Google Scholar 

  • Sandberg, J., Maris, M., & De Geus, K. (2011). Mobile English learning: An evidence-based study with fifth graders. Computers and Education, 57(1), 1334–1347.

    Google Scholar 

  • Saran, M., Seferoǧlu, G., & Çaǧiltay, K. (2012). Mobile language learning: Contribution of multimedia messages via mobile phones in consolidating vocabulary. The Asia-Pacific Education Researcher, 21(1), 181–190.

    Google Scholar 

  • Shadiev, R., Hwang, W. Y., & Liu, T. Y. (2018). A study of the use of wearable devices for healthy and enjoyable English as a foreign language learning in authentic contexts. Educational Technology & Society, 21, 217–231.

    Google Scholar 

  • Sharples, M., Milrad, M., Arnedillo-Sánchez, I., Milrad, M., & Vavoula, G. (2009). Mobile learning: Small devices, big issues. In N. Balacheff, S. Ludvigsen, T. Jong, A. Lazonder, & S. Barnes (Eds.), Technology enhanced learning: Principles and products (pp. 233–249). Heidelberg: Springer.

    Google Scholar 

  • Sharples, M., Taylor, J., & Vavoula, G. (2005). Towards a theory of mobile learning. Proceedings of mLearn, 1, 1–9.

    Google Scholar 

  • Silverio-Fernández, M., Renukappa, S., & Suresh, S. (2018). What is a smart device?—A conceptualisation within the paradigm of the internet of things. Visualization in Engineering, 6(1), 3.

    Google Scholar 

  • Song, Y., & Fox, R. (2008). Using PDA for undergraduate student incidental vocabulary testing. ReCALL, 20(3), 290–314.

    Google Scholar 

  • Stockwell, G., & Hubbard, P. (2013). Some emerging principles for mobile-assisted language learning. Monterey, CA: The International Research Foundation for English Language Education. Retrieved November 1, 2019, from https://www.tirfonline.org/english-in-the-workforce/mobile-assisted-language-learning.

  • Sung, Y., Chang, K., & Liu, T. (2016). The effects of integrating mobile devices with teaching and learning on students’ learning performance: A meta-analysis and research synthesis. Computers & Education, 94, 252–275.

    Google Scholar 

  • Sung, Y., Chang, K., & Yang, J. (2015). How effective are mobile devices for language learning ? A meta-analysis. Educational Research Review, 16, 68–84. https://doi.org/10.1016/j.edurev.2015.09.001.

    Article  Google Scholar 

  • Thornton, P., & Houser, C. (2005). Using mobile phones in English education in Japan. Journal of Computer Assisted Learning, 21, 217–228.

    Google Scholar 

  • Traxler, J. (2005). Defining mobile learning. Paper presented at IADIS International Conference Mobile Learning 2005 (pp. 261–266).

  • Van Lier, L. (2004). The ecology and semiotics of language learning: A sociocultural perspective. Dordrecht: Springer.

    Google Scholar 

  • Viberg, O., & Grönlund, A. (2012). Mobile assisted language learning: A literature review. Paper presented at the 11th World Conference on Mobile and Contextual Learning, Helsinki, Finland. mLearn 2012. 1–8.

  • Wang, Y. H. (2016). Could a mobile-assisted learning system support flipped classrooms for classical Chinese learning? Journal of Computer Assisted Learning, 32(5), 391–415.

    Google Scholar 

  • Winters, N. (2006). What is mobile learning? In M. Sharples (Ed.), Big issues in mobile learning: Report of a workshop by the kaleidoscope network of excellence mobile learning initiative (pp. 5–9). Nottingham: University of Nottingham.

    Google Scholar 

  • Wu, Q. (2015). Designing a smartphone app to teach English (L2) vocabulary. Computers & Education, 85, 170–179.

    Google Scholar 

  • Wu, T. T., Sung, T. W., Huang, Y. M., Yang, C. S., & Yang, J. T. (2011). Ubiquitous English learning system with dynamic personalized guidance of learning portfolio. Educational Technology & Society, 14(4), 164–180.

    Google Scholar 

  • Wu, W. C., Chen Hsieh, J., & Yang, J. C. (2017). Creating an online learning community in a flipped classroom to enhance EFL learners’ oral proficiency. Educational Technology & Society, 20(2), 142–157.

    Google Scholar 

  • Zheng, D., Liu, Y., Lambert, A., Lu, A., Tomei, J., & Holden, D. (2018). An ecological community becoming: Language learning as first-order experiencing with place and mobile technologies. Linguistics and Education, 44, 45–57.

    Google Scholar 

  • Zheng, D., & Newgarden, K. (2017). Dialogicality, ecology, and learning in online game worlds. In S. L. Thorne & S. May (Eds.), Language, education and technology (pp. 345–359). Cham: Springer International Publishing.

    Google Scholar 

  • Zheng, L., Li, X., & Chen, F. (2016). Effects of a mobile self-regulated learning approach on students’ learning achievements and self-regulated learning skills. Innovations in Education and Teaching International, 55(6), 1–9.

    Google Scholar 

  • Zurita, G., & Nussbaum, M. (2004). Computer supported collaborative learning using wirelessly interconnected handheld computers. Computer & Education, 42, 289–314.

    Google Scholar 

Download references

Acknowledgements

This research is part of the project entitled Classroom Interaction in Smartphone-supported College English Classes supported by the Key Projects of Ministry of Education, National Education Sciences Planning Projects of 2017, China (Project Number: DCA170308). We would also like to acknowledge the constructive suggestions provided by the reviewers and the valuable editing suggestions given by Mr. Mitchell Wagner from Indiana University.

Author information

Authors and Affiliations

  1. School of Humanities, Beijing University of Posts and Telecommunications, No. 10 Xitucheng Road, Beijing, 100876, China

    Zhenzhen Chen & Huili An

  2. Graduate School of Education, Peking University, No. 5 Summer Palace Road, Beijing, 100871, China

    Zhenzhen Chen & Jiyou Jia

  3. Office of Medical Education, School of Medicine, University of Virginia, P.O. Box 800382, Charlottesville, MA, 22908, USA

    Weichao Chen

Authors
  1. Zhenzhen Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weichao Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiyou Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Huili An
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhenzhen Chen.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, Z., Chen, W., Jia, J. et al. The effects of using mobile devices on language learning: a meta-analysis. Education Tech Research Dev 68, 1769–1789 (2020). https://doi.org/10.1007/s11423-020-09801-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11423-020-09801-5

Keywords

Search

Navigation