Abstract
Driven by the demand for evidence of development effectiveness, the field of mobile learning for development (ML4D) has recently begun to adopt rigorous evaluation methods. Using the findings of an ongoing systematic review of ML4D interventions, this paper critically assesses the value proposition of rigorous impact evaluations in ML4D. While a drive towards more reliable evidence of mobile learning’s effectiveness as a development intervention is welcome, the maturity of the field, which continues to be characterised by pilot programmes rather than well-established and self-sustaining interventions, questions the utility of rigorous evaluation designs. The experiences of conducting rigorous evaluations of ML4D interventions have been mixed, and the paper concludes that in many cases the absence of an explicit programme theory negates the effectiveness of carefully designed impact evaluations. Mixed-methods evaluations are presented as a more relevant evaluation approach in the context of ML4D.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
World Bank: Maximizing Mobile. World Bank, Washington D.C. (2012)
UNESCO: Turning on mobile learning. Global themes. UNESCO, Paris (2012)
Traxler, J., Kukulska-Hulme, A.: Mobile learning in developing countries. Knowledge Series. Commonwealth of learning, Vancouver (2005)
Roschelle, J.: Unlocking the learning value of wireless mobile devices. Journal of Computer Assisted Learning 19(3), 260–272 (2003)
UNESCO: Teaching and learning: Achieving quality for all. Education for all – Global monitoring report 2014. UNESCO, Paris (2014)
Wali, E., Winters, N., Oliver, M.: Maintaining, Changing and Crossing Contexts: an Activity Theoretic Reinterpretation of Mobile Learning. Research in Learning Technology 16(1), 41–57 (2008)
Banerjee, A.V., Duflo, E.: Poor economics. A radical way to rethinking of the way to fight global poverty. Public Affairs, New York (2011)
UK Department for International Development (DFID): Assessing the strength of evidence. How to note. DFID, London (2014)
Ravallion, M.: Should the randomistas rule? Berkeley Electronic Press (2009), http://siteresources.worldbank.org/INTPOVRES/Resources/477227-1142020443961/2311843-1229023430572/Should_the_randomistas_rule.pdf
Glennerster, R., Takavarasha, K.: Running randomized evaluations - a practical guide. Princeton University Press, Princeton (2013)
Pritchett, L.: An Homage to the Randomistas on the Occasion of the J-PAL 10th Anniversary: Development as a Faith-Based Activity (2014), http://www.cgdev.org/blog/homage-randomistas-occasion-j-pal-10th-anniversary-development-faith-based-activity
UNESCO: Mobile learning for teachers in Africa and the Middle East: Exploring the Potential of Mobile Technologies to Support Teachers and Improve Practice. UNESCO, Paris (2012)
Traxler, J.: Mobile learning in Africa: the elephants in the room. In: Kinuthia, W., Marshall, S. (eds.) On the Move: Mobile Learning for Development. Information Age Publishing, Charlotte (2013)
Sharples, M.: Methods for evaluating mobile learning. In: Vavoula, G., Pachler, N., Kukulska, H. (eds.) Researching Mobile Learning: Frameworks, Tools and Research Designs. Peter Lang Publishing Group, Oxford (2009)
Clemens, M.A., Demombynes, G.: When does rigorous impact evaluation make a difference? The case of the Millennium Development Villages. CDG Working paper 174. Center for Global Development, Washington, DC (2010)
Thomas, J., Sutcliffe, K., Harden, A., Oakley, A., Oliver, S., Rees, R., Brunton, G., Kavanagh, J.: Children and Healthy Eating: A systematic review of barriers and facilitators. EPPI-Centre, Social Science Research Unit, Institute of Education, University of London, London (2003)
Aker, C.J., Ksoll, C., Lybbert, T.J.: ABC, 123: The Impact of a Mobile Phone Literacy Program on Educational Outcomes. CGD Working Paper 223, Centre for Global Development, Washington, DC (2010)
Cole, S.A., Fernando, A.N.: The Value of Advice: Evidence from Mobile Phone-Based Agricultural Extension. HBS Working Paper 13-047. Harvard Business School, Boston (2012)
Sterne, J., Higgins, J., Reeves, B.: Extending the risk of bias tool to allow for assessment of non-randomised studies, cluster-randomised trials and cross-over trials: a Cochrane methods innovation fund project (Workshop). In: The Cochrane Collaboration. 21st Cochrane Colloquium Abstract Book, pp. 203–204 (2013), http://2013.colloquium.cochrane.org/abstract-book
Hammersley, M.: On ‘Systematic’ Reviews of Research Literatures: A ‘narrative’ response to Evans & Benefield. British Educational Research Journal 27(5), 543–554 (2001)
Oakley, A.: Research Evidence, Knowledge Management and Educational Practice: Early lessons from a systematic approach. London Review of Education 1(1), 21–33 (2003)
Eyeben, R., Guijt, I., Roche, C., Shutt, C., Whitty, B.: The Politics of Evidence Conference Report, April 23-24, 2013, at Institute of Development Studies, Sussex, UK (2013)
Traxler, J.: mLearning solutions for international development–rethinking the thinking. Digital Culture & Education 5(2), 74–85 (2013)
Kaleebu, N., Gee, A., Jones, R., Watson, A.H.A.: SMS story impact assessment report. VSO, Papua New Guinea (2013)
Gertler, P.J., Martinez, S., Premand, P., Rawlings, L.B., Vermeersch, C.M.J.: Impact evaluation in practice. World Bank, Washington, DC (2011)
Worldreader: Measured Impact: Students Read More & Better (2014), http://www.worldreader.org/what-we-do/
Worldreader: iRead Ghana study. Final evaluation report. USAID, Washington, DC (2012)
Mruz, K.: 2011 Rwanda TeacherMate Report. Open Learning Exchange, Cambridge, US (2011)
Wennersten, M., Qureshy, Z.B.: Summative evaluation of the Nokia & Pearson Foundation BridgeIT India Project. EZ Vidya, Delhi (2012)
Winters, N.: Mobile learning in the majority world: A critique of the GSMA position. In: Price, S., Jewitt, C., Brown, B. (eds.) The SAGE Handbook of Digital Technology Research. Sage, London (2013)
Velghe, F.: ‘I wanna go in the phone’: literacy acquisition, informal learning processes, ‘voice’ and mobile phone appropriation in a South African township. Ethnography and Education 9(1), 111–126 (2014)
Oliver, K., Innvar, S., Lorenc, T., Woodman, J., Thomas, J.: A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Services Research 14(2) (2014)
GSMA: The Mobile Proposition for Education. GSMA, London (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Langer, L., Winters, N., Stewart, R. (2014). Mobile Learning for Development: Ready to Randomise?. In: Kalz, M., Bayyurt, Y., Specht, M. (eds) Mobile as a Mainstream – Towards Future Challenges in Mobile Learning. mLearn 2014. Communications in Computer and Information Science, vol 479. Springer, Cham. https://doi.org/10.1007/978-3-319-13416-1_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-13416-1_15
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-13415-4
Online ISBN: 978-3-319-13416-1
eBook Packages: Computer ScienceComputer Science (R0)