Skip to main content
SpringerLink
Log in

Measurement and Analysis of Learner’s Motivation in Game-Based E-Learning

  • Chapter
  • First Online:
Assessment in Game-Based Learning

Abstract

Computer games started to be integrated in the learning process in order to bridge the gap between the new learner generation and the traditional learning process. However, today’s game-based e-learning environments do not provide different types of adaptation, with learners receiving mostly “one size fits all” educational games despite the existing differences between them in terms of learner knowledge, motivation, etc. In this context, game-based e-learning can lead to demotivated learners. Therefore, there is a need for adaptation strategies. In order to make adaptation possible, real-time assessment of the game-play process as well as of the learning process is needed. Since learner motivation plays an important role in both the learning and the gaming process, and can easily change, new techniques for automated assessment of learner motivation are needed. This chapter presents current trends in game-based e-learning assessment in general focusing on the assessment of learner motivation in particular. Methods for gathering information on player/learner motivation are also presented. Information on learner motivation can be gathered (1) through dialog-based interaction, (2) through game-play-based interaction and/or (3) through additional equipment. This chapter also proposes four generic metrics for the measurement and analysis of motivation in game-based e-learning based on metrics that were used in e-learning. Each metric is presented and its usage and interpretation in gaming-based e-learning are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Aleven, V., Myers, E., Easterday, M., & Ogan, A. (2010). Toward a framework for the analysis and design of educational games. In Proceeding of IEEE third international conference on digital game and intelligent toy enhanced learning (pp. 69–76), Los Alamitos, CA.

    Google Scholar 

  • Arroyo, I., Ferguson, K., Johns, J., Dragon, T., Meheranian, H., Fisher, D., et al. (2007). Repairing disengagement with non-invasive interventions. In R. Luckin, K. R. Koedinger, & J. Greer (Eds.), Proceeding of the 2007 conference on artificial intelligence in education: Building technology rich learning contexts that work (pp. 195–202). Amsterdam, The Netherlands: IOS.

    Google Scholar 

  • Baker, R. S. J. D., Mitrović, A., & Mathews, M. (2010). Detecting gaming the system in constraint-based tutors. In P. de Bra, A. Kobsa, & D. Chin (Eds.), User modeling, adaptation, and personalization, Proceedings of the 18th international conference, UMAP 2010. Notes in computer science, 6075/2010 (pp. 267–278). Berlin, Germany: Springer.

    Google Scholar 

  • Bandura, A. (1994). Self-efficacy. In V. S. Ramachaudran (Ed.), Encyclopedia of human behaviour (pp. 71–81). New York, NY: Academic.

    Google Scholar 

  • Bandura, A. (2006). Guide for constructing self-efficacy scales. In T. Urdan & F. Pojares (Eds.), Self-efficacy beliefs of adolescents (Vol. 5, pp. 307–337). Charlotte: Information Age Publishing.

    Google Scholar 

  • Bernard, R. R. S., & Cannon, H. M. (2011). Exploring motivation: Using emoticons to map student motivation in a business game exercise. Developments in Business Simulation and Experiential Learning, 38, 229–240.

    Google Scholar 

  • Bica, F., Verdin, R., & Vicari, R. M. (2006). Towards cognitive modeling of students’ self-efficacy. In Proceedings of 6th international conference on advanced learning technologies, ICALT2006 (pp. 1017–1021). Washington, DC: IEEE Computer Society.

    Google Scholar 

  • Breuer, J. S., & Bente, G. (2010). Why so serious? On the relation of serious games and learning. Eludamos. Journal for Computer Game Culture, 4(1), 7–24.

    Google Scholar 

  • Burgos, D., Moreno-Ger, P., Sierra, J. L., Fernández-Manjón, B., Specht, M., & Koper, R. (2008). Building adaptive game-based learning resources: The integration of IMS learning design and. Simulation & Gaming, 39(3), 414–431.

    Article  Google Scholar 

  • Chang, Y.-C., Chen, K.-T., Wu, C.-C., Ho, C.-J., & Lei, C.-L. (2010). Online game QoE evaluation using paired comparisons. Presented at the 2010 IEEE international workshop technical committee on communications quality and reliability (CQR 2010) (p. 6), Vancouver, BC.

    Google Scholar 

  • Chen, Z.-H., & Chan, T.-W. (2008). Learning by substitutive competition: Nurturing my-pet for game competition based on open learner model. In Proceedings of the second IEEE international conference on digital games and intelligent (pp. 124–131), Big Island, HI.

    Google Scholar 

  • Cocea, M., & Weibelzahl, S. (2009). Log file analysis for disengagement detection in e-learning environments. User Modelling and User-Adapted Interaction, 19(4), 341–385.

    Article  Google Scholar 

  • Cocea, M., & Weibelzahl, S. (2011). Disengagement detection in on-line learning: Validation studies and perspectives. IEEE Transactions on Learning Technologies, 4(2), 114–124.

    Article  Google Scholar 

  • Conati, C., & Maclaren, H. (2009). Modeling user affect from causes and effects. In G.-J. Houben, G. McCalla, F. Pianesi, & M. Zancanaro (Eds.), Proceedings of the 17th international conference on user modeling, adaptation, and personalization. Lectures notes in computer science (Vol. 5535, pp. 4–15). Berlin, Germany: Springer.

    Google Scholar 

  • Conlan, O., Hampson, C., Peirce, N., & Kickmeier-Rust, M. (2009). Realtime knowledge space skill assessment for personalized digital educational games. In Proceedings of 2009 ninth IEEE international conference on advanced learning technologies (pp. 538–542), Riga, Latvia.

    Google Scholar 

  • Connolly, T. M., & Stanfield, M. (2006). Using games-based eLearning technologies in overcoming difficulties in teaching information systems. Journal of Information Technology Education, 5, 459–476.

    Google Scholar 

  • Connolly, T. M., & Stansfield, M. (2011). From E-learning to games-based E-learning. In Information Resources Management Association, USA (Ed.), Gaming and simulations: Concepts, methodologies, tools and applications (pp. 1763–1773). Hershey, PA: IGI Global.

    Google Scholar 

  • Connolly, T. M., Stansfield, M., & Hainey, T. (2011). An alternate reality game for language learning: ARGuing for multimodal motivation. Computers & Education, 57(1), 1389–1415.

    Article  Google Scholar 

  • Costagliola, G., De Rosa, M., Fuccella, V., Capuano, N., & Ritrovato. P. (2010). A novel approach for attention management in e-learning systems. In proceedings of distributed multimedia ­systems (DMS) (pp. 222–227). Skokie, Illinois, USA: Knowledge Systems Institute, ISBN/ISSN: 1-891706-28-4.

    Google Scholar 

  • de Freitas, S., & Oliver, M. (2006). How can exploratory learning with games and simulations within the curriculum be most effectively evaluated? Computers and Education, 46(3), 249–264.

    Article  Google Scholar 

  • de Freitas, S., Rebolledo-Mendez, G., Liarokapis, F., Magoulas, G., & Poulovassilis, A. (2010). Learning as immersive experiences: Using the four-dimensional framework for designing and evaluating immersive learning experiences in a virtual world. British Journal of Educational Technology, 4(1), 69–85.

    Article  Google Scholar 

  • de Vicente, A. (2003). Towards tutoring systems that detect students’ motivation: An investigation. Ph.D. thesis, University of Edinburg, Edinburg.

    Google Scholar 

  • de Vicente, A., & Pain, H. (2002). Informing the detection of the students’ motivational state: An empirical study. In S. A. Cerri, G. Gouarderes, & F. Paraguacu (Eds.), Proceedings of the 6th international conference on intelligent tutoring systems (pp. 79–86). London: Springer.

    Google Scholar 

  • Derbali, L., Chalfoun, P., & Frasson, C. (2011). A theoretical and empirical approach in assessing motivational factors: From serious games to an ITS. In R. C. Murray & P. M. McCarthy (Eds.), Proceedings of the twenty-fourth international Florida artificial intelligence research society conference 2011 (pp. 513–518). Palm Beach, FL: AAAI.

    Google Scholar 

  • Derbali, L., & Frasson, C. (2010). Prediction of players motivational states using electrophysiological measures during serious game play. In Proceedings of 2010 IEEE 10th international conference on advanced learning technologies (ICALT) (pp. 498–502), Sousse, Tunisia.

    Google Scholar 

  • Diah, N. M., Ismail, M., Ahmad, S., & Dahari, M. K. M. (2010). Usability testing for educational computer game using observation method. In 2010 international conference on information retrieval & knowledge management (CAMP) (pp. 157–161), Shah Alam, Selangor.

    Google Scholar 

  • Fu, F.-L., Su, R.-C., & Yu, S.-C. (2009). EGameFlow: A scale to measure learners’ enjoyment of e-learning games. Computers & Education, 52(1), 101–112.

    Article  Google Scholar 

  • Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441–467.

    Article  Google Scholar 

  • Gee, J. P., & Shaffer, D. W. (2010). Looking where the light is bad: Video games and the future of assessment. EDge: The Latest Information for the Education Practitioner, 6(1), 1–27.

    Google Scholar 

  • Ghergulescu, I., & Muntean, C. H. (2010). Assessment of motivation in games based e-learning. In Proceeding of IADIS international conference cognition and exploratory learning in digital age (pp. 71–78), Timisoara, Romania.

    Google Scholar 

  • Hershkovitz, A., & Nachmias, R. (2008). Developing a log-based motivation measuring tool. Educational Data Mining, 2008(5), 226–233.

    Google Scholar 

  • Hong, J.-C., Cheng, C.-L., Hwang, M.-Y., Lee, C.-K., & Chang, H.-Y. (2009). Assessing the educational values of digital games. Journal of Computer Assisted Learning, 25(5), 423–437.

    Article  Google Scholar 

  • Huang, W.-H., Huang, W.-Y., & Tschopp, J. (2010). Sustaining iterative game playing processes in DGBL: The relationship between motivational processing and outcome processing. Computers & Education, 55, 789–797.

    Article  Google Scholar 

  • Ifenthaler, D., Eseryel, D., & Ge, X. (2011). Origins of game-based assessment. In D. Ifenthaler, D. Eseryel, & X. Ge (Eds.), Assessment in game-based learning: Foundations, innovations, and perspectives. New York: Springer.

    Google Scholar 

  • IMI. (2008). Retrieved Sept 15 2011, from http://www.psych.rochester.edu/SDT/measures/IMI_description.php.

  • Johns, J., & Woolf, B. (2006). A dynamic mixture model to detect student motivation and proficiency. In A. Cohn (Ed.), Proceeding of AAAI’06 21st national conference on artificial intelligence (pp. 163–168). Menlo Park, CA: AAAI Press.

    Google Scholar 

  • Kebritchi, M., Hirumi, A., & Bai, H. (2010). The effects of modern mathematics computer games on mathematics achievement and class motivation. Computers & Education, 55(2), 427–443.

    Article  Google Scholar 

  • Keller, J. M. (1987). Development and use of the ARCS model of motivational design. Instructional Development, 10, 2–10.

    Article  Google Scholar 

  • Khan, F. A., Graf, S., Weippl, E. R., & Tjoa, A. M. (2009). An approach for identifying affective states through behavioral patterns in web-based learning management systems. In Proceedings of the 11th international conference on information integration and web-based applications & services, iiWAS’09 (pp. 431–435), Kuala Lumpur.

    Google Scholar 

  • Khan, F. A., Graf, S., Weippl, E. R., & Tjoa, A. M. (2010). Implementation of affective states and learning styles tactics in web-based learning management systems. In Proceedings of the 2010 10th IEEE international conference on advanced learning technologies (pp. 734–735), Sousse, Tunisia.

    Google Scholar 

  • Khan, F. A., Weippl, E. R., & Tjoa, A. M. (2009). Integrated approach for the detection of learning styles and affective states. In World conference on educational multimedia, hypermedia and telecommunications (Vol. 1, pp. 753–761) Chesapeake, VA: AACE.

    Google Scholar 

  • Kim, Y. S., Cha, H. J., Cho, Y. R., Yoon, T. B., & Lee, J.-H. (2007). An intelligent tutoring system with motivation diagnosis and planning. In 15th international conference on computers in education, Hiroshima. Retrieved April 20, 2011, from http://credits.skku.edu/credits/publications/ICCE2007_Poster.pdf

  • Koidl, K., Mehm, F., Hampson, C., Conlan, O., & Göbel, S. (2010). Dynamically adjusting digital educational games towards learning objectives. In B. Meyer (Ed.), Proceedings 4th European conference on games based learning, Copenhagen, Denmark (pp. 177–185). Reading: Academic.

    Google Scholar 

  • Kuipers, F., Kooij, R., De Vleeschauwer, D., & Brunnström, K. (2010). Techniques for measuring quality of experience. In Wired/wireless internet communications. Lecture notes in computer science (Vol. 6074, pp. 216–227). Berlin: Springer.

    Google Scholar 

  • Levac, D., Pierrynowski, M. R., Canestraro, M., Gurr, L., Leonard, L., & Neeley, C. (2010). Exploring children’s movement characteristics during virtual reality video game play. Human Movement Science, 29(6), 1023–1038.

    Article  Google Scholar 

  • Lin, H.-H., Wang, C.-Y., & Wei, H.-Y. (2010). Improving online game performance over IEEE 802.11n networks. Presented at the 2010 9th annual workshop on network and systems support for games (NetGames) (p. 2), Taipei, Taiwan.

    Google Scholar 

  • Liu, T.-Y., & Chu, Y.-L. (2010). Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation. Computers & Education, 55(2), 630–643.

    Article  Google Scholar 

  • Mattheiss, E., Kickmeier-Rust, M. D., Steiner, C. M., & Albert, D. (2010). Approaches to detect discouraged learners: Assessment of motivation in educational computer games. In S. Hambach, A. Martens, D. Tavangarian, & B. Urban (Eds.), Proceedings of eLearning Baltics (eLBa) (p. 10). Rostock: Fraunhofer.

    Google Scholar 

  • McQuiggan, S. W., Mott, B. W., & Lester, J. C. (2008). Modeling self-efficacy in intelligent tutoring systems: An inductive approach. User Modeling and User-Adapted Interaction, 18(1–2), 81–123.

    Article  Google Scholar 

  • McQuiggan, S. W., Robison, J. L., & Lester, J. C. (2010). Affective transitions in narrative-centered learning environments. Educational Technology & Society, 13(1), 40–53.

    Google Scholar 

  • Miller, L. M., Chang, C.-I., Wang, S., Beier, M. E., & Klisch, Y. (2011). Learning and motivational impacts of a multimedia science game. Computers & Education, 57(1), 1425–1433.

    Article  Google Scholar 

  • Moreno-Ger, P., Torrente, J., Bustamante, J., Fernández-Galaz, C., Fernández-Manjón, B., & Comas-Rengifo, M. D. (2010). Application of a low-cost web-based simulation to improve students’ practical skills in medical education. International Journal of Medical Informatics, 79(6), 459–467.

    Article  Google Scholar 

  • Muñoz, K., Kevitt, P. M., Lunney, T., Noguez, J., & Neri, L. (2011). An emotional student model for game-play adaptation. Entertainment Computing, 2(2), 133–141.

    Article  Google Scholar 

  • Munoz-Organero, M., Munoz-Merino, P. J., & Kloos, C. D. (2010). Student behavior and interaction patterns with an LMS as motivation predictors in E-learning settings. IEEE Transactions on Education, 53(3), 463–470.

    Article  Google Scholar 

  • Papastergiou, M. (2009). Exploring the potential of computer and video games for health and physical education: A literature review. Computers & Education, 53, 603–622.

    Article  Google Scholar 

  • Prensky, M. (2001). The digital game-based learning revolution. In M. Prensky (Ed.), Digital game-based learning (1st ed.). New York: McGraw-Hill.

    Google Scholar 

  • Qu, L., Wang, N., & Johnson, W. L. (2005). Using learner focus of attention to detect learner motivation factors. In L. Ardissono, P. Brna, A. Mitrovic (Eds.), Proceedings of the 10th international conference, user modelling 2005, Edinburgh, Scotland. Lectures notes in computer science (Vol. 3538, pp. 70–73). Berlin, Germany: Springer.

    Google Scholar 

  • Rebolledo-Mendez, G., de Freitas, S., Rojano-Caceres, R., & Gaona-Garcia, A. R. (2010). An empirical examination of the relation between attention and motivation in computer-based ­education: A modeling approach. In H. W. Guesgen & R. C. Murray (Eds.), Proceedings of the twenty-third international Florida artificial intelligence research society conference 2010, Daytona Beach, FL, USA (pp. 74–79). Menlo Park, CA: AAAI.

    Google Scholar 

  • Renshaw, T., Stevens, R., & Denton, P. (2009). Towards understanding engagement in games: An eye-tracking study. On the Horizon, 17(4), 408–420.

    Article  Google Scholar 

  • Ryan, R., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American psychologist, 55(1), 68–78.

    Article  Google Scholar 

  • Sancho, P., & Fernandez-Manjon, B. (2010). Experiences in using a MUVE for enhancing motivation in engineering education. In Proceedings of IEEE EDUCON 2010 conference (pp. 775–782), Madrid, Spain.

    Google Scholar 

  • Shih, J.-L., Shih, B.-J., Shih, C.-C., Su, H.-Y., & Chuang, C.-W. (2010). The influence of collaboration styles to children’s cognitive performance in digital problem-solving game “William Adventure”: A comparative case study. Computers & Education, 55(3), 982–993.

    Article  Google Scholar 

  • Shute, V. J. (2009). Simply assessment. International Journal of Learning and Media, 1(2), 1–11.

    Article  Google Scholar 

  • Shute, V. J., Masduki, I., & Donmez, O. (2010). Conceptual framework for modeling, assessing, and supporting competencies within game environments. Technology, Instruction, Cognition, and Learning, 8(2), 137–161.

    Google Scholar 

  • Shute, V. J., Ventura, M., Bauer, M., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfeld, M. J. Cody, & P. Vorderer (Eds.), Serious games: Mechanisms and effects (pp. 295–321). Mahwah, NJ: Routledge.

    Google Scholar 

  • Steinkuehler, C., & King, E. (2009). Digital literacies for the disengaged: Creating after school contexts to support boys’ game-based literacy skills. On the Horizon, 17(1), 47–59.

    Article  Google Scholar 

  • Takatalo, J., Hakkinen, J., Kaistinen, J., & Nyman, G. (2007). Measuring user experience in digital gaming: Theoretical and methodological issues. In L. C. Cui & Y. Miyake (Eds.), Proceedings of SPIE: Image quality and system performance IV (Vol. 6494, pp. 1–13). San Jose, CA: SPIE.

    Google Scholar 

  • Takatalo, J., Häkkinen, J., Kaistinen, J., & Nyman, G. (2010). Presence, involvement, and flow in digital games. In R. Bernhaupt (Ed.), Evaluating user experience in games (pp. 23–46). London: Springer.

    Chapter  Google Scholar 

  • Takatalo, J., Häkkinen, J., Kaistinen, J., & Nyman, G. (2011). User experience in digital games: Differences between laboratory and home. Simulation & Gaming, 42, 656–673.

    Google Scholar 

  • Tang, S., Hanneghan, M., & El Rhalibi, A. (2009). Introduction to games-based learning. In T. Connolly, M. Stansfield, & L. Boyle (Eds.), Games-based learning advancements for multi-sensory human computer interfaces (pp. 1–17). Hershey, PA: IGI Global.

    Google Scholar 

  • Tüzün, H., YIlmaz-Soylu, M., Karakus, T., Inal, Y., & KIzIlkaya, G. (2009). The effects of computer games on primary school students’ achievement and motivation in geography learning. Computers & Education, 52(1), 68–77.

    Article  Google Scholar 

  • Vos, N., van der Meijden, H., & Denessen, E. (2011). Effects of constructing versus playing an educational game on student motivation and deep learning strategy use. Computers & Education, 56(1), 127–137.

    Article  Google Scholar 

  • Wilson, K. A., Bedwell, W. L., Lazzara, E. H., Salas, E., Burke, C. S., Estock, J. L., et al. (2009). Relationships between game attributes and learning outcomes. Simulation & Gaming, 40(2), 217–266.

    Article  Google Scholar 

  • Woolf, B. P., Arroyo, I., Muldner, K., Burleson, W., Cooper, D. G., Dolan, R., et al. (2010). The effect of motivational learning companions on low achieving students and students with disabilities. In V. Aleven, J. Kay, & J. Mostow (Eds.), Proceeding of intelligent tutoring systems (pp. 327–337). Berlin: Springer.

    Chapter  Google Scholar 

  • Yue, W. S., & Zin, N. A. M. (2009). Usability evaluation for history educational games. In Proceedings of the 2nd international conference on interaction sciences: Information technology, culture and human, ICIS’09, Busan, Korea (pp. 1019–1025). New York, NY: ACM.

    Google Scholar 

Download references

Acknowledgement

This research work is supported by IRCSET Embark Postgraduate Scholarship Scheme, Ireland.

Author information

Authors and Affiliations

  1. School of Computing, National College of Ireland, Mayor Street, IFSC, Dublin 1, Ireland

    Ioana Ghergulescu & Cristina Hava Muntean

Authors
  1. Ioana Ghergulescu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Cristina Hava Muntean
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ioana Ghergulescu .

Editor information

Editors and Affiliations

  1. , Fakultät für Sozialwissenschaften, University of Mannheim, Gebaudeteil B A5,6, Mannheim, 68131, Baden-Württemberg, Germany

    Dirk Ifenthaler

  2. , College of Education, University of Oklahoma, Van Vleet Oval 820, Norman, 73019, Oklahoma, USA

    Deniz Eseryel

  3. Van Fleet Oval 820, Norman, 73019, Oklahoma, USA

    Xun Ge

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer Science+Business Media New York

About this chapter

Cite this chapter

Ghergulescu, I., Muntean, C.H. (2012). Measurement and Analysis of Learner’s Motivation in Game-Based E-Learning. In: Ifenthaler, D., Eseryel, D., Ge, X. (eds) Assessment in Game-Based Learning. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-3546-4_18

Download citation

Publish with us

Policies and ethics

Search

Navigation