Skip to main content

Improving learning achievements, motivations and problem-solving skills through a peer assessment-based game development approach

Educational Technology Research and Development volume 62, pages 129–145 (2014)Cite this article

Abstract

In this study, a peer assessment-based game development approach is proposed for improving students’ learning achievements, motivations and problem-solving skills. An experiment has been conducted to evaluate the effectiveness of the proposed approach in a science course at an elementary school. A total of 167 sixth graders participated in the experiment, 82 of whom were assigned to the experimental group and learned with the peer assessment-based game development approach, while 85 students were in the control group and learned with the conventional game development approach. From the empirical results, it was found that the proposed approach could effectively promote students’ learning achievement, learning motivation, problem-solving skills, as well as their perceptions of the use of educational computer games. Moreover, it was found from the open-ended questions that most of the students perceived peer assessment-based game development as an effective learning strategy that helped them improve their deep learning status in terms of “in-depth thinking,” “creativity,” and “motivation.”

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3

References

  • Ali, A. (2009). A conceptual model for learning to program in introductory programming courses. Informing Science and Information Technology, 6, 517–529.

    Google Scholar 

  • Bouzidi, L., & Jaillet, A. (2009). Can online peer assessment be trusted? Educational Technology & Society, 12(4), 257–268.

    Google Scholar 

  • Bulu, S. T., & Yildirim, Z. (2008). Communication behaviors and trust in collaborative online teams. Educational Technology & Society, 11(1), 132–147.

    Google Scholar 

  • Burguillo, J. C. (2010). Using game theory and competition-based learning to stimulate student motivation and performance. Computers & Education, 55(2), 566–575.

    Article  Google Scholar 

  • Chang, C.-C., & Tseng, K.-H. (2009). Using a web-based portfolio assessment system to elevate project-based learning performances. Interactive Learning Environments, 19(3), 211–230.

    Article  Google Scholar 

  • Chang, C.-C., Tseng, K.-H., Chou, P.-N., & Chen, Y.-H. (2011). Reliability and validity of web-based portfolio peer assessment: A case study for a senior high school’s students taking computer course. Computers & Education, 57(1), 1306–1316.

    Article  Google Scholar 

  • Chen, C.-H. (2010). The implementation and evaluation of a mobile self- and peer-assessment system. Computers & Education, 55(1), 229–236.

    Article  Google Scholar 

  • Chen, N. S., Wei, C. W., Wu, K. T., & Uden, L. (2009). Effects of high level prompts and peer assessment on online learners’ reflection levels. Computers & Education, 52, 283–291.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Dickey, M. D. (2011a). Murder on Grimm Isle: The impact of game narrative design in an educational game-based learning environment. British Journal of Educational Technology 42(3), 456–469.

    Article  Google Scholar 

  • Dickey, M. D. (2011b). World of Warcraft and the impact of game culture and play in an undergraduate game design course. Computers & Education, 56(1), 200–209.

    Article  Google Scholar 

  • Ebner, M., & Holzinger, A. (2007). Successful implementation of user-centered game based learning in higher education: An example from civil engineering. Computers & Education, 49(3), 873–890.

    Article  Google Scholar 

  • Falchikov, N., & Goldfinch, J. (2000). Student peer assessment in higher education: A meta-analysis comparing peer and teacher marks. Review of Educational Research, 70(3), 287–322.

    Article  Google Scholar 

  • Fallows, S., & Chandramohan, B. (2001). Multiple approaches to assessment: Reflections on use of tutor, peer and self-assessment. Teaching in Higher Education, 6(2), 229–246.

    Article  Google Scholar 

  • Fuhrmann, T., Kali, Y., & Hoadley, C. M. (2008). Helping education students understand learning through designing. Educational Technology, 48(2), 26–33.

    Google Scholar 

  • Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441–467.

    Article  Google Scholar 

  • Hayes, E. (2008). Game content creation and it proficiency: An exploratory study. Computers & Education, 51(1), 97–108.

    Article  Google Scholar 

  • Hong, J.-C., & Liu, M.-C. (2003). A study on thinking strategy between experts and novices of computer games. Computers in Human Behaviors, 19(2), 245–258.

    Article  Google Scholar 

  • Hsieh, S. W., Jang, Y. R., Hwang, G. J., & Chen, N. S. (2011). Effects of teaching and learning styles on students’ reflection levels for ubiquitous learning. Computers & Education, 57, 1194–1201.

    Article  Google Scholar 

  • Hung, C. M., Hwang, G. J., & Huang, I. (2012). A Project-based digital storytelling approach to improving students’ learning motivation, problem-solving competence and learning achievement. Educational Technology & Society, 15(4), 368–379.

    Google Scholar 

  • Hwang, G. J., Sung, H. Y., Hung, C. M., & Huang, I. (2012a). Development of a personalized educational computer game based on students’ learning styles. Educational Technology Research and Development, 60(4), 623–638.

    Article  Google Scholar 

  • Hwang, G. J., Sung, H. Y., Hung, C. M., Yang, L. H., & Huang, I. (2012b). A knowledge engineering approach to developing educational computer games for improving students’ differentiating knowledge. British Journal of Educational Technology,. doi:10.1111/j.1467-8535.2012.01285.x.

    Google Scholar 

  • Hwang, G. J., Yang, L. H., & Wang, S. Y. (2013). A concept map-embedded educational computer game for improving students’ learning performance in natural science courses. Computers & Education, 69, 121–130.

    Article  Google Scholar 

  • Jenkins, M. (2004). Unfulfilled promise: Formative assessment using computer-aided assessment. Learning and Teaching in Higher Education, 1, 67–80.

    Google Scholar 

  • Jonassen, D. H., & Carr, C. S. (2000). Mindtools: Affording multiple knowledge representations for learning. In S. P. Lajoie (Ed.), Computers as cognitive tools: No more walls (Vol. 2, pp. 165–196). Hillsdale: Lawlence Erlbaum Associates Inc.

    Google Scholar 

  • Jonassen, D. H., Carr, C., & Yueh, H. P. (1998). Computers as Mindtools for engaging learners in critical thinking. TechTrends, 43(2), 24–32.

    Article  Google Scholar 

  • Kafai, Y. (2006). Playing and making games for learning: Instructionist and constructionist perspectives for game studies. Games and Culture, 1(1), 36–40.

    Article  Google Scholar 

  • Kafai, Y., Ching, C., & Marshall, S. (1997). Children as designers of educational multimedia software. Computers & Education, 29, 117–126.

    Article  Google Scholar 

  • Kiili, K. (2007). Foundation for problem-based gaming. British Journal of Educational Technology, 38(3), 394–404.

    Article  Google Scholar 

  • Li, Q. (2010). Digital game building: Learning in a participatory culture. Educational Research, 52(4), 427–443.

    Article  Google Scholar 

  • Liu, T. Y., & Chu, Y. L. (2010). Using ubiquitous games in an English listening and speaking course: Impact on learning outcomes and motivation. Computers & Education, 55(2), 630–643.

    Article  Google Scholar 

  • Liu, E. Z. F., Lin, S. S. J., Chiu, C. H., & Yuan, S. M. (2001). Web-based peer review: The learner as both adapter and reviewer. IEEE Transaction on Education, 44(3), 246–251.

    Article  Google Scholar 

  • Mak, B., & Coniam, D. (2008). Using wikis to enhance and develop writing skills among secondary school students in Hong Kong. System, 36(3), 437–455.

    Article  Google Scholar 

  • Mayer, R. E., Dyck, J. L., & Vilberg, W. (1986). Learning to program and learning to think: What’s the connection? Communications of ACM, 29(7), 605–610.

    Article  Google Scholar 

  • Mayer, R. E., & Wittrock, R. C. (2006). Problem solving. In P. A. Alexander & P. H. Winne (Eds.), Handbook of educational psychology (pp. 287–304). Mahwah: Erlbaum.

    Google Scholar 

  • Merrill, M. D., & Gibert, C. G. (2008). Effective peer interaction in problem-centered instructional strategy. Distance Education, 29(2), 199–207.

    Article  Google Scholar 

  • Min, H.-T. (2006). The effects of trained peer review on EFL students’ revision types and writing quality. Journal of Second Language Writing, 15(2), 118–141.

    Article  Google Scholar 

  • Moreno-Ger, P., Burgos, D., Martínez-Ortiz, I., Sierra, J. L., & Fernández-Manjón, B. (2008). Educational game design for online education. Computers in Human Behavior, 24(6), 2530–2540.

    Article  Google Scholar 

  • Pan, I. Y. (2001). A Study on the effects of the play-based elementary science teaching . (Unpublished master’s thesis), Taiwan: Taipei Municipal University of Education.

  • Papastergiou, M. (2009). Digital game-based learning in high school computer science education: Impact on educational effectiveness and student motivation. Computers & Education, 52(1), 1–12.

    Article  Google Scholar 

  • Prensky, M. (2001). Digital game-based learning. New York: McGraw Hill.

    Google Scholar 

  • Prensky, M. (2008). Students as designers and creators of educational computer games: Who else? British Journal of Educational Technology, 39(6), 1004–1019.

    Article  Google Scholar 

  • Prins, F. J., Sluijsmans, D. M. A., Kirschner, P. A., & Strijbos, J. W. (2005). Formative peer assessment in a CSCL environment: A case study. Assessment and Evaluation in Higher Education, 30(4), 417–444.

    Article  Google Scholar 

  • Purchase, H. C. (2000). Learning about interface design through peer assessment. Assessment & Evaluation in Higher Education, 25(4), 341–352.

    Article  Google Scholar 

  • Robertson, J., & Howells, C. (2008). Computer game design: Opportunities for successful learning. Computers & Education, 50(2), 559–578.

    Article  Google Scholar 

  • Schmal, V., Grabinski, C. J., & Bowman, S. (2008). Use of games as a learner-centered strategy in gerontology, geriatrics, and aging-related courses. Gerontology & Geriatrics Education, 29(3), 225–233.

    Article  Google Scholar 

  • Su, H. L., & Hsieh, H. Y. (2006). The study of science game incorporated into elementary school natural science and technology instructions on problem-solving ability. Journal of Scientific and Technological Studies, 40(1), 47–68.

    Google Scholar 

  • Sung, H. Y., & Hwang, G. J. (2013). A collaborative game-based learning approach to improving students’ learning performance in science courses. Computers & Education, 63(1), 43–51.

    Article  Google Scholar 

  • Tarkan, S., Sazawal, V., Druin, A., Foss, E., Golub, E., Hatley, L., Khatri, T., Massey, S., Walsh, G., & Torres, G. (2009). Designing a Novice Programming Environment with Children. Poster session of 40th Annual SIGCSE Technical Symposium.

  • Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249–276.

    Article  Google Scholar 

  • Towler, L., & Broadfoot, P. (1992). Self-assessment in the primary school. Educational Review, 44(2), 137–151.

    Article  Google Scholar 

  • Triantafyllakos, G., Palaigeorgiou, G., & Tsoukalas, I. A. (2011). Designing educational software with students through collaborative design games: The We!Design&Play framework. Computers & Education, 56(1), 227–242.

    Article  Google Scholar 

  • Tsai, C.-C., & Liang, J.-C. (2009). The development of science activities via on-line peer assessment: The role of scientific epistemological views. Instructional Science, 37(3), 293–310.

    Article  Google Scholar 

  • Tsivitanidou, O. E., Zacharia, Z. C., & Hovardas, T. (2011). Investigating secondary school students’ unmediated peer assessment skills. Learning and Instruction, 21(4), 506–519.

    Article  Google Scholar 

  • Tuan, H. L., Chin, C. C., & Shieh, S. H. (2005). The development of a questionnaire to measure students’ motivation towards science learning. International Journal of Science Education, 27(6), 639–654.

    Article  Google Scholar 

  • Tuzun, H., Meryem, Y. S., Karakus, T., Inal, Y., & Kızılkaya, G. (2009). The effects of computer games on primary school students’ achievement and motivation in geography learning. Computers & Education, 52(1), 68–77.

    Article  Google Scholar 

  • van den Boom, G., Paas, F., & van Merriënboer, J. G. (2007). Effects of elicited reflections combined with tutor or peer feedback on self-regulated learning and learning outcomes. Learning and Instruction, 17(5), 532–548.

    Article  Google Scholar 

  • Villalta, M., Gajardo, I., Nussbaum, M., Andreu, J. J., Echeverría, A., & Plass, J. L. (2011). Design guidelines for classroom multiplayer presential games. Computers & Education, 57(3), 2039–2053.

    Article  Google Scholar 

  • Wang, M. J. (2004). A study on online peer feedback. English Teaching & Learning, 29(2), 63–77.

    Google Scholar 

  • Wen, M. L., & Tsai, C.-C. (2008). Online peer assessment in an inservice science and mathematics teacher education course. Teaching in Higher Education, 13(1), 55–67.

    Article  Google Scholar 

  • Xiao, Y., & Lucking, R. (2008). The impact of two types of peer assessment on students’ performance and satisfaction within a Wiki environment. The Internet and Higher Education, 11(3–4), 186–193.

    Article  Google Scholar 

  • Yang, M., Badger, R., & Yu, Z. (2006). A comparative study of peer and teacher feedback in a Chinese EFL writing class. Journal of Second Language Writing, 15(3), 179–200.

    Article  Google Scholar 

  • Yang, Y.-F., & Tsai, C.-C. (2010). Conceptions of and approaches to learning through online peer assessment. Learning and Instruction, 20(1), 72–83.

    Article  Google Scholar 

  • Yien, J. M., Hung, C. M., Hwang, G. J., & Lin, Y. C. (2011). A game-based learning approach to improving students’ learning achievements in a nutrition course. Turkish Online Journal of Educational Technology, 10(2), 1–10.

    Google Scholar 

Download references

Acknowledgments

This study is supported in part by the National Science Council of the Republic of China under contract number NSC 101-2511-S-011-005-MY3 and NSC 100-2511-S-110-001-MY3.

Author information

Authors and Affiliations

  1. Graduate Institute of Digital Learning and Education, National Taiwan University of Science and Technology, 43, Sec. 4, Keelung Rd., Taipei, 106, Taiwan

    Gwo-Jen Hwang

  2. Tainan Municipal Haidong Elementary School, No. 381, Sec. 3, Anjhong Rd., Annan District, T’ainan, 70960, Taiwan

    Chun-Ming Hung

  3. Department of Information Management, National Sun Yat-Sen University, 70, Lienhai Rd., Kaohsiung, 80424, Taiwan

    Nian-Shing Chen

Authors
  1. Gwo-Jen Hwang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chun-Ming Hung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nian-Shing Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gwo-Jen Hwang.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Hwang, GJ., Hung, CM. & Chen, NS. Improving learning achievements, motivations and problem-solving skills through a peer assessment-based game development approach. Education Tech Research Dev 62, 129–145 (2014). https://doi.org/10.1007/s11423-013-9320-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11423-013-9320-7

Keywords

  • Digital game-based learning
  • Peer assessment
  • Learning motivation
  • Learning achievement
  • Game development