Advertisement

Journal of Computing in Higher Education

, Volume 27, Issue 2, pp 114–133 | Cite as

Employing self-assessment, journaling, and peer sharing to enhance learning from an online course

  • Wu-Yuin Hwang
  • Jung-Lung Hsu
  • Rustam Shadiev
  • Chia-Ling Chang
  • Yueh-Min Huang
Article

Abstract

This study explored the use of self-assessments, journaling, and peer sharing in an online computer programming course. We conducted an experiment using a pretest–intervention–posttest design in which 64 undergraduate first-year students participated. We aimed to investigate whether self-assessment, journaling, and peer sharing can facilitate students’ learning. Moreover, we examined how the research variables related to each other and to learning achievement. Therefore, after the experiment, (1) prior knowledge, learning performance, and achievement were assessed, (2) online logs representing learning behaviors were analyzed, and (3) students were interviewed. Results demonstrated that self-assessment, journaling, and peer sharing effectively facilitated learning and students’ cognition regulation strategies. Namely, keeping a learning journal enabled students to summarize key concepts, elaborate ideas, and reflect on learning material; self-assessment allowed students to reflect on their understanding of the material under study; and peer sharing enabled students to study peers’ learning journals and self-assessments to improve their own. Although self-assessment, journaling, and peer sharing significantly correlated with each other and with learning achievement, results showed that keeping a learning journal had the strongest effect on learning achievement. Moreover, self-assessment and keeping a learning journal complemented each other and combining the two resulted in even higher learning achievement scores. The findings suggest that the use of self-assessment, journaling, and peer sharing show promise to facilitate learning from an online course.

Keywords

Self-assessment Journaling Peer sharing Web-based learning Regulation of cognition 

Notes

Acknowledgments

This research is partially supported by the Ministry of Science and Technology, Taiwan, R.O.C. under Grant Nos. MOST 104-2911-I-003-301, MOST 103-2511-S-008-017-MY3, MOST 103-2511-S-006-007-MY3, MOST 103-2511-S-006-002-MY3, NSC 101-2511-S-008-012-MY3, and NSC 101-2511-S-008-013-MY3. The authors would like to thank anonymous reviewers and Dr. MJ Bishop, Editor-in-Chief of Journal of Computing in Higher Education for their valuable comments and suggestions on this manuscript.

References

  1. Akyol, Z., & Garrison, D. R. (2011). Assessing metacognition in an online community of inquiry. Internet and Higher Education, 14(3), 183–190.CrossRefGoogle Scholar
  2. Alessi, S. M., & Trollip, S. R. (2001). Multimedia for learning: Methods and development. Needham Heights, Massachusetts: Allyn & Bacon.Google Scholar
  3. Anderson, W., & Krathwohl, D. R. (Eds.). (2001). A taxonomy for learning, teaching, and assessment: A revision of Blooms’ educational objectives. New York, NY: Longman.Google Scholar
  4. A.nnotate (2012). User guides: A.nnotate. Retrieved September 10, 2012, from http://a.nnotate.com/userguide.html
  5. Artino, A. R. (2009). Think, feel, act: Motivational and emotional influences on military students’ online academic success. Journal of Computing in Higher Education, 21(2), 146–166.CrossRefGoogle Scholar
  6. Berthold, K., Nückles, M., & Renkl, A. (2007). Do learning protocols support learning strategies and outcomes? The role of cognitive and metacognitive prompts. Learning and Instruction, 17(5), 564–577.CrossRefGoogle Scholar
  7. Bloom, B. S. (1956). Taxonomy of educational objectives: The classification of educational goals, Handbook I: Cognitive domain. New York: Longman, Green.Google Scholar
  8. Chang, C. C., Tseng, K. H., & Liang, C. (2014). Is reflection performance correlated to the learning effect in a web-based portfolio assessment environment for middle school students? The Asia-Pacific Education Researcher, 23(1), 73–82.CrossRefGoogle Scholar
  9. Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2013). Applied multiple regression/correlation analysis for the behavioral sciences. London: Routledge.Google Scholar
  10. Crews, T., & Butterfield, J. (2002). Using technology to bring abstract concepts into focus: A programming case study. Journal of Computing in Higher Education, 13(2), 25–50.CrossRefGoogle Scholar
  11. García-Beltrán, A., & Martínez, R. (2006). Web assisted self-assessment in computer programming learning using AulaWeb. International Journal of Engineering Education, 22(5), 1063–1069.Google Scholar
  12. Hara, N., & Kling, R. (2001). Student distress in web-based distance education. Educause Quarterly, 3, 68–69.Google Scholar
  13. Hicks, D. (2003). Supporting personalization and customization in a collaborative setting. Computers in Industry, 52(1), 71–79.CrossRefGoogle Scholar
  14. Huang, Y. M., Chen, M. Y., & Mo, S. S. (2015). How do we inspire people to contact aboriginal culture with Web2.0 technology? Computers & Education, 86, 71–83.CrossRefGoogle Scholar
  15. Huang, Y. M., Huang, S. H., & Wu, T. T. (2014). Embedding diagnostic mechanisms in a digital game for learning mathematics. Educational Technology Research and Development, 62(2), 187–207.CrossRefGoogle Scholar
  16. Hutcheson, G. D., & Sofroniou, N. (1999). The multivariate social scientist: Introductory statistics using generalized linear models. London: Sage.Google Scholar
  17. Hwang, W. Y., Chen, N. S., Shadiev, R., & Li, J. S. (2011a). Effects of reviewing annotations and homework solutions on math learning achievement. British Journal of Educational Technology, 42(6), 1016–1028.CrossRefGoogle Scholar
  18. Hwang, W. Y., Shadiev, R., & Huang, S. M. (2011b). A study of a multimedia web annotation system and its effect on the EFL writing and speaking performance of junior high school students. ReCALL, 23(2), 160–180.CrossRefGoogle Scholar
  19. Hwang, W. Y., Shadiev, R., Wang, C. Y., & Huang, Z. H. (2012). A pilot study of cooperative programming learning behavior and its relationship with students’ learning performance. Computers & Education, 58(4), 1267–1281.CrossRefGoogle Scholar
  20. Hwang, W. Y., Wang, C. Y., Hwang, G. J., Huang, Y. M., & Huang, S. (2008). A web-based programming learning environment to support cognitive development. Interacting with Computers, 20(6), 524–534.CrossRefGoogle Scholar
  21. Lee, C. B. (2013). Examining intentional knowing among secondary school students: Through the lens of metacognition. The Asia-Pacific Education Researcher, 22(1), 79–90.CrossRefGoogle Scholar
  22. Martin, W. E., & Bridgmon, K. D. (2012). Quantitative and statistical research methods: From hypothesis to results. San Francisco, CA: Wiley.Google Scholar
  23. Matlock-Hetzel, S. (1997). Basic concepts in item and test analysis (pp. 1–22). San Antonio: Annual Meeting of the Southwest Educational Research Association.Google Scholar
  24. Milford, T., & Brown, L. (2010). The role of self-assessment in the preparation of pre-service teachers. Journal of Educational Practices, 8(1), 47–58.Google Scholar
  25. Moon, J. (2010). Learning journals and logs. UCD Teaching and Learning Resources. Retrieved from http://www.ucd.ie/t4cms/ucdtla0035.pdf
  26. Nilson, L. B. (2010). Teaching at its best: A research-based resource for college instructors. San-Francisco, CA: Wiley.Google Scholar
  27. Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19(4), 460–475.CrossRefGoogle Scholar
  28. Shadiev, R., Hwang, W. Y., Chen, N. S., & Huang, Y. M. (2014a). Review of speech-to-text recognition technology for enhancing learning. Journal of Educational Technology and Society, 17(4), 65–84.Google Scholar
  29. Shadiev, R., Hwang, W. Y., & Huang, Y. M. (2015). A pilot study of facilitating cross-cultural understanding with project-based collaborative learning activity in online environment. Australasian Journal of Educational Technology, 31(2), 123–139.Google Scholar
  30. Shadiev, R., Hwang, W. Y., Yeh, S. C., Yang, S. J. H., Wang, J. L., Lin, H., & Hsu, G. L. (2014b). Effects of unidirectional vs. reciprocal teaching strategies on web-based computer programming learning. Journal of Educational Computing Research, 50(1), 67–95.CrossRefGoogle Scholar
  31. Sperling, R. A., Howard, B. C., Miller, L. A., & Murphy, C. (2002). Measures of children’s knowledge and regulation of cognition. Contemporary Educational Psychology, 27(1), 51–79.CrossRefGoogle Scholar
  32. Truong, N., Bancroft, P., & Roe, P. (2003). A web based environment for Learning to program. In Proceeding of the 26th Annual Conference of ACSC, (pp. 255–264).Google Scholar
  33. Vatton, I., Quint, V., Kahan, J., Cramer, K., Nylander, K., & Rosen, K. et al. (2012). Amaya user manual. Retrieved September 10, 2012 from http://www.w3.org/Amaya/Distribution/manual.pdf
  34. Wong, B. Y. L., Kuperis, S., Jamieson, D., Keller, L., & Cull-Hewitt, R. (2002). Effects of guided journal writing on students’ story understanding. Journal of Educational Research, 95(3), 179–191.CrossRefGoogle Scholar
  35. Zandieh, Z., & Jafarigohar, M. (2012). The effects of hypertext gloss on comprehension and vocabulary retention under incidental and intentional learning conditions. English Language Teaching, 5(6), 60–71.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Wu-Yuin Hwang
    • 1
  • Jung-Lung Hsu
    • 2
  • Rustam Shadiev
    • 3
  • Chia-Ling Chang
    • 1
  • Yueh-Min Huang
    • 3
  1. 1.Graduate Institute of Network Learning TechnologyNational Central UniversityJhongliTaiwan, ROC
  2. 2.Department of Information ManagementKainan UniversityLuchuTaiwan, ROC
  3. 3.Department of Engineering ScienceNational Cheng Kung UniversityTainanTaiwan, ROC

Personalised recommendations