Employing self-assessment, journaling, and peer sharing to enhance learning from an online course
- 653 Downloads
- 4 Citations
Abstract
This study explored the use of self-assessments, journaling, and peer sharing in an online computer programming course. We conducted an experiment using a pretest–intervention–posttest design in which 64 undergraduate first-year students participated. We aimed to investigate whether self-assessment, journaling, and peer sharing can facilitate students’ learning. Moreover, we examined how the research variables related to each other and to learning achievement. Therefore, after the experiment, (1) prior knowledge, learning performance, and achievement were assessed, (2) online logs representing learning behaviors were analyzed, and (3) students were interviewed. Results demonstrated that self-assessment, journaling, and peer sharing effectively facilitated learning and students’ cognition regulation strategies. Namely, keeping a learning journal enabled students to summarize key concepts, elaborate ideas, and reflect on learning material; self-assessment allowed students to reflect on their understanding of the material under study; and peer sharing enabled students to study peers’ learning journals and self-assessments to improve their own. Although self-assessment, journaling, and peer sharing significantly correlated with each other and with learning achievement, results showed that keeping a learning journal had the strongest effect on learning achievement. Moreover, self-assessment and keeping a learning journal complemented each other and combining the two resulted in even higher learning achievement scores. The findings suggest that the use of self-assessment, journaling, and peer sharing show promise to facilitate learning from an online course.
Keywords
Self-assessment Journaling Peer sharing Web-based learning Regulation of cognitionNotes
Acknowledgments
This research is partially supported by the Ministry of Science and Technology, Taiwan, R.O.C. under Grant Nos. MOST 104-2911-I-003-301, MOST 103-2511-S-008-017-MY3, MOST 103-2511-S-006-007-MY3, MOST 103-2511-S-006-002-MY3, NSC 101-2511-S-008-012-MY3, and NSC 101-2511-S-008-013-MY3. The authors would like to thank anonymous reviewers and Dr. MJ Bishop, Editor-in-Chief of Journal of Computing in Higher Education for their valuable comments and suggestions on this manuscript.
References
- Akyol, Z., & Garrison, D. R. (2011). Assessing metacognition in an online community of inquiry. Internet and Higher Education, 14(3), 183–190.CrossRefGoogle Scholar
- Alessi, S. M., & Trollip, S. R. (2001). Multimedia for learning: Methods and development. Needham Heights, Massachusetts: Allyn & Bacon.Google Scholar
- Anderson, W., & Krathwohl, D. R. (Eds.). (2001). A taxonomy for learning, teaching, and assessment: A revision of Blooms’ educational objectives. New York, NY: Longman.Google Scholar
- A.nnotate (2012). User guides: A.nnotate. Retrieved September 10, 2012, from http://a.nnotate.com/userguide.html
- Artino, A. R. (2009). Think, feel, act: Motivational and emotional influences on military students’ online academic success. Journal of Computing in Higher Education, 21(2), 146–166.CrossRefGoogle Scholar
- Berthold, K., Nückles, M., & Renkl, A. (2007). Do learning protocols support learning strategies and outcomes? The role of cognitive and metacognitive prompts. Learning and Instruction, 17(5), 564–577.CrossRefGoogle Scholar
- Bloom, B. S. (1956). Taxonomy of educational objectives: The classification of educational goals, Handbook I: Cognitive domain. New York: Longman, Green.Google Scholar
- Chang, C. C., Tseng, K. H., & Liang, C. (2014). Is reflection performance correlated to the learning effect in a web-based portfolio assessment environment for middle school students? The Asia-Pacific Education Researcher, 23(1), 73–82.CrossRefGoogle Scholar
- Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2013). Applied multiple regression/correlation analysis for the behavioral sciences. London: Routledge.Google Scholar
- Crews, T., & Butterfield, J. (2002). Using technology to bring abstract concepts into focus: A programming case study. Journal of Computing in Higher Education, 13(2), 25–50.CrossRefGoogle Scholar
- García-Beltrán, A., & Martínez, R. (2006). Web assisted self-assessment in computer programming learning using AulaWeb. International Journal of Engineering Education, 22(5), 1063–1069.Google Scholar
- Hara, N., & Kling, R. (2001). Student distress in web-based distance education. Educause Quarterly, 3, 68–69.Google Scholar
- Hicks, D. (2003). Supporting personalization and customization in a collaborative setting. Computers in Industry, 52(1), 71–79.CrossRefGoogle Scholar
- Huang, Y. M., Chen, M. Y., & Mo, S. S. (2015). How do we inspire people to contact aboriginal culture with Web2.0 technology? Computers & Education, 86, 71–83.CrossRefGoogle Scholar
- Huang, Y. M., Huang, S. H., & Wu, T. T. (2014). Embedding diagnostic mechanisms in a digital game for learning mathematics. Educational Technology Research and Development, 62(2), 187–207.CrossRefGoogle Scholar
- Hutcheson, G. D., & Sofroniou, N. (1999). The multivariate social scientist: Introductory statistics using generalized linear models. London: Sage.Google Scholar
- Hwang, W. Y., Chen, N. S., Shadiev, R., & Li, J. S. (2011a). Effects of reviewing annotations and homework solutions on math learning achievement. British Journal of Educational Technology, 42(6), 1016–1028.CrossRefGoogle Scholar
- Hwang, W. Y., Shadiev, R., & Huang, S. M. (2011b). A study of a multimedia web annotation system and its effect on the EFL writing and speaking performance of junior high school students. ReCALL, 23(2), 160–180.CrossRefGoogle Scholar
- Hwang, W. Y., Shadiev, R., Wang, C. Y., & Huang, Z. H. (2012). A pilot study of cooperative programming learning behavior and its relationship with students’ learning performance. Computers & Education, 58(4), 1267–1281.CrossRefGoogle Scholar
- Hwang, W. Y., Wang, C. Y., Hwang, G. J., Huang, Y. M., & Huang, S. (2008). A web-based programming learning environment to support cognitive development. Interacting with Computers, 20(6), 524–534.CrossRefGoogle Scholar
- Lee, C. B. (2013). Examining intentional knowing among secondary school students: Through the lens of metacognition. The Asia-Pacific Education Researcher, 22(1), 79–90.CrossRefGoogle Scholar
- Martin, W. E., & Bridgmon, K. D. (2012). Quantitative and statistical research methods: From hypothesis to results. San Francisco, CA: Wiley.Google Scholar
- Matlock-Hetzel, S. (1997). Basic concepts in item and test analysis (pp. 1–22). San Antonio: Annual Meeting of the Southwest Educational Research Association.Google Scholar
- Milford, T., & Brown, L. (2010). The role of self-assessment in the preparation of pre-service teachers. Journal of Educational Practices, 8(1), 47–58.Google Scholar
- Moon, J. (2010). Learning journals and logs. UCD Teaching and Learning Resources. Retrieved from http://www.ucd.ie/t4cms/ucdtla0035.pdf
- Nilson, L. B. (2010). Teaching at its best: A research-based resource for college instructors. San-Francisco, CA: Wiley.Google Scholar
- Schraw, G., & Dennison, R. S. (1994). Assessing metacognitive awareness. Contemporary Educational Psychology, 19(4), 460–475.CrossRefGoogle Scholar
- Shadiev, R., Hwang, W. Y., Chen, N. S., & Huang, Y. M. (2014a). Review of speech-to-text recognition technology for enhancing learning. Journal of Educational Technology and Society, 17(4), 65–84.Google Scholar
- Shadiev, R., Hwang, W. Y., & Huang, Y. M. (2015). A pilot study of facilitating cross-cultural understanding with project-based collaborative learning activity in online environment. Australasian Journal of Educational Technology, 31(2), 123–139.Google Scholar
- Shadiev, R., Hwang, W. Y., Yeh, S. C., Yang, S. J. H., Wang, J. L., Lin, H., & Hsu, G. L. (2014b). Effects of unidirectional vs. reciprocal teaching strategies on web-based computer programming learning. Journal of Educational Computing Research, 50(1), 67–95.CrossRefGoogle Scholar
- Sperling, R. A., Howard, B. C., Miller, L. A., & Murphy, C. (2002). Measures of children’s knowledge and regulation of cognition. Contemporary Educational Psychology, 27(1), 51–79.CrossRefGoogle Scholar
- Truong, N., Bancroft, P., & Roe, P. (2003). A web based environment for Learning to program. In Proceeding of the 26th Annual Conference of ACSC, (pp. 255–264).Google Scholar
- Vatton, I., Quint, V., Kahan, J., Cramer, K., Nylander, K., & Rosen, K. et al. (2012). Amaya user manual. Retrieved September 10, 2012 from http://www.w3.org/Amaya/Distribution/manual.pdf
- Wong, B. Y. L., Kuperis, S., Jamieson, D., Keller, L., & Cull-Hewitt, R. (2002). Effects of guided journal writing on students’ story understanding. Journal of Educational Research, 95(3), 179–191.CrossRefGoogle Scholar
- Zandieh, Z., & Jafarigohar, M. (2012). The effects of hypertext gloss on comprehension and vocabulary retention under incidental and intentional learning conditions. English Language Teaching, 5(6), 60–71.CrossRefGoogle Scholar