Closing the Circle: Use of Students’ Responses for Peer-Assessment Rubric Improvement
Educational peer assessment has proven to be a useful approach for providing students timely feedback and allowing them to help and learn from each other. Reviewers are often expected both to provide formative feedback─textual feedback telling the authors where and how to improve the artifact─and peer grading at the same time. Formative feedback is important for the authors because timely and insightful feedback can help them improve their artifacts, and peer grading is important to the teaching staff, as it provides more input to help determine final grades. In a large class or MOOC when the help from teaching staff is limited, formative feedback from their peers is the best help that the authors may receive. To guarantee the quality of the formative feedback and reliability of peer grading, instructors should keep on improving peer-assessment rubrics. In this study we used students’ feedback from the last 3 years in the Expertiza peer-assessment system to analyze the quality of 15 existing rubrics on 61 assignments. A set of patterns on peer-grading reliability and comment length were found and a set of guidelines are given accordingly.
KeywordsEducational peer-review Review rubric Peer assessment
This project is sponsored by the National Science Foundation, on grant DUE 1432347.
- 7.Stevens, D.D., Levi, A.: Introduction to Rubrics: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning. Stylus Publishing, LLC, Sterling (2005)Google Scholar
- 9.Gehringer, E., Ehresman, L., Conger, S.G., Wagle, P.: Reusable learning objects through peer review: the Expertiza approachGoogle Scholar
- 10.Piech, C., Huang, J., Chen, Z., Do, C., Ng, A., Koller, D.: Tuned models of peer assessment in MOOCs. In: 6th International Conference on Educational Data Mining, Memphis, Tennessee, USA (2013)Google Scholar
- 11.Song, Y., Hu, Z., Gehringer, E.: Pluggable reputation systems for peer review: a web-service approach. In: 45th IEEE Frontiers in Education Conference, 2015, FIE 2015, El Paso, Texas (2015)Google Scholar