Abstract
In design courses, reviewing how others have solved design problems or completed projects is common practice and often encouraged by educators. Using student work as examples can provide context for assessment criteria and help students approach new design problems. While studies have explored the use of exemplars in various disciplines, little research has focused on which exemplars to use (e.g., high-quality, low-quality) in design, technology, and engineering fields. To address this gap, researchers conducted a literature review of 33 articles on exemplar use in secondary and post-secondary education. The analysis revealed nine themes related to exemplar use and their impact on student learning, including (1) Clarity of instruction, (2) Learner focus, (3) Motivation for learning, (4) Student reflection on learning, (5) Building student self-efficacy, (6) Identifying instructional challenges, (7) Providing contrasting cases, (8) The relationship between exemplar quality and student work quality, and (9) Raising the bar for learning outcomes. Findings suggest that simply providing an exemplar is not enough and that the selection of an exemplar can have positive or negative impacts on student motivation, understanding, and application. Carefully selecting exemplars and engaging in dialogue with students can help them identify expectations, recognize quality work, and identify potential misconceptions. These findings have implications for those involved in design, technology, and engineering education. Educators can use these findings to guide their selection of exemplars and engage students in meaningful dialogue to aid their learning. Researchers can also use these findings to further investigate the use of exemplars in these fields.
Similar content being viewed by others
References
Aitken, A., & Thompson, D. G. (2018). Using software to engage design students in academic writing. International Journal of Technology and Design Education, 28(3), 885–898. https://doi.org/10.1007/s10798-017-9413-4
Amulya, J. (2004). What is reflective practice? Center for Reflective Community Practice at the Massachusetts Institute of Technology.
Anderson, N. (2017). What’s right about wrong answers: Learning from math mistakes, grades 4–5. Stenhouse Publishers.
Anderson, J. B., & Freiberg, H. J. (1995). Using self-assessment as a reflective tool to enhance the student teaching experience. Teacher Education Quarterly, 22(1), 77–91.
Andrade, H. G. (2000). Using rubrics to promote thinking and learning. Educational Leadership, 57(5), 13–19.
Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215. https://doi.org/10.1037/0033-295X.84.2.191
Bell, A., Mladenovic, R., & Price, M. (2013). Students’ perceptions of the usefulness of marking guides, grade descriptors and annotated exemplars. Assessment & Evaluation in Higher Education, 38(7), 769–788. https://doi.org/10.1080/02602938.2012.714738
Borrego, M., Foster, M. J., & Froyd, J. E. (2014). Systematic literature reviews in engineering education and other developing Interdisciplinary fields. Journal of Engineering Education, 103(1), 45–76. https://doi.org/10.1002/jee.20038
Bouwer, R., Lesterhuis, M., Bonne, P., & De Maeyer, S. (2018). Applying criteria to examples or learning by comparison: Effects on students' evaluative judgment and performance in writing. In Frontiers in education (Vol. 3, p. 86). Frontiers Media SA. https://doi.org/10.3389/feduc.2018.00086
Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/10.1080/02602938.2018.1463354
Carless, D., & Chan, K. K. H. (2017). Managing dialogic use of exemplars. Assessment & Evaluation in Higher Education, 42(6), 930–941. https://doi.org/10.1080/02602938.2016.1211246
Carless, D., Chan, K. K. H., To, J., Lo, M., & Barrett, E. (2018). Developing students’ capacities for evaluative judgement through analysing exemplars. Developing Evaluative Judgement in Higher Education: Assessment for Knowing and Producing Quality Work, 108–116.
Charmaz, K. (2006). Constructing grounded theory: A practical guide through qualitative analysis. SAGE.
Chong, S. W. (2019). The use of exemplars in English writing classrooms: From theory to practice. Assessment & Evaluation in Higher Education, 44(5), 748–763. https://doi.org/10.1080/02602938.2018.1535051
Chong, S. W. (2021). University students’ perceptions towards using exemplars dialogically to develop evaluative judgement: The case of a high-stakes language test. Asian-Pacific Journal of Second and Foreign Language Education, 6(1), 12. https://doi.org/10.1186/s40862-021-00115-4
Dixon, H., Hawe, E., & Hamilton, R. (2020). The case for using exemplars to develop academic self-efficacy. Assessment & Evaluation in Higher Education, 45(3), 460–471. https://doi.org/10.1080/02602938.2019.1666084
Glaser, B. G. (1965). The constant comparative method of qualitative analysis. Social Problems, 12(4), 436–445. https://doi.org/10.2307/798843
Gonczi, A. L., Bergman, B. G., Huntoon, J., Allen, R., McIntyre, B., Turner, S., Davis, J., & Handler, R. (2017). Decision matrices: Tools to enhance middle school engineering instruction. Science Activities, 54(1), 8–17. https://doi.org/10.1080/00368121.2016.1264922
Grainger, P. R., Heck, D., & Carey, M. D. (2018). Are assessment exemplars perceived to support self-regulated learning in teacher education?. Frontiers in Education, 3, 60.
Hawe, E., & Dixon, H. (2017). Assessment for learning: A catalyst for student self-regulation. Assessment & Evaluation in Higher Education, 42(8), 1181–1192. https://doi.org/10.1080/02602938.2016.1236360
Hawe, E., Lightfoot, U., & Dixon, H. (2019). First-year students working with exemplars: Promoting self-efficacy, self-monitoring and self-regulation. Journal of Further and Higher Education, 43(1), 30–44. https://doi.org/10.1080/0309877X.2017.1349894
Hawe, E., Dixon, H., & Hamilton, R. (2021). Why and how educators use exemplars. Journal of University Teaching and Learning Practice. https://doi.org/10.53761/1.18.3.10
Headley, J., & Pittson, H. (2020). Bottom up! Establishing a University Wide community of practice for exemplars and exploration of its affect in enhancing the quality of student assessment. Practitioner Research in Higher Education, 13(1), 18–26.
Hendry, G. D., & Jukic, K. (2014). Learning about the quality of work that teachers expect: Students’ perceptions of exemplar marking versus teacher explanation. Journal of University Teaching and Learning Practice, 11(2), 5.
Hendry, G. D., & Tomitsch, M. (2014). Implementing an exemplar-based approach in an interaction design subject: Enhancing students’ awareness of the need to be creative. International Journal of Technology and Design Education, 24(3), 337–348. https://doi.org/10.1007/s10798-013-9256-6
Hendry, G. D., Armstrong, S., & Bromberger, N. (2012). Implementing standards-based assessment effectively: Incorporating discussion of exemplars into classroom teaching. Assessment & Evaluation in Higher Education, 37(2), 149–161. https://doi.org/10.1080/02602938.2010.515014
Johnston, E., Burleigh, C., Rasmusson, X., Turner, P., Valentine, D., & Bailey, L. (2021). Multimedia open educational resource materials for teaching-online diversity and leadership: Aligning bloom’s taxonomy and studio habits of mind. Higher Learning Research Communications, 11(2), 40–67.
Kean, J. (2012). Show AND tell: Using peer assessment and exemplars to help students understand quality in assessment. Practitioner Research in Higher Education, 6(2), 2.
Kearney, S. P., & Perkins, T. (2014). Engaging students through assessment: The Success and limitations of the ASPAL (authentic self and peer assessment for learning) Model. Journal of University Teaching and Learning Practice, 11(3), 2.
Knight, S., Leigh, A., Davila, Y. C., Martin, L. J., & Krix, D. W. (2019). Calibrating assessment literacy through benchmarking tasks. Assessment & Evaluation in Higher Education, 44(8), 1121–1132. https://doi.org/10.1080/02602938.2019.1570483
Kulkarni, C. E., Socher, R., Bernstein, M. S., & Klemmer, S. R. (2014). Scaling short-answer grading by combining peer assessment with algorithmic scoring. In Proceedings of the First ACM conference on learning @ scale conference (pp. 99–108). https://doi.org/10.1145/2556325.2566238
McMillan, J. H., & Hearn, J. (2008). Student self-assessment: The key to stronger student motivation and higher achievement. Educational Horizons, 87(1), 40–49.
Merriam, S. B., & Tisdell, E. J. (2015). Qualitative research (4th ed.). Wiley.
Nelson, R. (2018). Barriers to the cultivation of evaluative judgement: A critical and historical perspective. Developing evaluative judgement in Higher Education. Routledge.
Newlyn, D. (2013). Providing exemplars in the learning environment: The case for and against. Universal Journal of Educational Research, 1(1), 26–32.
Petticrew, M., & Roberts, H. (2008). Systematic reviews in the social sciences: A practical guide. Wiley.
Polanyi, M. (1997). The Tacit Dimension. In Knowledge in Organizations. Routledge.
Rawson, K. A., & Dunlosky, J. (2016). How effective is example generation for learning declarative concepts? Educational Psychology Review, 28(3), 649–672. eric.
Sadler, D. R. (1987). Specifying and promulgating achievement standards. Oxford Review of Education, 13(2), 191–209. https://doi.org/10.1080/0305498870130207
Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144. https://doi.org/10.1007/BF00117714
Sadler, D. R. (2002). Ah!… so that’s ‘quality’. In Assessment. Routledge.
Sadler, D. R. (2007). Perils in the meticulous specification of goals and assessment criteria. Assessment in Education: Principles Policy & Practice, 14(3), 387–392. https://doi.org/10.1080/09695940701592097
Saldaña, J. (2013). The Coding Manual for Qualitative Researchers (Second). SAGE Publications Inc.
Schwartz, D. (2018). Designing contrasting cases for inductive learning. Human Sciences and Technologies Advanced Research Institiute. https://hstar.stanford.edu/research/designing-contrasting-cases-for-inductive-learning/
Seeley, C. L. (2014). Chapter 8: Oops! The value of mistakes, failures, and wrong turns. In Smarter than we think: More messages about Math, Teaching, and learning in the 21st Century: A Resource for teachers, leaders, Policy makers, and families. Math Solutions.
Tam, A. C. F. (2021). Undergraduate students’ perceptions of and responses to exemplar-based dialogic feedback. Assessment & Evaluation in Higher Education, 46(2), 269–285. https://doi.org/10.1080/02602938.2020.1772957
Teaching Channel. (2014). My Favorite No (Uncut). Teaching Channel. https://learn.teachingchannel.com/video/my-favorite-no-complete-lesson
To, J., & Liu, Y. (2018). Using peer and teacher-student exemplar dialogues to unpack assessment standards: Challenges and possibilities. Assessment & Evaluation in Higher Education, 43(3), 449–460. https://doi.org/10.1080/02602938.2017.1356907
Vygotsky, L. S. (1987). The collected works of L.S. Vygotsky: The fundamentals of defectology. Springer Science and Business Media.
Yucel, R., Bird, F. L., Young, J., & Blanksby, T. (2014). The road to self-assessment: Exemplar marking before peer review develops first-year students’ capacity to judge the quality of a scientific report. Assessment & Evaluation in Higher Education, 39(8), 971–986. https://doi.org/10.1080/02602938.2014.880400
Zimmerman, B. J. (2000). Chapter 2 - Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of Self-Regulation (pp. 13–39). Academic Press. https://doi.org/10.1016/B978-012109890-2/50031-7
Zimmerman, B. J., & Schunk, D. H. (2007). Motivation: An essential dimension of self-regulated learning. Motivation and self-regulated learning. Routledge.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all authors, the corresponding author states that there is no conflict of interest.
Competing Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1
Initial Search Query (Conducted 7/20/2022).
# | Query |
---|---|
S1 | “exemplars” OR “samples” OR “worked examples” OR “examples” OR “model answer” OR “Gallery walk” OR “Design critique” OR “Peer critique” OR “Formative peer assessment” OR “Math thinking” OR “Learning by Evaluation” OR “LbE” OR “Peer learning” |
S2 | “self-efficacy” OR “self efficacy” OR “self-confidence” OR “self confidence” OR “confidence” OR “efficacy” OR “concept of quality” OR “evaluative knowledge” |
S3 | “secondary school” OR “high school” OR “secondary education” OR “postsecondary education” OR “college” OR “university” |
S4 | “selection” OR “quality” OR “choice” |
Appendix 2
Additional Search Query (Conducted 7/22/2022).
# | Query |
---|---|
S1 | “assessment” OR “marking” OR “criteria” OR “standards” |
S2 | “discussion” OR “task” OR “understanding” |
S3 | “exemplars” |
S4 | “education” |
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Thorne, S., Mentzer, N., Bartholomew, S. et al. A systematic literature review of student evaluation of peer exemplars and implications for design, Technology, and Engineering Learning. Int J Technol Des Educ (2024). https://doi.org/10.1007/s10798-023-09874-2
Accepted:
Published:
DOI: https://doi.org/10.1007/s10798-023-09874-2