Skip to main content
Log in

A systematic literature review of student evaluation of peer exemplars and implications for design, Technology, and Engineering Learning

  • Published:
International Journal of Technology and Design Education Aims and scope Submit manuscript

Abstract

In design courses, reviewing how others have solved design problems or completed projects is common practice and often encouraged by educators. Using student work as examples can provide context for assessment criteria and help students approach new design problems. While studies have explored the use of exemplars in various disciplines, little research has focused on which exemplars to use (e.g., high-quality, low-quality) in design, technology, and engineering fields. To address this gap, researchers conducted a literature review of 33 articles on exemplar use in secondary and post-secondary education. The analysis revealed nine themes related to exemplar use and their impact on student learning, including (1) Clarity of instruction, (2) Learner focus, (3) Motivation for learning, (4) Student reflection on learning, (5) Building student self-efficacy, (6) Identifying instructional challenges, (7) Providing contrasting cases, (8) The relationship between exemplar quality and student work quality, and (9) Raising the bar for learning outcomes. Findings suggest that simply providing an exemplar is not enough and that the selection of an exemplar can have positive or negative impacts on student motivation, understanding, and application. Carefully selecting exemplars and engaging in dialogue with students can help them identify expectations, recognize quality work, and identify potential misconceptions. These findings have implications for those involved in design, technology, and engineering education. Educators can use these findings to guide their selection of exemplars and engage students in meaningful dialogue to aid their learning. Researchers can also use these findings to further investigate the use of exemplars in these fields.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Aitken, A., & Thompson, D. G. (2018). Using software to engage design students in academic writing. International Journal of Technology and Design Education, 28(3), 885–898. https://doi.org/10.1007/s10798-017-9413-4

    Article  Google Scholar 

  • Amulya, J. (2004). What is reflective practice? Center for Reflective Community Practice at the Massachusetts Institute of Technology.

    Google Scholar 

  • Anderson, N. (2017). What’s right about wrong answers: Learning from math mistakes, grades 4–5. Stenhouse Publishers.

    Google Scholar 

  • Anderson, J. B., & Freiberg, H. J. (1995). Using self-assessment as a reflective tool to enhance the student teaching experience. Teacher Education Quarterly, 22(1), 77–91.

    Google Scholar 

  • Andrade, H. G. (2000). Using rubrics to promote thinking and learning. Educational Leadership, 57(5), 13–19.

    Google Scholar 

  • Bandura, A. (1977). Self-efficacy: Toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215. https://doi.org/10.1037/0033-295X.84.2.191

    Article  Google Scholar 

  • Bell, A., Mladenovic, R., & Price, M. (2013). Students’ perceptions of the usefulness of marking guides, grade descriptors and annotated exemplars. Assessment & Evaluation in Higher Education, 38(7), 769–788. https://doi.org/10.1080/02602938.2012.714738

    Article  Google Scholar 

  • Borrego, M., Foster, M. J., & Froyd, J. E. (2014). Systematic literature reviews in engineering education and other developing Interdisciplinary fields. Journal of Engineering Education, 103(1), 45–76. https://doi.org/10.1002/jee.20038

    Article  Google Scholar 

  • Bouwer, R., Lesterhuis, M., Bonne, P., & De Maeyer, S. (2018). Applying criteria to examples or learning by comparison: Effects on students' evaluative judgment and performance in writing. In Frontiers in education (Vol. 3, p. 86). Frontiers Media SA. https://doi.org/10.3389/feduc.2018.00086

  • Carless, D., & Boud, D. (2018). The development of student feedback literacy: Enabling uptake of feedback. Assessment & Evaluation in Higher Education, 43(8), 1315–1325. https://doi.org/10.1080/02602938.2018.1463354

    Article  Google Scholar 

  • Carless, D., & Chan, K. K. H. (2017). Managing dialogic use of exemplars. Assessment & Evaluation in Higher Education, 42(6), 930–941. https://doi.org/10.1080/02602938.2016.1211246

    Article  Google Scholar 

  • Carless, D., Chan, K. K. H., To, J., Lo, M., & Barrett, E. (2018). Developing students’ capacities for evaluative judgement through analysing exemplars. Developing Evaluative Judgement in Higher Education: Assessment for Knowing and Producing Quality Work, 108–116.

  • Charmaz, K. (2006). Constructing grounded theory: A practical guide through qualitative analysis. SAGE.

    Google Scholar 

  • Chong, S. W. (2019). The use of exemplars in English writing classrooms: From theory to practice. Assessment & Evaluation in Higher Education, 44(5), 748–763. https://doi.org/10.1080/02602938.2018.1535051

    Article  Google Scholar 

  • Chong, S. W. (2021). University students’ perceptions towards using exemplars dialogically to develop evaluative judgement: The case of a high-stakes language test. Asian-Pacific Journal of Second and Foreign Language Education, 6(1), 12. https://doi.org/10.1186/s40862-021-00115-4

    Article  Google Scholar 

  • Dixon, H., Hawe, E., & Hamilton, R. (2020). The case for using exemplars to develop academic self-efficacy. Assessment & Evaluation in Higher Education, 45(3), 460–471. https://doi.org/10.1080/02602938.2019.1666084

    Article  Google Scholar 

  • Glaser, B. G. (1965). The constant comparative method of qualitative analysis. Social Problems, 12(4), 436–445. https://doi.org/10.2307/798843

    Article  Google Scholar 

  • Gonczi, A. L., Bergman, B. G., Huntoon, J., Allen, R., McIntyre, B., Turner, S., Davis, J., & Handler, R. (2017). Decision matrices: Tools to enhance middle school engineering instruction. Science Activities, 54(1), 8–17. https://doi.org/10.1080/00368121.2016.1264922

  • Grainger, P. R., Heck, D., & Carey, M. D. (2018). Are assessment exemplars perceived to support self-regulated learning in teacher education?. Frontiers in Education, 3, 60.

    Article  Google Scholar 

  • Hawe, E., & Dixon, H. (2017). Assessment for learning: A catalyst for student self-regulation. Assessment & Evaluation in Higher Education, 42(8), 1181–1192. https://doi.org/10.1080/02602938.2016.1236360

    Article  Google Scholar 

  • Hawe, E., Lightfoot, U., & Dixon, H. (2019). First-year students working with exemplars: Promoting self-efficacy, self-monitoring and self-regulation. Journal of Further and Higher Education, 43(1), 30–44. https://doi.org/10.1080/0309877X.2017.1349894

    Article  Google Scholar 

  • Hawe, E., Dixon, H., & Hamilton, R. (2021). Why and how educators use exemplars. Journal of University Teaching and Learning Practice. https://doi.org/10.53761/1.18.3.10

  • Headley, J., & Pittson, H. (2020). Bottom up! Establishing a University Wide community of practice for exemplars and exploration of its affect in enhancing the quality of student assessment. Practitioner Research in Higher Education, 13(1), 18–26.

    Google Scholar 

  • Hendry, G. D., & Jukic, K. (2014). Learning about the quality of work that teachers expect: Students’ perceptions of exemplar marking versus teacher explanation. Journal of University Teaching and Learning Practice, 11(2), 5.

    Article  Google Scholar 

  • Hendry, G. D., & Tomitsch, M. (2014). Implementing an exemplar-based approach in an interaction design subject: Enhancing students’ awareness of the need to be creative. International Journal of Technology and Design Education, 24(3), 337–348. https://doi.org/10.1007/s10798-013-9256-6

    Article  Google Scholar 

  • Hendry, G. D., Armstrong, S., & Bromberger, N. (2012). Implementing standards-based assessment effectively: Incorporating discussion of exemplars into classroom teaching. Assessment & Evaluation in Higher Education, 37(2), 149–161. https://doi.org/10.1080/02602938.2010.515014

    Article  Google Scholar 

  • Johnston, E., Burleigh, C., Rasmusson, X., Turner, P., Valentine, D., & Bailey, L. (2021). Multimedia open educational resource materials for teaching-online diversity and leadership: Aligning bloom’s taxonomy and studio habits of mind. Higher Learning Research Communications, 11(2), 40–67.

    Article  Google Scholar 

  • Kean, J. (2012). Show AND tell: Using peer assessment and exemplars to help students understand quality in assessment. Practitioner Research in Higher Education, 6(2), 2.

    Google Scholar 

  • Kearney, S. P., & Perkins, T. (2014). Engaging students through assessment: The Success and limitations of the ASPAL (authentic self and peer assessment for learning) Model. Journal of University Teaching and Learning Practice, 11(3), 2.

    Article  Google Scholar 

  • Knight, S., Leigh, A., Davila, Y. C., Martin, L. J., & Krix, D. W. (2019). Calibrating assessment literacy through benchmarking tasks. Assessment & Evaluation in Higher Education, 44(8), 1121–1132. https://doi.org/10.1080/02602938.2019.1570483

    Article  Google Scholar 

  • Kulkarni, C. E., Socher, R., Bernstein, M. S., & Klemmer, S. R. (2014). Scaling short-answer grading by combining peer assessment with algorithmic scoring. In Proceedings of the First ACM conference on learning @ scale conference (pp. 99–108). https://doi.org/10.1145/2556325.2566238

  • McMillan, J. H., & Hearn, J. (2008). Student self-assessment: The key to stronger student motivation and higher achievement. Educational Horizons, 87(1), 40–49.

    Google Scholar 

  • Merriam, S. B., & Tisdell, E. J. (2015). Qualitative research (4th ed.). Wiley.

    Google Scholar 

  • Nelson, R. (2018). Barriers to the cultivation of evaluative judgement: A critical and historical perspective. Developing evaluative judgement in Higher Education. Routledge.

    Book  Google Scholar 

  • Newlyn, D. (2013). Providing exemplars in the learning environment: The case for and against. Universal Journal of Educational Research, 1(1), 26–32.

    Article  Google Scholar 

  • Petticrew, M., & Roberts, H. (2008). Systematic reviews in the social sciences: A practical guide. Wiley.

    Google Scholar 

  • Polanyi, M. (1997). The Tacit Dimension. In Knowledge in Organizations. Routledge.

  • Rawson, K. A., & Dunlosky, J. (2016). How effective is example generation for learning declarative concepts? Educational Psychology Review, 28(3), 649–672. eric.

    Article  Google Scholar 

  • Sadler, D. R. (1987). Specifying and promulgating achievement standards. Oxford Review of Education, 13(2), 191–209. https://doi.org/10.1080/0305498870130207

    Article  Google Scholar 

  • Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119–144. https://doi.org/10.1007/BF00117714

    Article  Google Scholar 

  • Sadler, D. R. (2002). Ah!… so that’s ‘quality’. In Assessment. Routledge.

  • Sadler, D. R. (2007). Perils in the meticulous specification of goals and assessment criteria. Assessment in Education: Principles Policy & Practice, 14(3), 387–392. https://doi.org/10.1080/09695940701592097

    Article  Google Scholar 

  • Saldaña, J. (2013). The Coding Manual for Qualitative Researchers (Second). SAGE Publications Inc.

    Google Scholar 

  • Schwartz, D. (2018). Designing contrasting cases for inductive learning. Human Sciences and Technologies Advanced Research Institiute. https://hstar.stanford.edu/research/designing-contrasting-cases-for-inductive-learning/

  • Seeley, C. L. (2014). Chapter 8: Oops! The value of mistakes, failures, and wrong turns. In Smarter than we think: More messages about Math, Teaching, and learning in the 21st Century: A Resource for teachers, leaders, Policy makers, and families. Math Solutions.

  • Tam, A. C. F. (2021). Undergraduate students’ perceptions of and responses to exemplar-based dialogic feedback. Assessment & Evaluation in Higher Education, 46(2), 269–285. https://doi.org/10.1080/02602938.2020.1772957

    Article  Google Scholar 

  • Teaching Channel. (2014). My Favorite No (Uncut). Teaching Channel. https://learn.teachingchannel.com/video/my-favorite-no-complete-lesson

  • To, J., & Liu, Y. (2018). Using peer and teacher-student exemplar dialogues to unpack assessment standards: Challenges and possibilities. Assessment & Evaluation in Higher Education, 43(3), 449–460. https://doi.org/10.1080/02602938.2017.1356907

    Article  Google Scholar 

  • Vygotsky, L. S. (1987). The collected works of L.S. Vygotsky: The fundamentals of defectology. Springer Science and Business Media.

    Google Scholar 

  • Yucel, R., Bird, F. L., Young, J., & Blanksby, T. (2014). The road to self-assessment: Exemplar marking before peer review develops first-year students’ capacity to judge the quality of a scientific report. Assessment & Evaluation in Higher Education, 39(8), 971–986. https://doi.org/10.1080/02602938.2014.880400

    Article  Google Scholar 

  • Zimmerman, B. J. (2000). Chapter 2 - Attaining self-regulation: A social cognitive perspective. In M. Boekaerts, P. R. Pintrich, & M. Zeidner (Eds.), Handbook of Self-Regulation (pp. 13–39). Academic Press. https://doi.org/10.1016/B978-012109890-2/50031-7

    Chapter  Google Scholar 

  • Zimmerman, B. J., & Schunk, D. H. (2007). Motivation: An essential dimension of self-regulated learning. Motivation and self-regulated learning. Routledge.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Scott Thorne.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Competing Interests

The authors have no competing interests to declare that are relevant to the content of this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

Initial Search Query (Conducted 7/20/2022).

#

Query

S1

“exemplars” OR “samples” OR “worked examples” OR “examples” OR “model answer” OR “Gallery walk” OR “Design critique” OR “Peer critique” OR “Formative peer assessment” OR “Math thinking” OR “Learning by Evaluation” OR “LbE” OR “Peer learning”

S2

“self-efficacy” OR “self efficacy” OR “self-confidence” OR “self confidence” OR “confidence” OR “efficacy” OR “concept of quality” OR “evaluative knowledge”

S3

“secondary school” OR “high school” OR “secondary education” OR “postsecondary education” OR “college” OR “university”

S4

“selection” OR “quality” OR “choice”

Appendix 2

Additional Search Query (Conducted 7/22/2022).

#

Query

S1

“assessment” OR “marking” OR “criteria” OR “standards”

S2

“discussion” OR “task” OR “understanding”

S3

“exemplars”

S4

“education”

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Thorne, S., Mentzer, N., Bartholomew, S. et al. A systematic literature review of student evaluation of peer exemplars and implications for design, Technology, and Engineering Learning. Int J Technol Des Educ (2024). https://doi.org/10.1007/s10798-023-09874-2

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10798-023-09874-2

Keywords

Navigation