Abstract
In order to identify the potential benefits and challenges of implementing student portfolios as quality mathematics assessment, a pilot study was conducted with teachers in various secondary school settings. The multi-case study consisted of five teacher participants from geographically and demographically differing contexts, four in the USA and one in Canada. They were interviewed and surveyed, exploring their motivations for utilizing a portfolio system of mathematics assessment for the 2020–2021 school year, the design of their portfolio system, and resultant impacts on student dispositions around mathematics. Each participating teacher implemented different structures of portfolio assessment, including the types of items included and how the items were assessed. Results showed that compared to traditional multiple-choice tests, teachers felt portfolios were a better reflection of their students’ “extra-mathematical” skills, such as problem-solving and persistence. Teacher surveys and interviews also demonstrated confidence that the use of portfolios as assessment was superior to more traditional measures in terms of adhering to good pedagogical practices. Through questionnaire data and interviews, teachers reported portfolios were particularly beneficial for students for whom English is not their primary language, as well as students with special needs. The paper lays the groundwork for additional research studies in the area of student mathematics portfolios based on the provided framework.
Résumé
Afin d’identifier les avantages et les défis potentiels associés à la mise en œuvre de portfolios d’élèves pour évaluer la qualité des mathématiques, on a mené une étude pilote auprès d’enseignants de différents établissements du secondaire. L’étude de plusieurs cas comprenait cinq participants, des enseignants issus de contextes géographiques et démographiques différents, quatre aux États-Unis et un au Canada. On a interviewé et sondé les enseignants pour explorer leurs motivations derrière l’utilisation d’un système de portfolio d’évaluation des mathématiques pour l’année scolaire 2020–2021, ainsi que celles derrière la conception de leur système de portfolio, et enfin, pour en évaluer l’effet sur les dispositions des élèves à l’égard des mathématiques. Chaque enseignant participant a mis en œuvre différentes structures d’évaluation du portfolio, y compris les types d’éléments inclus et la façon dont ces éléments ont été évalués. Les résultats ont montré qu’en comparaison avec les évaluations traditionnelles avec choix multiples, les portfolios, selon les enseignants reflétaient mieux les compétences « extra-mathématiques» de leurs élèves, telles que la résolution de problèmes et la persévérance. Les sondages et les interviews menés auprès des enseignants ont également révélé une confiance à savoir qu’en tant que mode d’évaluation, l’utilisation des portfolios était supérieure aux mesures plus traditionnelles en ce qui concerne l’adhésion aux bonnes pratiques pédagogiques. Selon les données obtenues des questionnaires et des interviews, les enseignants ont indiqué que les portfolios étaient particulièrement bénéfiques aux élèves dont l’anglais n’est pas la langue maternelle, ainsi que ceux qui ont des besoins particuliers. L’article établit un contexte pour d’autres études de recherche dans le domaine des portfolios de mathématiques des élèves fondées sur le cadre proposé.
Similar content being viewed by others
References
Abedi, J., & Gándara, P. (2006). Performance of English Language Learners as a Subgroup in Large-Scale Assessment: Interaction of Research and Policy. Educational Measurement: Issues and Practice, 25(4), 36–46. https://doi.org/10.1111/j.1745-3992.2006.00077.x
Au, W. (2007). High-Stakes Testing and Curricular Control: A Qualitative Metasynthesis. Educational Researcher, 36(5), 258–267. JSTOR.
Billings, E. M. H., Coffey, D. C., Golden, J., & Wells, P. J. (2013). Teaching with the Mathematical Practices in Mind. Mathematics Teaching in the Middle School, 19(2), 100–107. JSTOR. https://doi.org/10.5951/mathteacmiddscho.19.2.0100
Brandt, R. (1992). On Research on Teaching: A Conversation with Lee Shulman. Educational Leadership, 49(7), 14–19.
Burch, C. B. (1999). Inside the Portfolio Experience: The Student’s Perspective. English Education, 32(1), 34–49.
Calfee, R. C., & Perfumo, P. (1993). Student Portfolios: Opportunities for a Revolution in Assessment. Journal of Reading, 36(7), 532–537.
Care, E. (2018). Twenty-First Century Skills: From Theory to Action. In E. Care, P. Griffin, & M. Wilson (Eds.), Assessment and Teaching of 21st Century Skills: Research and Applications (pp. 3–17). Springer International Publishing. https://doi.org/10.1007/978-3-319-65368-6_1
Chang, C.-C., Tseng, K.-H., Chou, P.-N., & Chen, Y.-H. (2011). Reliability and validity of Web-based portfolio peer assessment: A case study for a senior high school’s students taking computer course. Computers & Education, 57(1), 1306–1316. https://doi.org/10.1016/j.compedu.2011.01.014
Cicmanec, K. M., & Viechnicki, K. J. (1994). Assessing Mathematics Skills Through Portfolios: Validating the Claims From Existing Literature. Educational Assessment, 2(2), 167–178. https://doi.org/10.1207/s15326977ea0202_4
Cook-Benjamin, L. L. (1995). College Students’ Attitudes and Perceptions of Learning Through the Use of Portfolio Assessment [Ed.D., University of South Dakota]. http://search.proquest.com/docview/857040369/abstract/DD3B7978D82A40C1PQ/1
Coutts, R., Gilleard, W., & Baglin, R. (2011). Evidence for the impact of assessment on mood and motivation in first‐year students. Studies in Higher Education, 36(3), 291–300. https://doi.org/10.1080/03075079.2010.523892
Creswell, J. W., & Poth, C. N. (2016). Qualitative inquiry and research design: Choosing among five approaches. Sage publications.
Davis, J., & Martin, D. (2018). Racism, Assessment, and Instructional Practices: Implications for Mathematics Teachers of African American Students. Journal of Urban Mathematics Education, 11, 45–68.
Diop, K. A. S., & Liu, E. (2020). Categorization of case in case study research method: New approach. Knowledge and Performance Management, 4(1), 1–14. https://doi.org/10.21511/kpm.04(1).2020.01
Eisenhardt, K. M. (1989). Building Theories from Case Study Research. The Academy of Management Review, 14(4), 532–550. https://doi.org/10.2307/258557
Elbow, P., & Belanoff, P. (1997). Reflections on an Explosion: Portfolios in the ’90s and Beyond. In K. B. Yancey & I. Weiser (Eds.), Situating Portfolios (pp. 21–33). University Press of Colorado. https://doi.org/10.2307/j.ctt46nxw3.4
Fritz, C. (2001). The level of teacher involvement in the Vermont mathematics portfolio assessment process and instructional practices in grade 4 classrooms. Doctoral Dissertations. https://scholars.unh.edu/dissertation/15
Gillespie, C. S., Ford, K. L., Gillespie, R. D., & Leavell, A. G. (1996). Portfolio Assessment: Some Questions, Some Answers, Some Recommendations. Journal of Adolescent & Adult Literacy, 39(6), 480–491.
Greiff, S., Niepel, C., & Wüstenberg, S. (2015). 21st century skills: International advancements and recent developments. Thinking Skills and Creativity, 18, 1–3. https://doi.org/10.1016/j.tsc.2015.04.007
Griffin, P., & Care, E. (Eds.). (2015). Assessment and Teaching of 21st Century Skills: Methods and Approach. Springer Netherlands. https://doi.org/10.1007/978-94-017-9395-7
Harlen, W. (2005). Teachers’ summative practices and assessment for learning – tensions and synergies. The Curriculum Journal, 16(2), 207–223. https://doi.org/10.1080/09585170500136093
Harlen, W., & Crick, R. D. (2003). Testing and Motivation for Learning. Assessment in Education: Principles, Policy & Practice, 10(2), 169–207. https://doi.org/10.1080/0969594032000121270
Heron, J., & Reason, P. (1997). A Participatory Inquiry Paradigm. Qualitative Inquiry, 3(3), 274–294. https://doi.org/10.1177/107780049700300302
Horn, I. S. (2018). Accountability as a Design for Teacher Learning: Sensemaking About Mathematics and Equity in the NCLB Era. Urban Education, 53(3), 382–408. https://doi.org/10.1177/0042085916646625
Horn, I., & Schneeberger McGugan, K. (2020). Adaptive expertise in mathematics teaching during a crisis: How highly-committed secondary U.S. mathematics teachers adjusted their instruction in the COVID-19 pandemic. https://doi.org/10.13140/RG.2.2.13720.83200
Humphries, J. E., & Kosse, F. (2017). On the interpretation of non-cognitive skills – What is being measured and why it matters. Journal of Economic Behavior & Organization, 136, 174–185. https://doi.org/10.1016/j.jebo.2017.02.001
Inglis, M., & Attridge, N. (2016). Does Mathematical Study Develop Logical Thinking?: Testing The Theory Of Formal Discipline. World Scientific Publishing Company. http://ebookcentral.proquest.com/lib/uwy/detail.action?docID=4709107
Joram, E., Gabriele, A. J., & Walton, K. (2020). What influences teachers’ “buy-in” of research? Teachers’ beliefs about the applicability of educational research to their practice. Teaching and Teacher Education, 88, 102980. https://doi.org/10.1016/j.tate.2019.102980
Kickert, R., Meeuwisse, M., Stegers-Jager, K. M., Koppenol-Gonzalez, G. V., Arends, L. R., & Prinzie, P. (2019). Assessment policies and academic performance within a single course: The role of motivation and self-regulation. Assessment & Evaluation in Higher Education, 44(8), 1177–1190. https://doi.org/10.1080/02602938.2019.1580674
King, N., Horrocks, C., & Brooks, J. (2019). Interviews in qualitative research (2nd ed.). SAGE.
Krall, G. (2018). Necessary Conditions: Teaching Secondary Math with Academic Safety, Quality Tasks, and Effective Facilitation. Stenhouse Publishers.
Liljedahl, P. (2007). Persona-Based Journaling: Striving for Authenticity in Representing the Problem-Solving Process. International Journal of Science and Mathematics Education, 5(4), 661–680. https://doi.org/10.1007/s10763-007-9092-9
Lim, S. Y., & Chapman, E. (2013). Development of a short form of the attitudes toward mathematics inventory. Educational Studies in Mathematics, 82(1), 145–164. https://doi.org/10.1007/s10649-012-9414-x
Pohlmann, B., Möller, J., & Streblow, L. (2004). Zur Fremdeinschätzung von Schülerselbstkonzepten durch Lehrer und Mitschüler [On Students' Self-Concepts Inferred By Teachers and Classmates]. Zeitschrift Für Pädagogische Psychologie, 18(3/4), 157–169. https://doi.org/10.1024/1010-0652.18.34.157
Renwick, M. (2017). Digital Portfolios in the Classroom: Showcasing and Assessing Student Work. Association for Supervision & Curriculum Development. http://ebookcentral.proquest.com/lib/uwy/detail.action?docID=5041558
Schatz, E. (2012). Rationale and procedures for nesting semi-structured interviews in surveys or censuses. Population Studies, 66(2), 183–195.
Schoenfeld, A. H. (2015). Summative and Formative Assessments in Mathematics Supporting the Goals of the Common Core Standards. Theory Into Practice, 54(3), 183–194. https://doi.org/10.1080/00405841.2015.1044346
Sowder, J. (2007). The Mathematical Education and Development of Teachers. In Second Handbook of Research on Mathematics Teaching and Learning (pp. 157–223). Information Age Publishing.
Spinath, B. (2005). Akkuratheit der Einschätzung von Schülermerkmalen durch Lehrer und das Konstrukt der diagnostischen Kompetenz [Accuracy of teacher judgments on student characteristics and the construct of diagnostic competence]. Zeitschrift Für Pädagogische Psychologie, 19(1/2), 85–95.
Südkamp, A., Kaiser, J., & Möller, J. (2012). Accuracy of teachers’ judgments of students’ academic achievement: A meta-analysis. Journal of Educational Psychology, 104(3), 743–762.https://doi.org/10.1037/a0027627
Wiggins, G. (1990). The Case for Authentic Assessment. ERIC Digest. https://eric.ed.gov/?id=ED328611
Wiggins, G. (2011). A True Test: Toward More Authentic and Equitable Assessment. Phi Delta Kappan, 92(7), 81–93. https://doi.org/10.1177/003172171109200721
Wilson, M., Hallam, P. J., Pecheone, R. L., & Moss, P. A. (2014). Evaluating the Validity of Portfolio Assessments for Licensure Decisions. Education Policy Analysis Archives, 22(0), Article 0. https://doi.org/10.14507/epaa.v22n6.2014
Yin, R. K. (2018). Case study research and applications. Sage.
Zimmerman, J. (2006). Why Some Teachers Resist Change and What Principals Can Do About It. NASSP Bulletin, 90(3), 238–249. https://doi.org/10.1177/0192636506291521
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The author declares no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Appendices
Appendix 1
A sample portfolio prompt from Aaron’s Calculus class, along with a few select examples of potential tasks for students to include.
Calculus Assessment 1
Below attached are many optimization problems. Demonstrate your understanding of the material that we have covered in this course so far by solving a chosen problem and providing an analysis of the graph. Some topics to include are:
-
Determining a derivative through first principles
-
Limits
-
Continuity
-
Relate the graph of a function to the graph of its derivative and it’s second derivative
-
Instantaneous rates of change (first derivative)
-
Instantaneous rates of change of instantaneous rates of change (second derivative)
-
Average rates of change
-
Curve sketching
Here are the possible optimization problems to choose from (pick one only).
Quadratic Optimization Problems.
We are going to fence in a rectangular field. If we look at the field from above the cost of the vertical sides are $10/ft, the cost of the bottom is $2/ft and the cost of the top is $7/ft. If we have $700 determine the dimensions of the field that will maximize the enclosed area |
---|
We are going to fence in a rectangular field. Starting at the bottom of the field and moving around the field in a counter clockwise manner the cost of material for each side is $6/ft, $9/ft, $12/ft and $14/ft respectively. If we have $1000 to buy fencing material determine the dimensions of the field that will maximize the enclosed area |
The sum of two positive numbers is 48. What is the smallest possible value for the sum of their squares? |
A rectangular field is to be enclosed by fence and then divided into two by another fence parallel to one of the sides. If there are 1800 m of fencing available, find the dimensions of the field of maximum area. What is the area? |
Find two positive numbers x and y that add to 30, and for which 2x2 + 5y2 is a minimum |
Appendix 2
A sample portfolio problem regarding matrices from Jess class.
Trail Mix Problem
There are three varieties of trail mix offered by a catering company, each variety is made in six- pound batches. The varieties are:
-
Healthy Style (HS)
-
Perfectly-Even Style (PES)
-
Sweet-Tooth Style (STS)
One batch of each trail mix requires:
-
HS: A pounds of fruit, B pounds of nuts, and C pound of M&Ms ○
-
PES: D pounds of fruit, E pounds of nuts, and F pounds of M&Ms
-
STS: G pounds of fruit, H pounds of nuts, and J pounds of M&Ms
The catering company gets an order for a summer camp for their last week of camp:
-
Monday: K batches of HS, L batches of PE, and M batch of STS
-
Tuesday: N batches of each style
-
Wednesday: P batch of HS, Q batches of PE, and R STS
-
Thursday: S batch of each style
-
Friday: T batches of HS, U batches of PE, and V batches of STS.
The goal of this problem is to determine the total amount of each ingredient needed for the entire week's order using ONE sequence of matrix multiplications.
Your journal entry will need to explain your rational for setting up the matrices as you did and what the appropriate labeling needs are so that your final answer is a column or row matrix that shows the total amount of each ingredient the catering company will need to fulfill this week’s orders.
Remember to explain how you are certain that your method of solving this problem will result in the desired solution matrix.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Krall, G. Teacher-Designed Mathematical Portfolio Assessments: Motivations, Potential Benefits, and Lessons Learned. Can. J. Sci. Math. Techn. Educ. 23, 303–321 (2023). https://doi.org/10.1007/s42330-023-00280-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42330-023-00280-3