Skip to main content
SpringerLink
Log in

Test Design, Development, and Results Interpretation – The Tests Themselves

  • Chapter
  • First Online:
Thirty Years of Literacies Testing at the University of Cape Town

  • 14 Accesses

Abstract

A detailed assessment of the theoretical and construct design and development of the tests that the university has led over the last three decades. The chapter focuses on the various tests; how they are conceptualised and designed; how they are analysed; and on how test data are generated from these tests. The chapter also looks at the innovative and critical ways in which the work has engaged with data from the tests and how these data have been presented as alternate to standard achievement test data. Ways in which data might be used to support student learning, academic teaching or the design of programmes are also discussed and evaluated.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Alternative Admissions Research Project (AARP). (2007). Reasoning test skills specifications table. University of Cape Town.

    Google Scholar 

  • Alternative Admissions Research Project (AARP). (2010). The mathematics comprehension test (MCOM) skills specifications. University of Cape Town.

    Google Scholar 

  • Archer, A., Frith, V., & Prince, R. N. (2002). A project-based approach to numeracy practices at university focusing on HIV/AIDS. Literacy and Numeracy Studies, 11(2), 123–131.

    Google Scholar 

  • Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.

    Google Scholar 

  • Baynham, M., & Baker, D. (2002). ‘Practice’ in literacy and numeracy research: Multiple perspectives. Ways of Knowing, 2(1), 1–9.

    Google Scholar 

  • Boaler, J. (2002). Exploring the nature of Mathematical activity: Using theory, research and ‘working hypotheses’ to broaden conceptions of mathematics knowing. Educational Studies in Mathematics, 51(1), 3–21. https://doi.org/10.1023/A:1022468022549

    Article  Google Scholar 

  • Bohlmann, C., & Braun, M. (2006). Cognitive academic mathematical proficiency (CAMP). In H. Griesel (Ed.), Access and entry level benchmarks: The National Benchmark Tests Project (pp. 35–41). Higher Education South Africa.

    Google Scholar 

  • Bohlmann, C. A., & Pretorius, E. J. (2002). Reading skills and mathematics: The practice of higher education. South African Journal of Higher Education, 16(3), 196–206.

    Article  Google Scholar 

  • Bohlmann, C. A., Prince, R. N., & Deacon, A. (2017). Mathematical errors made by high performing candidates writing the National Benchmark Tests. Pythagoras, 38(1), 1–10. https://doi.org/10.4102/pythagoras.v38i1.292

    Article  Google Scholar 

  • CETAP. (2019). The National Benchmark Tests National Report. University of Cape Town.

    Google Scholar 

  • Chalton, D., Yeld, N., & Visser, A. (2001). Survival analysis of University tenure (Report prepared for the AARP, University of Cape Town). University of Cape Town.

    Google Scholar 

  • Chapman, A. (1998). Academic numeracy: Developing a framework. Literacy and Numeracy Studies, 8(1), 99–121.

    Google Scholar 

  • Chapman, A., & Lee, A. (1990). Rethinking literacy and numeracy. Australian Journal of Education, 34(3), 277–289. https://doi.org/10.1177/000494419003400305

    Article  Google Scholar 

  • Cliff, A. (2014). Entry-level students’ reading abilities and what these abilities might mean for academic readiness. Language Matters, 45(3), 313–324. https://doi.org/10.1080/10228195.2014.958519

    Article  Google Scholar 

  • Cliff, A. (2015). The National Benchmark Test in Academic literacy: How might it be used to support teaching in higher education? Language Matters, 46(1), 3–21. https://doi.org/10.1080/10228195.2015.1027505

    Article  Google Scholar 

  • Cliff, A., & Hanslo, M. (2009). The design and use of ‘alternate’ assessments of academic literacy as selection mechanisms in higher education. Southern African Linguistics and Applied Language Studies, 27(3), 265–276. https://doi.org/10.2989/SALALS.2009.27.3.5.939

    Article  Google Scholar 

  • Cliff, A., & Yeld, N. (2006). Domain 1 – Academic literacy. In H. Griesel (Ed.), Access and entry level benchmarks: The National Benchmark Tests Project (pp. 19–27). Higher Education South Africa.

    Google Scholar 

  • Cliff, A., Yeld, N., & Hanslo, M. (2003). Assessing the academic literacy skills of entry-level students, using the Placement Test in English for Educational Purposes (PTEEP). In Bi-annual conference of the European Association for Research in Learning and Instruction (EARLI), Padova, Italy.

    Google Scholar 

  • Cliff, A., Ramaboa, K., & Pearce, C. (2007). The assessment of entry-level students’ academic literacy: Does it matter? Ensovoort, 11(2), 33–48.

    Google Scholar 

  • Cloete, N., Kulati, T., & Phala, M. (2000). Leadership and institutional change in higher education. Papers from a seminar in Gordon’s Bay, South Africa, 16–19 May 1999. Centre for Higher Education Transformation.

    Google Scholar 

  • Conradie, J., & Frith, J. (2000). Comprehension tests in Mathematics. Educational Studies in Mathematics, 42(3), 225–235. https://doi.org/10.1023/A:1017502919000

    Article  Google Scholar 

  • Dasgupta, U., Mani, S., Sharma, S., & Singhal, S. (2022). Effects of peers and rank on cognition, preferences, and personality. The Review of Economics and Statistics, 104(3), 587–601. https://doi.org/10.1162/rest_a_00966

    Article  Google Scholar 

  • Frith, V. (2011). Mathematical literacy for higher education. Learning and Teaching Mathematics, 2011(10), 3–7.

    Google Scholar 

  • Frith, V. (2012). A quantitative literacy course for Humanities and Law students: The challenges of a context-based curriculum. Perspectives in Education, 30(2), 41–49.

    Google Scholar 

  • Frith, V., & Lloyd, P. (2016). Investigating proportional reasoning in a university quantitative literacy course. Numeracy: Advancing Education in Quantitative Literacy, 9(1), Article 3. https://doi.org/10.5038/1936-4660.9.1.3

    Article  Google Scholar 

  • Frith, V., & Prince, R. (2006). Domain 1 - Quantitative Literacy. In H. Griesel (Ed.), Access and entry-level benchmarks. The National Benchmark Tests Project (pp. 28–34). Higher Education South Africa.

    Google Scholar 

  • Frith, V., & Prince, R. (2017). The quantitative literacy of South African school-leavers who qualify for higher education. Pythagoras, 38(1), 1–14. https://doi.org/10.4102/pythagoras.v38i1.355

    Article  Google Scholar 

  • Frith, V., & Prince, R. N. (2018). The National Benchmark Quantitative Literacy Test for applicants to South African Higher Education. Numeracy: Advancing Education in Quantitative Literacy, 11(2), Article 3. https://doi.org/10.5038/1936-4660.11.2.3

    Article  Google Scholar 

  • Frith, V., Bowie, L., Gray, K., & Prince, R. (2003). Mathematical literacy of students entering first year at a South African university. In Ninth National Congress of the Association for Mathematics Education of South Africa. University of Cape Town.

    Google Scholar 

  • Frith, J., Frith, V., & Conradie, J. (2006). The assessment of prospective students’ potential to learn undergraduate mathematics. In Proceedings of the Third International Conference on the Teaching of Mathematics (ICTM3). Istanbul, Turkey.

    Google Scholar 

  • Gal, I., Van Groenestijn, M., Manley, M., Schmitt, M. J., & Tout, D. (2005). Adult numeracy and its assessment in the ALL survey: A conceptual framework and pilot results. In T. Scott Murray, Y. Clermont, & M. Binkley (Eds.), Measuring adult literacy and life skills: New frameworks for assessment (pp. 137–191). Statistics Canada.

    Google Scholar 

  • Griesel, H. (2006). Access and entry level benchmarks: The National Benchmark Tests Project. Higher Education South Africa.

    Google Scholar 

  • Gunston, G., & Frith, V. (2011). Towards understanding the quantitative literacy demands of a first-year medical curriculum. African Journal of Health Professions Education, 3(1), 19–23.

    Google Scholar 

  • Haeck, W., Yeld, N., Conradie, J., Robertson, N., & Shall, A. (1997). A developmental approach to mathematics testing for university admissions and course placement. Educational Studies in Mathematics, 33(1), 71–91. https://doi.org/10.1023/A:1002974021690

    Article  Google Scholar 

  • Hughes-Hallett, D. (2001). Achieving numeracy: The challenge of implementation. In L. Arthur Steen (Ed.), Mathematics and democracy: The case for quantitative literacy (pp. 93–98). The National Council on Education and the Disciplines.

    Google Scholar 

  • Jablonka, E. (2003). Mathematical literacy. In A. J. Bishop, M. A. Clements, C. Keitel, J. Kilpatrick, & F. K. S. Leung (Eds.), Second international handbook of Mathematics education (pp. 75–102). Springer.

    Chapter  Google Scholar 

  • Kelly, S., Johnston, B., & Baynham, M. (2007). The concept of numeracy as social practice. In S. Kelly, B. Johnston, & K. Yasukawa (Eds.), The adult numeracy handbook: Reframing adult numeracy in Australia (pp. 35–49). NSW Adult Literacy and Numeracy Australian Research Consortium.

    Google Scholar 

  • Lloyd, P., & Frith, V. (2013). Proportional reasoning as a threshold to numeracy at university: A framework for analysis. Pythagoras, 34(2), 1–9. https://doi.org/10.4102/pythagoras.v34i2.234

    Article  Google Scholar 

  • McNamara, T. F. (1996). Measuring second language performance. Longman.

    Google Scholar 

  • Mullis, I. V. S., Martin, M. O., Smith, T. A., Garden, R. A., Gregory, K. D., Gonzalez, E. J., Chrostowski, S. J., & O’Connor, K. M. (2003). Trends in international mathematics and science study (TIMMS): Assessment frameworks and specifications 2003 (2nd ed.). International Association for the Evaluation of Educational Achievement and International Study Center, Lynch School of Education.

    Google Scholar 

  • Murphy, R., & Weinhardt, F. (2020). Top of the class: The importance of ordinal rank. The Review of Economic Studies, 87(6), 2777–2826. https://doi.org/10.1093/restud/rdaa020

    Article  Google Scholar 

  • NAGB. (2004). Mathematics framework for the 2005 National Assessment of Educational Progress. U.S. Department of Education.

    Google Scholar 

  • Naidoo, I., Wedekind, V., & Essack, S. Y. (2012). Selection tools predictive of success in the health sciences – NATED vs. NSC students. South African Journal of Higher Education, 26(3), 472–486.

    Google Scholar 

  • OECD. (2003). The PISA 2003 assessment framework–Mathematics, reading, science, and problem-solving knowledge and skills. OECD.

    Google Scholar 

  • Pretorius, E. J., & Bohlmann, C. A. (2003). A reading intervention programme for mathematics students: The practice of higher education. South African Journal of Higher Education, 17(2), 226–236.

    Google Scholar 

  • Pretorius, E., & Bohlmann, C. (2008). Relationships between mathematics and literacy: Exploring some underlying factors. Pythagoras, 67(1), 42–55.

    Google Scholar 

  • Prince, R. N., & Archer, A. H. (2006). Quantitative literacy as situated social practice in Higher Education. International Journal of Learning, 12(7), 227–233.

    Google Scholar 

  • Prince, R., & Archer, A. (2008). A new literacies approach to academic numeracy practices in Higher Education. Literacy and Numeracy Studies, 16(1), 63–75. https://doi.org/10.5130/lns.v16i1.1948

    Article  Google Scholar 

  • Prince, R., & Frith, V. (2009). A framework for understanding the quantitative literacy demands of higher education. South African Journal of Higher Education, 23(1), 83–97. https://doi.org/10.4314/sajhe.v23i1.44804

    Article  Google Scholar 

  • Prince, R., & Simpson, Z. (2016). Quantitative literacy practices in civil engineering study: Designs for teaching and learning. In Proceedings of the 5th international conference on designs for learning. Aalborg.

    Google Scholar 

  • Prince, R., Frith, V., & Jaftha, J. (2004). Mathematical literacy of students in first year of Medical School at a South African University. In 12th annual conference of the Southern African Association for Research in Mathematics, Science and Technology Education (SAARMSTE). University of Cape Town.

    Google Scholar 

  • Scholtz, D., & Allen-Ile, C. O. K. (2007). Is the SATAP test an indicator of academic preparedness for first year university students? South African Journal of Higher Education, 21(7), 919–939.

    Google Scholar 

  • Shay, S., Collier-Reed, B., Hendry, J., Marquard, S., Kefale, K., Prince, R., Steyn, S., Mpofu-Mketwa, T., & Carstens, R. (2020). From gatekeepers to gateways: Courses impeding graduation annual report 2019. University of Cape Town.

    Google Scholar 

  • Steen, L. A. (2001). The case for quantitative literacy. In L. A. Steen (Ed.), Mathematics and democracy: The case for quantitative literacy (pp. 93–98). The National Council on Education and the Disciplines.

    Google Scholar 

  • Street, B. V. (2005). Applying new literacy studies to numeracy as social practice. In A. Rogers (Ed.), Urban literacy: Communication, identity and learning in development contexts (pp. 87–96). UNESCO Institute for Education.

    Google Scholar 

  • Street, B., & Baker, D. (2006). Chapter 10. So, what about multimodal numeracies? In K. Pahl & J. Rowsell (Eds.), Travel notes from the new literacy studies: Instances of practice (pp. 219–233). Multilingual Matters.

    Chapter  Google Scholar 

  • Visser, A. J., & Hanslo, M. (2005). Approaches to predictive studies: Possibilities and challenges. South African Journal of Higher Education, 19(6), 1160–1176.

    Google Scholar 

  • Yeld, N. (2001). Assessment, equity and language of learning: Key issues for higher education selection in South Africa. Unpublished PhD thesis, University of Cape Town.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centre for Higher Education Development, University of Cape Town, Western Cape, South Africa

    Alan Cliff

Authors
  1. Alan Cliff
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Cliff, A. (2024). Test Design, Development, and Results Interpretation – The Tests Themselves. In: Thirty Years of Literacies Testing at the University of Cape Town. Springer, Cham. https://doi.org/10.1007/978-3-031-58679-8_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-58679-8_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-58678-1

  • Online ISBN: 978-3-031-58679-8

  • eBook Packages: EducationEducation (R0)

Publish with us

Policies and ethics

Search

Navigation