In our utopia schools would work together to collaboratively develop and administer progress testing. It is a waste of resources for schools to reinvent the wheel and start an expensive process of item production and test administration. Progress testing is just that, using tests to measure progress (https://www.youtube.com/watch?v=Mc_-fVmEf1M). That means that individual schools can still have unique curricula and different learning methods. The tests are just the tools to see if the student is making progress within those unique curricula.
In the Netherlands six out of the eight medical schools have combined forces and collaboratively develop and administer progress tests. It has led to an enormous reduction of cost [10], while at the same time it has the benefits as sketched above for the approximately 10,000 learners involved and for the schools themselves. At the same time, it has silenced any discussion on national exams. Naturally, the Netherlands is but a tiny country with few medical schools. Could we not do the same internationally with English speaking schools? Imagine the synergy that this would provide? Let us sketch a few examples of predictable positive developments.
Progress testing with all of its educational benefits would be a low-cost assessment strategy. Schools would have to contribute yearly with a few but high quality items to a central bank. Some cost would be associated with the central administrative and psychometric expertise that is required, but when more schools buy in this would be a marginal cost. Schools would also need to agree on a blueprint for the test. The European Board of Medical Assessors offers progress testing in an online adaptive form (http://www.ebma.eu). This allows a further reduction of the length of the test by about 50%, while the reliability is significantly higher (above 0.90). This is particularly advantageous for students in junior years, a period known to have lower reliabilities in its traditional, paper-based form [2]. With an existing large item bank, schools could flexibly administer progress tests whenever they wish and as frequently as they wish. This would probably deliver the cheapest form of assessment per unit of measurement information in the ability of a test to differentiate learners’ cognitive competence.
Many countries have national licensing exams, but also many countries have no licensing exams. Some countries are preparing or contemplating national exams. Big bang final exams may be useful as a licensing strategy to protect the public [11, 12], but they are not so useful as an educational strategy that would allow both students and schools to improve their performance longitudinally [13]. Moreover, licensing exams are costly. With a comprehensive progress testing approach the need for cognitive national licensing exams evaporates. Written tests predict other written tests and progress tests have shown to accurately predict performance on licencing tests [14]. It is a complete win-win. Schools know how they perform relative to each other, while learners profit from all the feedback. And all of this at a very reasonable cost. With all the knowledge on progress testing, embarking on a traditional licensing exam with all the potential side effects [15] seems almost an outdated strategy.
Finally, an educational synergy should be sketched that might have a phenomenal impact on assessment in medical education. Once a system of progress testing is in place in a school’s assessment strategy, the big question is what it replaces. In some schools the progress test is the only form of knowledge testing [8]. Imagine the resource implications of such a strategy! Other assessment strategies would be possible as well. With a periodic progress test in place, one would have a very precise view of a learner’s knowledge. There is not much point repeating such assessments again locally. It allows assessment in the school to be more creative. With the massive move towards competency-based learning, there is a great need for more authentic forms of assessment and assessing behaviours. It is these assessments that a school might focus on. With the resources being saved, more expenditure is available for these authentic forms of assessment. This would have a massive impact and would drive education in a very desirable direction.