Abstract
Programmatic assessment is an assessment system that ensures comprehensive decision-making concerning students’ performance based on rigorous-multiple data points. Portfolios possess an essential role in the implementation of programmatic assessment. It serves as a platform to collect and record data points and reflect on students’ progress and achievement. As a part of a larger project aiming to implement programmatic assessment as an undergraduate medical national exit exam in Indonesia, one of the first steps is to develop an e-portfolio system. We used the design thinking approach to develop the e-portfolio since it will be widely used throughout medical schools in Indonesia. Accordingly, the current study aimed to design a national-level e-portfolio system for undergraduate medical education in Indonesia. We conducted participatory action research as an iterative process to develop an e-portfolio design using the Stanford five-step design thinking approach. Best practices in developing and utilizing e-portfolios were reviewed by the research team based on several theoretical frameworks. The Stanford five-step design thinking includes empathize, define, ideate, prototype, and test. The generic e-portfolio was developed based on the ideation stage by applying the results of the define stage, leading to the prototyping phase. The national e-portfolio was established to incorporate several features clustered into the widely-known SOAP mnemonic: S (Subjective—Student Reflection), O (Objective—Assessment Outcomes), A (Assessment—Diagnosing Learning Issues), and P (Plan—Formulating Improvement and Learning Plan). The e-portfolio is intended to be used by students and faculty advisors. Applying e-portfolio and programmatic assessment requires students and advisors to be familiar with reflective inquiries. The e-portfolio should be managed and interpreted appropriately. Otherwise, it might become an assessment pile and thus will make all intensive work and resources in vain.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Van der Vleuten CP, Schuwirth LW, Driessen EW, Dijkstra J, Tigelaar D, Baartman LK et al (2012) A model for programmatic assessment fit for purpose. Med Teach 34(3):205–214. https://doi.org/10.3109/0142159X.2012.652239
Van Der Vleuten CPM, Schuwirth LWT, Driessen EW, Govaerts MJB, Heeneman S (2015) Twelve tips for programmatic assessment. Med Teach 37(7):641–646. https://doi.org/10.3109/0142159X.2014.973388
Heeneman S, de Jong LH, Dawson LJ, Wilkinson TJ, Ryan A, Tait GR et al (2021) Ottawa 2020 consensus statement for programmatic assessment—1. Agreement on the principles. Med Teach 43(10):1139–1148. https://doi.org/10.1080/0142159X.2021.1957088
Ainin DQ, Suhoyo Y, Duarsa ABS, Claramita M (2023) Development of a self-evaluation instrument with programmatic assessment components for undergraduate medical students. Eur J Educ 12(2):649–662. https://doi.org/10.12973/eu-jer.12.2.649
Hasso Plattner Institute of Design. Design Thinking Bootcamp Bootleg. Stanford University (2009). https://static1.squarespace.com/static/57c6b79629687fde090a0fdd/t/58890239db29d6cc6c3338f7/1485374014340/METHODCARDS-v3-slim.pdf.
Baum F, MacDougall C, Smith D (2006) Participatory action research. J Epidemiol Community Health 60(10):854–857
Sandars J, Goh P-S (2020) Design thinking in medical education: the key features and practical application. J Med Educ Curric Dev 7:2382120520926518. https://doi.org/10.1177/2382120520926518
Hong DZ, Lim AJS, Tan R, Ong YT, Pisupati A, Chong EJX et al (2021) A systematic scoping review on portfolios of medical educators. J Med Educ Curric Dev 8:23821205211000356
van der Schaaf M, Donkers J, Slof B, Moonen-van Loon J, van Tartwijk J, Driessen E et al (2017) Improving workplace-based assessment and feedback by an e-portfolio enhanced with learning analytics. Educ Tech Res Dev 65(2):359–380. https://doi.org/10.1007/s11423-016-9496-8
Moores A, Parks M (2010) Twelve tips for introducing e-portfolios with undergraduate students. Med Teach 32(1):46–49. https://doi.org/10.3109/01421590903434151
Driessen E, van Tartwijk J, van der Vleuten C, Wass V (2007) Portfolios in medical education: why do they meet with mixed success? A systematic review. Med Educ 41(12):1224–1233. https://doi.org/10.1111/j.1365-2923.2007.02944.x
Buckley S, Coleman J, Davison I, Khan KS, Zamora J, Malick S, et al (2009) The educational effects of portfolios on undergraduate student learning: a best evidence medical education (BEME) systematic review. BEME Guide No 11. Med Teach 31(4):282–98. https://doi.org/10.1080/01421590902889897
Greviana N, Mustika R, Soemantri D (2020) Development of e-portfolio in undergraduate clinical dentistry: how trainees select and reflect on evidence. Eur J Dent Educ 24(2):320–327
Greviana N, Mustika R, Soemantri D (2020) E-portfolio system development for undergraduate clinical dentistry: an action research study. Padjajaran J Dentistry 32(2):91–100
Sherman R (2015) Project management. In: Sherman R (ed) Business intelligence guidebook. Morgan Kaufmann, Boston, pp 449–492
Business Model Inc. Value Proposition Canvas. Amsterdam: Business Model Inc (2022). https://www.businessmodelsinc.com/en/inspiration/tools/value-proposition-canvas
Utomo PS, Sumunar DSEW, Greviana N, Soemantri D, Claramita M (2022) Intellectual property rights of an electronic portfolio platform. Min of Law Rep of Indonesia. No. EC00202267866
Tan R, Qi Ting JJ, Zhihao Hong D, Sing Lim AJ, Ong YT, Pisupati A et al (2022) Medical student portfolios: a systematic scoping review. J Med Educ Curric Dev 9:23821205221076024. https://doi.org/10.1177/23821205221076022
Utomo PS, Randita ABT, Riskiyana R, Kurniawan F, Aras I, Abrori C et al (2022) Predicting medical graduates’ clinical performance using national competency examination results in Indonesia. BMC Med Educ 22(1):254. https://doi.org/10.1186/s12909-022-03321-x
Acknowledgements
The authors express gratitude to all institutions and participants involved in the project and evaluation.
Funding
The project received funding from the Ministry of Education, Culture, Research and Technology of the Republic of Indonesia.
Author information
Authors and Affiliations
Contributions
PSU designed the e-portfolio system, provided training and facilitations during the program, data collection and analysis, drafted the manuscript, edited, and finalized the manuscript. NG designed the e-portfolio system, provided training and facilitations during the program, data collection and analysis, and drafted the manuscript. DSWES designed the e-portfolio system, provided training and facilitations during the program, data collection and analysis, and drafted the manuscript. DS provided suggestions for the e-portfolio system, provided training during the program, and drafted the manuscript. MC provided recommendations for the e-portfolio system, provided training during the program, drafted the manuscript, and supervised the project.
Corresponding author
Editor information
Editors and Affiliations
Ethics declarations
The project and study were granted ethical approval by the Medical and Health Research Ethics Committee (MHREC) Faculty of Medicine Public Health and Nursing Universitas Gadjah Mada No: KE/FK/0833/EC/2022. All participants provided their consent prior to joining the project.
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Utomo, P.S., Greviana, N., Sumunar, D.S.E.W., Soemantri, D., Claramita, M. (2023). Advancing Programmatic Assessment Using e-Portfolio for Undergraduate Medical Education: A National Development Report. In: Claramita, M., Soemantri, D., Hidayah, R.N., Findyartini, A., Samarasekera, D.D. (eds) Character Building and Competence Development in Medical and Health Professions Education. INA-MHPEC 2022. Springer Proceedings in Humanities and Social Sciences. Springer, Singapore. https://doi.org/10.1007/978-981-99-4573-3_1
Download citation
DOI: https://doi.org/10.1007/978-981-99-4573-3_1
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-4572-6
Online ISBN: 978-981-99-4573-3
eBook Packages: MedicineMedicine (R0)