Abstract
Structured Self-Regulated Learning (SSRL) diaries have the potential for combining the development and assessment of a student’s SRL processes over time. The aim of this study was to evaluate the extent to which an SSRL diary can develop SRL and provide a reliable longitudinal assessment of SRL development in academically low-achieving undergraduate medical students. We conducted a quasi-experimental study with low-achieving medical students at Tehran University of Medical Sciences. The intervention was a weekly SSRL diary, with 21 items in two parts (before and after studying) that was integrated with weekly explicit SRL training. A repeated measures ANOVA was performed to assess the participants' SRL development across time. We conducted generalizability theory analysis in two designs; the first was to assess the reliability of the total diary score in assessing low-achieving medical students’ SRL and the second was to assess the efficacy of the four-week intervention results in improving the low-achieving medical students’ SRL. Each participant (n = 20) completed four SSRL diaries. There were significant positive changes during the intervention in the students’ measures of total SRL, time estimation of study, time spent on study, concentration, elaboration, organization, self-monitoring, and self-evaluation. The absolute and relative generalizability coefficients for the first design, which indicates the reliability of the students’ SRL scores, were 0.71 and 0.77. The absolute and relative generalizability coefficients for the second design, which presents the reliability of the improvement of students’ SRL across time were 0.79 and 0.87. The results of this study suggest that SSRL diaries combined with explicit training can provide an effective and reliable method for combining the development and assessment of SRL in low-achieving medical students’ SRL over time.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
Artino, A. R., Jr., Hemmer, P. A., & Durning, S. J. J. A. M. (2011). Using self-regulated learning theory to understand the beliefs, emotions, and behaviors of struggling medical students. Academic Medicine, 86(10), S35–S38.
Artino, A. R., Jr., Cleary, T. J., Dong, T., Hemmer, P. A., & Durning, S. J. J. M. (2014). Exploring clinical reasoning in novices: A self-regulated learning microanalytic assessment approach. Medical Education, 48(3), 280–291.
Bellhäuser, H., Lösch, T., Winter, C., Schmitz, B. J. T. I., & Education, H. (2016). Applying a web-based training to foster self-regulated learning—Effects of an intervention for large numbers of participants. The Internet and Higher Education, 31, 87–100.
Bierer, S. B., Dannefer, E. F., & Tetzlaff, J. E. (2015). Time to loosen the apron strings: cohort-based evaluation of a learner-driven remediation model at one medical school. Journal of General Internal Medicine, 30(9), 1339–1343.
Bloch, R., & Norman, G. (2012). Generalizability theory for the perplexed: A practical introduction and guide: AMEE Guide No. 68. Medical Teacher, 34(11), 960–992.
Boileau, E., St-Onge, C., & Audétat, M.C., (2017). Is there a way for clinical teachers to assist struggling learners? A synthetic review of the literature. Advances in medical education and practice, pp.89–97.
Boruchovitch, E., & Ganda, D. R. (2013). Fostering self-regulated skills in an educational psychology course for Brazilian preservice teachers. Journal of Cognitive Education and Psychology, 12(2), 157–177.
Broadbent, J., Panadero, E., & Fuller-Tyszkiewicz, M. (2020). Effects of mobile-app learning diaries vs online training on specific self-regulated learning components. Educational Technology Research and Development, 68, 2351–2372.
Cardinet, J., Johnson, S., & Pini, G. (2011). Applying generalizability theory using EduG. Routledge.
Cardinet, J., Tourneur, Y., & Allal, L. (1976). The symmetry of generalizability theory: Applications to educational measurement. Journal of Educational Measurement, pp.119–135.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences Lawrence Earlbaum Associates. 20th–. Lawrence Earlbaum Associates.
Cook, D. A., & Artino, A. R., Jr. (2016). Motivation to learn: An overview of contemporary theories. Medical Education, 50(10), 997–1014.
Dignath-van Ewijk, C., Fabriz, S., & Büttner, G. (2015). Fostering self-regulated learning among students by means of an electronic learning diary: A training experiment. Journal of Cognitive Education and Psychology, 14(1), 77–97.
Dörrenbächer, L., & Perels, F. J. I. (2016). More is more? Evaluation of interventions to foster self-regulated learning in college. International Journal of Educational Research, 78, 50–65.
Fabriz, S., Dignath-van Ewijk, C., Poarch, G., & Büttner, G. J. E. J. (2014). Fostering self-monitoring of university students by means of a standardized learning journal—a longitudinal study with process analyses. European Journal of Psychology of Education, 29(2), 239–255.
Farrokhi, N., & Bahrami, L. (2016). The reliability of high school third grade final exams using Generalizability Theory. Educational Innovations, 15(3), 170–188.
Farrokhi, N., & Bahrami, L. (2017). Introduction of Generalizability theory and describing the process of a measurement study to assessing reliability. Educational Measurement, 24(6), 43–81.
Foong, C. C., Bashir Ghouse, N. L., Lye, A. J., Khairul Anhar Holder, N. A., Pallath, V., Hong, W. H., Sim, J. H., & Vadivelu, J. (2021). A qualitative study on self-regulated learning among high performing medical students. BMC Medical Education, 21(1), 320.
Gandomkar, R., & Sandars, J. (2018). Clearing the confusion about self-directed learning and self-regulated learning. Medical Teacher, 40(8), 862–863.
Gandomkar, R., Mirzazadeh, A., Jalili, M., Yazdani, K., Fata, L., & Sandars, J. (2016). Self-regulated learning processes of medical students during an academic learning task. Medical Education, 50(10), 1065–1074.
Gandomkar, R., Sandars, J., & Mirzazadeh, A. (2018). Many questions remain to be answered about understanding self-regulated learning in the clinical environment. Medical Education, 52(9), 882–884.
Gandomkar, R., Yazdani, K., Fata, L., Mehrdad, R., Mirzazadeh, A., Jalili, M., & Sandars, J. J. M. E. (2020). Using multiple self-regulated learning measures to understand medical students’ biomedical science learning. Medical Education, 54(8), 727–737.
Leggett, H., Sandars, J., & Burns, P. (2012). Helping students to improve their academic performance: a pilot study of a workbook with self-monitoring exercises. Medical Teacher, 34(9), 751–753.
Lucieer, S. M., Jonker, L., Visscher, C., Rikers, R. M., & Themmen, A. P. (2016). Self-regulated learning and academic performance in medical education. Medical Teacher, 38(6), 585–593.
Medina-Ramírez, R. I., Álamo-Arce, D. D., Rodriguez-Castro, F., Cecilio-Fernandes, D., Sandars, J., & Costa, M. J. (2020). Self-regulated learning microanalysis for the study of the performance of clinical examinations by physiotherapy students. BMC Medical Education, 20(1), 233. https://doi.org/10.1186/s12909-020-02149-7
Morokhovets, H. Y., Uvarkina, O. V., Bieliaieva, O. M., Lysanets, Y. V., Senkevych, H. A., & Stetsenko, S. A. (2019). development of motivation towards education in medical students. Wiadomosci Lekarskie (warsaw, Poland 1960), 72(1), 7–11.
O’Neil, H. F. (2014). Learning strategies. Academic Press.
Orsini, C., Binnie, V. I., & Wilson, S. L. (2016a). Determinants and outcomes of motivation in health professions education: A systematic review based on self-determination theory. Journal of Educational Evaluation for Health Professions, 13, 19. https://doi.org/10.3352/jeehp.2016.13.19
Orsini, C., Binnie, V. I., & Wilson, S. L. (2016b). Determinants and outcomes of motivation in health professions education: a systematic review based on self-determination theory. Journal of Educational Evaluation for Health Professions. 13.
Panadero, E., Klug, J., & Järvelä, S. J. S. J. (2016). Third wave of measurement in the self-regulated learning field: When measurement and intervention come hand in hand. Scandinavian Journal of Educational Research, 60(6), 723–735.
Roth, A., Ogrin, S., & Schmitz, B. (2016). Assessing self-regulated learning in higher education: A systematic literature review of self-report instruments. Educational Assessment, Evaluation and Accountability, 28(3), 225–250.
Rowden Quince, B. (2013). The effects of self-regulated learning strategy instruction and structured-diary use on students' self-regulated learning conduct and academic success in online community-college general education courses.
Saddawi-Konefka, D., Baker, K., Guarino, A., Burns, S. M., Oettingen, G., Gollwitzer, P. M., & Charnin, J. E. (2017). Changing resident physician studying behaviors: A randomized, comparative effectiveness trial of goal setting versus use of WOOP. Journal of Graduate Medical Education, 9(4), 451–457.
Sandars, J. (2020). Self-Regulated Learning: The essential factor for understanding and improving academic and clinical performance. Sci Med, 30(1), e36232–e36232.
Sandars, J., & Cleary, T. J. J. M. (2011). Self-regulation theory: applications to medical education: AMEE Guide No. 58. Medical Teacher, 33(11), 875–886.
Sandars, J., Patel, R., Steele, H., & McAreavey, M. (2014). Developmental student support in undergraduate medical education: AMEE Guide No. 92. Medical Teacher, 36(12), 1015–1026.
Schmitz, B., & Perels, F. (2011). Self-monitoring of self-regulation during math homework behaviour using standardized diaries. Metacognition and Learning, 6(3), 255–273.
Schmitz, B., & Wiese, B. S. (2006). New perspectives for the evaluation of training sessions in self-regulated learning: Time-series analyses of diary data. Contemporary Educational Psychology, 31(1), 64–96.
Stegers-Jager, K. M., Cohen-Schotanus, J., & Themmen, A. P. N. (2013). The effect of a short integrated study skills programme for first-year medical students at risk of failure: A randomised controlled trial. Medical Teacher, 35(2), 120–126. https://doi.org/10.3109/0142159X.2012.733836
Streiner, D. L., Norman, G. R., & Cairney, J. (2015). Health measurement scales: A practical guide to their development and use. Oxford University Press.
Webb, N. M., Shavelson, R. J., & Haertel, E. H. (2006). 4 reliability coefficients and generalizability theory. Handbook of Statistics, 26, 81–124.
Wilkinson, T. J., Wells, J. E., & Bushnell, J. A. J. M. E. (2005). Using a diary to quantify learning activities. Medical Education, 39(7), 657–664.
Winston, K. A., Van Der Vleuten, C. P., & Scherpbier, A. J. J. M. E. (2010). At-risk medical students: Implications of students’ voice for the theory and practice of remediation. Medical Education, 44(10), 1038–1047.
Winston, K. A., van der Vleuten, C. P., & Scherpbier, A. J. J. M. T. (2014). Prediction and prevention of failure: An early intervention to assist at-risk medical students. Medical Teacher, 36(1), 25–31.
Zarei Hajiabadi, Z., Gandomkar, R., Sohrabpour, A. A., & Sandars, J. (2022). Developing low-achieving medical students’ self-regulated learning using a combined learning diary and explicit training intervention. Medical Teacher. https://doi.org/10.1080/0142159X.2022.2152664
Zarei Hajiabadi, Z., Gandomkar, R., Sandars, J., & Ashrafifard, H. (2023). Self-regulated learning diary interventions and the implications for health professions education: A systematic review. under review.
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory into Practice, 41(2), 64–70.
Acknowledgements
The authors wish to thank all the medical students participating in this study. Authors are also grateful to all faculties, TUMS educational bodies including administrators and their staff, medical educationists and medical students who helped finalize the design and facilitate the intervention implementation.
Funding
This study was funded by the Tehran University of Medical Sciences. Tehran. Iran. Grant No: 96-04-214-36501.
Author information
Authors and Affiliations
Contributions
ZZ contributed to the study design, data gathering, analysis and interpretation of data and drafting of the manuscript. JS and JN contributed to the study design, analysis and interpretation of data and critical revision of the article. RG contributed to the study design, participated in the analysis and interpretation of data and drafting the manuscript. All authors (ZZ, JS, JN, RG) approved the final paper for submission.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Ethical approval
This study was approved by the Research Ethics Committee of the Tehran University of Medical Sciences, Tehran, Iran. Approval ID: IR.TUMS.MEDICINE.REC.1398.377.
Consent to participate
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix 1
Appendix 1
Translated version of weekly SSRL diary
Construct | Item | Scale | |
|---|---|---|---|
Before learning section: at the beginning of the study week | Goal setting | 1. List all your learning goals of NSB for the upcoming week | open-ended |
Time estimation | 2. How much time do you anticipate studying of NSB for the upcoming week? …. hours | open-ended | |
Goal orientation | 3. During the upcoming week, I will study for NSB because; • I want to be better than others □ • I want to get a good grade □ • I want to pass the exam □ • I want others to realize my potential □ • I want to learn the content well □ • I'm interested in NSB content □ • It is important to learn about NSB content □ • Other □ (If your reason or reasons are out of the case, please mention it) ……………………. | Multi response | |
Self-efficacy | 4. I'm sure that by the end of the upcoming week I will achieve all my NSB learning goals | 7-point Likert | |
After learning section: at the end of the study week | Time spent | 5. How much time did you spend studying for NSB last week? ….. hours | open-ended |
Concentration | 6. Over the past week, I have been managing issues that interrupt my learning while studying for NSB | 7-point Likert | |
Cognitive strategies | 7. Over the past week, I have been summarizing important points while studying for NSB 8. Over the past week, while studying for NSB, I have underlined or highlighted important points 9. During the past week, while studying for NSB, I have linked the information to my previous knowledge or the content of other courses 10. During the past week, I have been recounting topics while studying for NSB 11. Over the past week, I have reread NSB materials several times 12. During the past week, while studying for NSB, I categorized content into shapes, tables, diagrams, and so on | 7-point Likert | |
Self-monitoring | 13. Over the past week, while studying for NSB, I have been asking myself questions to make sure I have learned the material 14. Over the past week, while studying for NSB, I have been comparing my study speed with my schedule | 7-point Likert | |
Self-evaluation | 15. During the past week, I have been following my schedule while studying for NSB 16. Over the past week, I have achieved my goals of studying for NSB 17. I'm satisfied with the results of my study for NSB over the past week | 7-point Likert | |
Attribution | 18. Which of the following option or options do you attribute your satisfaction or dissatisfaction with studying for NSB during past week? (You can select more than one option if necessary) • The amount of effort □ • The extent of my abilities □ • The ability of the teacher/instructor □ • Features of NSB □ • my interest regarding the NSB content □ • Chance □ • Other (if your reason or reasons are out of the case, please mention it) ……………………. | Multi response | |
Self-reflection | 19. Describe your strengths in studying for NSB in last week 20. Describe your weaknesses in studying for NSB in last week 21. What can you do differently from last week to achieve your study goals for NSB in next week? | open-ended |
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zarei Hajiabadi, Z., Sandars, J., Norcini, J. et al. The potential of structured learning diaries for combining the development and assessment of self-regulated learning. Adv in Health Sci Educ 29, 27–43 (2024). https://doi.org/10.1007/s10459-023-10239-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10459-023-10239-6