Evaluating the Quality of Mindfulness Instruction Delivered in School Settings: Development and Validation of a Teacher Quality Observational Rating Scale
As interest increases in mindfulness in education programs for youth, there is a need to develop reliable measures of the quality of program implementation. This paper describes the development and psychometric properties of a measure that can be used to assess and monitor quality of implementation of mindfulness programs/curricula in typical classroom or out-of-school settings. The Teaching Mindfulness in Education Observation Scale (TMEOS) is a 28-item instrument that integrates qualitative and quantitative aspects of mindfulness instruction. Items focus on procedural adherence as well as aspects of implementation that reflect embodiment during instructional delivery (e.g., alignment with the attitudinal foundations of mindfulness). Reliability and validity data were examined and indicated that the four major scoring domains and key features showed adequate inter-rater reliability and internal consistency. We conclude that observational assessment of multiple dimension of implementation quality, including adherence and process-oriented aspects of implementation such as embodiment, can be reliably used to assess implementation quality of mindfulness programs in education settings. However, adequate preparation and training are critical. Implications and directions for future research are discussed.
KeywordsFidelity Implementation Training Professional development Coaching Mindfulness Schools Education
The authors would like to acknowledge the contributions of Robert Roeser and Yoonkyung Oh for their helpful suggestions and comments in preparing this manuscript.
The project described was supported by Award Number R305A140113 from the Institute of Educational Sciences (IES). The content is solely the responsibility of the authors and does not necessarily represent the official views of the Institute of Educational Sciences or the US Department of Education. In accordance with ethical obligations, Patricia C. Broderick, author and developer of the Learning to BREATHE curriculum, declares a financial interest in the Learning to BREATHE program which is described in this paper. The remaining authors have no conflicts of interest to declare.
Compliance with Ethical Standards
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Informed consent was obtained from all individual participants included in the study
- Broderick, P. C. (2013). Learning to BREATHE: a mindfulness curriculum for adolescents to cultivate emotion regulation, attention and performance. Oakland: New Harbinger Press.Google Scholar
- Brown, R. C., Simone, G., & Worley, L. (2016). Embodied presence: contemplative teacher education. In K. A. Schonert-Reichl & R. W. Roeser (Eds.), Handbook of mindfulness in education: Integrating theory and research into practice (pp. 149–170). New York: Springer.Google Scholar
- Cicchetti, D. V., Sparrow, S. S., Volkmar, F., Rourke, B. P., & Cohen, D. J. (1991). Establishing the reliability and validity of neuropsychological disorders with low base rates: some recommended guidelines. Journal of Clinical and Experimental Neuropsychology, 13, 328–338.CrossRefPubMedGoogle Scholar
- Crane, R. S., Eames, C., Kuyken, W., Hastings, R. P., Williams, J. M. G., Bartley, T., Evans, A., Silverton, S., Soulsby, J. G., & Surawy, C. (2013). Development and validation of the mindfulness-based interventions—teaching assessment criteria (MBI:TAC). Assessment, 20, 681–688. https://doi.org/10.1177/1073191113490790.CrossRefPubMedGoogle Scholar
- Dreyfus, H., & Dreyfus, S. (1986). Mind over machine: the power of human intuitive expertise in the era of the computer. New York: Free Press.Google Scholar
- Durlak, J. A. (2016). What everyone should know about program implementation. In J. A. Durlak, C. E. Domitrovich, R. P. Weissberg, & T. P. Gullotta (Eds.), Handbook of social and emotional learning: research and practice (pp. 395–405). New York: Guilford.Google Scholar
- Gould, L. F., Mendelson, T., Dariotis, J. K., Ancona, M., Smith, A. S. R., Gonzalez, A. A., Smith, A. A., & Greenberg, M. T. (2014). Assessing fidelity of CORE components in a mindfulness and yoga intervention for urban youth: applying the CORE process. New Directions for Youth Development, 142, 59–81. https://doi.org/10.1002/yd.20097.CrossRefGoogle Scholar
- Harrison, J. L. (2014). Assessing generic and program-specific dose-response relations between engagement in contemplative practices and reductions in teachers’ occupational stress and burnout. Unpublished thesis, Portland State University.Google Scholar
- Jennings, P. A. (2015). Mindfulness for teachers: simple skills for peace and productivity in the classroom. New York: W.W. Norton.Google Scholar
- Kabat-Zinn, J. (1990). Full catastrophe living: using the wisdom of your body and mind to face stress, pain and illness. New York: Dell.Google Scholar
- Kabat-Zinn, J., Santorelli, S., Blacker, M., Brantley, J., Meleo-Meyer, F., Grossman, P., Kesper-Grossman, U., Reibel, D., & Stahl, R. (2011). Training teachers to deliver Mindfulness-Based Stress Reduction Principles and Standards retrieved May 2, 2017 from http://www.umassmed.edu/cfm/training/principles--standards/Mc.
- Maynard, B. R., Solis, M. R., Miller, V. L., & Brendel, K. E. (2017). Mindfulness-based interventions for improving cognition, academic achievement, behavior, and socioemotional functioning of primary and secondary school students. Campbell Systematic Reviews, 2017, 5. https://doi.org/10.4073/csr2017.Google Scholar
- McCown, D., Reibel, D. K., & Micozzi, M. S. (2011). Teaching mindfulness: a practical guide for clinicians and educators. New York: Springer.Google Scholar
- Roeser, R. W. (2016). Processes of teaching, learning and transfer in mindfulness-based interventions (MBIs) for teachers: a contemplative educational perspective. In K. Schonert-Reichl & R. W. Roeser (Eds.), Handbook of mindfulness in education: theory, research, practice and future directions. New York: Springer.Google Scholar
- Semple, R. J., Droutman, V., & Reid, B. A. (2017). Mindfulness goes to school: Things learned (so far) from research and real‐world experiences. Psychology in the Schools, 54(1), 29–52.Google Scholar
- Virgili, M. (2013). Mindfulness-based interventions reduce psychological distress in working adults: a meta-analysis of intervention studies. Mindfulness, 1–12. https://doi.org/10.1007/s12671-013-0264-0.