Skip to main content

Evaluating the Quality of Mindfulness Instruction Delivered in School Settings: Development and Validation of a Teacher Quality Observational Rating Scale

Abstract

As interest increases in mindfulness in education programs for youth, there is a need to develop reliable measures of the quality of program implementation. This paper describes the development and psychometric properties of a measure that can be used to assess and monitor quality of implementation of mindfulness programs/curricula in typical classroom or out-of-school settings. The Teaching Mindfulness in Education Observation Scale (TMEOS) is a 28-item instrument that integrates qualitative and quantitative aspects of mindfulness instruction. Items focus on procedural adherence as well as aspects of implementation that reflect embodiment during instructional delivery (e.g., alignment with the attitudinal foundations of mindfulness). Reliability and validity data were examined and indicated that the four major scoring domains and key features showed adequate inter-rater reliability and internal consistency. We conclude that observational assessment of multiple dimension of implementation quality, including adherence and process-oriented aspects of implementation such as embodiment, can be reliably used to assess implementation quality of mindfulness programs in education settings. However, adequate preparation and training are critical. Implications and directions for future research are discussed.

This is a preview of subscription content, access via your institution.

References

  1. Broderick, P. C. (2013). Learning to BREATHE: a mindfulness curriculum for adolescents to cultivate emotion regulation, attention and performance. Oakland: New Harbinger Press.

    Google Scholar 

  2. Broderick, P. C., & Frank, J. (2014). Learning to BREATHE: An intervention to foster mindfulness in adolescents. New Directions for Youth Development, 142, 31–44. https://doi.org/10.1002/yd.20095.

    Article  Google Scholar 

  3. Broderick, P. C., & Jennings, P. A. (2012). Mindfulness for adolescents: a promising approach to supporting emotion regulation and preventing risky behavior. New Directions for Youth Development, 136, 111–126. https://doi.org/10.1002/yd.20042.

    Article  Google Scholar 

  4. Broderick, P. C., & Metz, S. M. (2016). Working on the inside. In K. A. Schonert-Reichl & R. W. Roeser (Eds.), Handbook of mindfulness in education: integrating theory and research into practice (pp. 355–382). New York: Springer.

    Chapter  Google Scholar 

  5. Brown, R. C., Simone, G., & Worley, L. (2016). Embodied presence: contemplative teacher education. In K. A. Schonert-Reichl & R. W. Roeser (Eds.), Handbook of mindfulness in education: Integrating theory and research into practice (pp. 149–170). New York: Springer.

    Google Scholar 

  6. Burke, C. (2010). Mindfulness-based approaches with children and adolescents: a preliminary review of current research in an emergent field. Journal of Child and Family Studies, 19, 133–144. https://doi.org/10.1007/s10826-009-9282-x.

    Article  Google Scholar 

  7. Chiesa, A., & Serretti, A. (2009). Mindfulness-based stress reduction for stress management in healthy people: a review and meta-analysis. Journal of Alternative and Complementary Medicine, 15, 593–600. https://doi.org/10.1089/acm.2008.0495.

    Article  PubMed  Google Scholar 

  8. Cicchetti, D. V., Sparrow, S. S., Volkmar, F., Rourke, B. P., & Cohen, D. J. (1991). Establishing the reliability and validity of neuropsychological disorders with low base rates: some recommended guidelines. Journal of Clinical and Experimental Neuropsychology, 13, 328–338.

    Article  Google Scholar 

  9. Crane, R. S., Kuyken, W., Williams, J. M. G., Hastings, R., Cooper, L., & Fennell, M. J. V. (2012). Competence in teaching mindfulness-based courses: concepts, development, and assessment. Mindfulness, 3, 76–84. https://doi.org/10.1007/s12671-011-0073-2.

    Article  PubMed  Google Scholar 

  10. Crane, R. S., Eames, C., Kuyken, W., Hastings, R. P., Williams, J. M. G., Bartley, T., Evans, A., Silverton, S., Soulsby, J. G., & Surawy, C. (2013). Development and validation of the mindfulness-based interventions—teaching assessment criteria (MBI:TAC). Assessment, 20, 681–688. https://doi.org/10.1177/1073191113490790.

    Article  PubMed  Google Scholar 

  11. Crane, R. S., Brewer, J., Feldman, C., Kabat-Zinn, J., Santorelli, S., Williams, J. M. G., & Kuyken, W. (2016). What defines mindfulness-based programs? The warp and the weft. Psychological Medicine, 47, 990–999. https://doi.org/10.1017/S0033291716003317.

    Article  PubMed  Google Scholar 

  12. Cullen, M. (2011). Mindfulness-based interventions: an emerging phenomenon. Mindfulness, 2, 186–193. https://doi.org/10.1007/s12671-011-0058-1.

    Article  Google Scholar 

  13. Dobkin, P. L., Hickman, S., & Monshat, K. (2014). Holding the heart of mindfulness-based stress reduction: balancing fidelity and imagination when adapting MBSR. Mindfulness, 5, 710–718. https://doi.org/10.1007/s12671-013-0225-7.

    Article  Google Scholar 

  14. Dreyfus, H., & Dreyfus, S. (1986). Mind over machine: the power of human intuitive expertise in the era of the computer. New York: Free Press.

    Google Scholar 

  15. Durlak, J. A. (2016). What everyone should know about program implementation. In J. A. Durlak, C. E. Domitrovich, R. P. Weissberg, & T. P. Gullotta (Eds.), Handbook of social and emotional learning: research and practice (pp. 395–405). New York: Guilford.

    Google Scholar 

  16. Durlak, J. A., Dymnicki, A. B., Taylor, R. D., Weissberg, R. P., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: a meta-analysis of school-based universal interventions. Child Development, 82(1), 405–432.

    Article  Google Scholar 

  17. Frank, J. L., Jennings, P. A., & Greenberg, M. T. (2013). Mindfulness-based interventions in school settings: an introduction to the special issue. Research in Human Development, 10, 205–210. https://doi.org/10.1080/15427609.2013.818480.

    Article  Google Scholar 

  18. Gould, L. F., Mendelson, T., Dariotis, J. K., Ancona, M., Smith, A. S. R., Gonzalez, A. A., Smith, A. A., & Greenberg, M. T. (2014). Assessing fidelity of CORE components in a mindfulness and yoga intervention for urban youth: applying the CORE process. New Directions for Youth Development, 142, 59–81. https://doi.org/10.1002/yd.20097.

    Article  Google Scholar 

  19. Greenberg, M. T., & Harris, A. R. (2012). Nurturing mindfulness in children and youth: current state of research. Child Development Perspectives, 6, 161–166. https://doi.org/10.1111/j.1750-8606.2011.00215.

    Article  Google Scholar 

  20. Grossman, P., Niemann, L., Schmidt, S., & Walach, H. (2004). Mindfulness-based stress reduction and health benefits: a meta-analysis. Journal of Psychosomatic Research, 57, 35–43. https://doi.org/10.1016/S0022-3999(03)00573-7.

    Article  PubMed  Google Scholar 

  21. Harrison, J. L. (2014). Assessing generic and program-specific dose-response relations between engagement in contemplative practices and reductions in teachers’ occupational stress and burnout. Unpublished thesis, Portland State University.

  22. Jennings, P. A. (2015). Mindfulness for teachers: simple skills for peace and productivity in the classroom. New York: W.W. Norton.

    Google Scholar 

  23. Kabat-Zinn, J. (1990). Full catastrophe living: using the wisdom of your body and mind to face stress, pain and illness. New York: Dell.

    Google Scholar 

  24. Kabat-Zinn, J., Santorelli, S., Blacker, M., Brantley, J., Meleo-Meyer, F., Grossman, P., Kesper-Grossman, U., Reibel, D., & Stahl, R. (2011). Training teachers to deliver Mindfulness-Based Stress Reduction Principles and Standards retrieved May 2, 2017 from http://www.umassmed.edu/cfm/training/principles--standards/Mc.

  25. Maynard, B. R., Solis, M. R., Miller, V. L., & Brendel, K. E. (2017). Mindfulness-based interventions for improving cognition, academic achievement, behavior, and socioemotional functioning of primary and secondary school students. Campbell Systematic Reviews, 2017, 5. https://doi.org/10.4073/csr2017.

    Article  Google Scholar 

  26. McCown, D., Reibel, D. K., & Micozzi, M. S. (2011). Teaching mindfulness: a practical guide for clinicians and educators. New York: Springer.

    Google Scholar 

  27. McCown, D., Reibel, D. K., & Micozzi, M. S. (2016). Resources for teaching mindfulness: an international handbook. New York: Springer.

    Book  Google Scholar 

  28. Rodgers, C. R., & Raider-Roth, M. B. (2006). Presence in teaching. Teachers and Teaching: Theory and Practice, 12(3), 265–287.

    Article  Google Scholar 

  29. Roeser, R. W. (2016). Processes of teaching, learning and transfer in mindfulness-based interventions (MBIs) for teachers: a contemplative educational perspective. In K. Schonert-Reichl & R. W. Roeser (Eds.), Handbook of mindfulness in education: theory, research, practice and future directions. New York: Springer.

    Google Scholar 

  30. Semple, R. J., Droutman, V., & Reid, B. A. (2017). Mindfulness goes to school: Things learned (so far) from research and real‐world experiences. Psychology in the Schools, 54(1), 29–52.

  31. Virgili, M. (2013). Mindfulness-based interventions reduce psychological distress in working adults: a meta-analysis of intervention studies. Mindfulness, 1–12. https://doi.org/10.1007/s12671-013-0264-0.

  32. Zoogman, S., Goldberg, S. B., Hoyt, W. T., & Miller, L. (2015). Mindfulness interventions with you: a meta-analysis. Mindfulness, 6, 290–302. https://doi.org/10.1007/s12671-013-0260-4.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the contributions of Robert Roeser and Yoonkyung Oh for their helpful suggestions and comments in preparing this manuscript.

Funding

The project described was supported by Award Number R305A140113 from the Institute of Educational Sciences (IES). The content is solely the responsibility of the authors and does not necessarily represent the official views of the Institute of Educational Sciences or the US Department of Education. In accordance with ethical obligations, Patricia C. Broderick, author and developer of the Learning to BREATHE curriculum, declares a financial interest in the Learning to BREATHE program which is described in this paper. The remaining authors have no conflicts of interest to declare.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Patricia C. Broderick.

Ethics declarations

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Informed consent was obtained from all individual participants included in the study

Electronic Supplementary Material

ESM 1

(DOCX 40 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Broderick, P.C., Frank, J.L., Berrena, E. et al. Evaluating the Quality of Mindfulness Instruction Delivered in School Settings: Development and Validation of a Teacher Quality Observational Rating Scale. Mindfulness 10, 36–45 (2019). https://doi.org/10.1007/s12671-018-0944-x

Download citation

Keywords

  • Fidelity
  • Implementation
  • Training
  • Professional development
  • Coaching
  • Mindfulness
  • Schools
  • Education