Skip to main content
SpringerLink
Log in

Applying Generalizability Theory to Differentiate Between Trait and State in the Five Facet Mindfulness Questionnaire (FFMQ)

  • ORIGINAL PAPER
  • Published:
Mindfulness Aims and scope Submit manuscript

Abstract

Objectives

Accurate evaluation of mindfulness-based training requires understanding of the differences between state and trait changes, and the Generalizability Theory (G-Theory) is the most appropriate method to differentiate these aspects in a measure. The Five Facet Mindfulness Questionnaire (FFMQ) is widely used measure of dispositional mindfulness, but its ability to accurately capture stable aspects of mindfulness has not been rigorously investigated using appropriate methodology.

Method

G-Theory was applied to differentiate between trait and state aspects of mindfulness and to examine temporal reliability of the FFMQ in a sample of 83 participants who completed the scale at three occasions separated by 2-week intervals.

Results

The total 39-item FFMQ and its short version FFMQ-18 have demonstrated good reliability in measuring trait mindfulness with G coefficients of 0.89 and 0.75, respectively, while individual facet subscales of the FFMQ appeared less reliable in measuring either trait or state. Subsequent analysis attempted to combine the FFMQ items that were least stable over time into a state mindfulness subscale. However, this did not result in acceptable psychometric properties for such a state subscale.

Conclusions

The findings of this study indicate that reliable measurement of stable aspects of mindfulness can be achieved by using the full FFMQ scale or its short version FFMQ-18 with scores generalizable across sample population and occasions. The scores obtained on individual facet subscales of the FFMQ predominantly measuring trait mindfulness, but their reliability is affected by measurement error due to interaction between person, item, and occasion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Allen, M. J., & Yen, W. M. (1979). Introduction on to measurement theory. Monterey, CA: Brooks/Cole.

    Google Scholar 

  • Arterberry, B. J., Martens, M. P., Cadigan, J. M., & Rohrer, D. (2014). Application of generalizability theory to the big five inventory. Personality and Individual Differences, 69, 98–103.

    Article  Google Scholar 

  • Baer, R. A., Carmody, J., & Hunsinger, M. (2012). Weekly change in mindfulness and perceived stress in a mindfulness-based stress reduction program. Journal of Clinical Psychology, 68(7), 755–765. https://doi.org/10.1002/jclp.21865.

    Article  PubMed  Google Scholar 

  • Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13(1), 27–45. https://doi.org/10.1177/1073191105283504.

    Article  PubMed  Google Scholar 

  • Baer, R. A., Smith, G. T., Lykins, E., Button, D., Krietemeyer, J., Sauer, S., & Walsh, E. (2008). Construct validity of the Five Facet Mindfulness Questionnaire in meditating and nonmeditating samples. Assessment, 15(3), 329–342.

    Article  Google Scholar 

  • Birrer, D., Röthlin, P., & Morgan, G. (2012). Mindfulness to enhance athletic performance: Theoretical considerations and possible impact mechanisms. Mindfulness, 3(3), 235–246. https://doi.org/10.1007/s12671-012-0161-y.

    Article  Google Scholar 

  • Bishop, S. R., Lau, M. A., Shapiro, S., Carlson, L. E., Anderson, N. D., Carmody, J., & Devins, G. (2006). Mindfulness: A proposed operational definition. Clinical Psychology: Science and Practice, 11, 230–241.

    Google Scholar 

  • Bloch, R., & Norman, G. (2012). Generalizability theory for the perplexed: A practical introduction and guide: AMEE guide no. 68. Medical Teacher, 34, 960–992.

    Article  Google Scholar 

  • Bohlmeijer, E., Prenger, R., Taal, E., & Cuijpers, P. (2010). The effects of mindfulness-based stress reduction therapy on mental health of adults with a chronic medical disease: A meta-analysis. Journal of Psychosomatic Research, 68(6), 539–544. https://doi.org/10.1016/j.jpsychores.2009.10.005.

    Article  PubMed  Google Scholar 

  • Bohlmeijer, E., ten Klooster, P. M., Fledderus, M., Veehof, M., & Baer, R. (2011). Psychometric properties of the Five Facet Mindfulness Questionnaire in depressed adults and development of a short form. Assessment, 18(3), 308–320. https://doi.org/10.1177/1073191111408231.

    Article  PubMed  Google Scholar 

  • Brown, D. B., Bravo, A. J., Roos, C. R., & Pearson, M. R. (2015). Five facets of mindfulness and psychological health: Evaluating a psychological model of the mechanisms of mindfulness. Mindfulness, 6(5), 1021–1032. https://doi.org/10.1007/s12671-014-0349-4.

    Article  PubMed  Google Scholar 

  • Bush, M. (2011). Mindfulness in higher education. Contemporary Buddhism, 12(1), 183–197. https://doi.org/10.1080/010183-197.

    Article  Google Scholar 

  • Cardinet, J., Pini, G., & Johnson, S. (2011). Applying generalizability theory using EduG. London: Routledge Academic.

  • Chang, V. Y., Palesh, O., Caldwell, R., Glasgow, N., Abramson, M., Luskin, F., et al. (2004). The effects of a mindfulness-based stress reduction program on stress, mindfulness self-efficacy, and positive states of mind. Stress and Health, 20(3), 141–147. https://doi.org/10.1002/smi.1011.

    Article  Google Scholar 

  • Chiesa, A., & Serretti, A. (2009). Mindfulness-based stress reduction for stress management in healthy people: A review and meta-analysis. Journal of Alternative and Complementary Medicine, 15(5), 593–600. https://doi.org/10.1089/acm.2008.0495.

    Article  PubMed  Google Scholar 

  • Coffey, K. A., Hartman, M., & Fredrickson, B. L. (2010). Deconstructing mindfulness and constructing mental health: Understanding mindfulness and its mechanisms of action. Mindfulness, 1(4), 235–253. https://doi.org/10.1007/s12671-010-0033-2.

    Article  Google Scholar 

  • Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963). Theory of generalizability: A liberalization of reliability theory†. British Journal of Statistical Psychology, 16(2), 137–163. https://doi.org/10.1111/j.2044-8317.1963.tb00206.x.

    Article  Google Scholar 

  • Davis, K. M., Lau, M. A., & Cairns, D. R. (2009). Development and preliminary validation of a trait version of the Toronto Mindfulness Scale. Journal of Cognitive Psychotherapy, 23(3), 185.

    Article  Google Scholar 

  • Frewen, P. A., Unholzer, F., Logie-Hagan, K. R.-J., & MacKinley, J. D. (2014). Meditation breath attention scores (MBAS): Test-retest reliability and sensitivity to repeated practice. Mindfulness, 5(2), 161–169. https://doi.org/10.1007/s12671-012-0161-y.

    Article  Google Scholar 

  • Gu, J., Strauss, C., Crane, C., Barnhofer, T., Karl, A., Cavanagh, K., & Kuyken, W. (2016). Examining the factor structure of the 39-item and 15-item versions of the Five Facet Mindfulness Questionnaire before and after mindfulness-based cognitive therapy for people with recurrent depression. Psychological Assessment, 28(7), 791–802. https://doi.org/10.1037/pas0000263.

    Article  PubMed  PubMed Central  Google Scholar 

  • Huisman, M. (2000). Imputation of missing item responses: Some simple techniques. Quality and Quantity, 34(4), 331–351.

    Article  Google Scholar 

  • Hwang, Y., Goldstein, H., Medvedev, O. N., Singh, N. N., Noh, J., & Hand, K. (2019). Mindfulness-based intervention for Educators: Effects of a School-Based Cluster Randomized Controlled Study. Mindfulness, 10(7), 1417–1436. https://doi.org/10.1007/s12671-019-01147-1.

    Article  Google Scholar 

  • Hyland, P. K., Lee, R. A., & Mills, M. J. (2015). Mindfulness at work: A new approach to improving individual and organizational performance. Industrial and Organizational Psychology, 8(4), 576–602. https://doi.org/10.1017/iop.2015.41.

    Article  Google Scholar 

  • Kabat-Zinn, J. (1982). An outpatient program in behavioral medicine for chronic pain patients based on the practice of mindfulness meditation: Theoretical considerations and preliminary results. General Hospital Psychiatry, 4(1), 33–47. https://doi.org/10.1016/0163-8343(82)90026-3.

    Article  PubMed  Google Scholar 

  • Kabat-Zinn, J. (1990). Full catastrophe living: Using the wisdom of your body and mind to face stress, pain, and illness. New York, NY: Delacourt.

    Google Scholar 

  • Kabat-Zinn, J., Wheeler, E., Light, T., Skillings, A., Scharf, M. J., Cropley, T. G., Hosmer, D., & Bernhard, J. D. (1998). Influence of a mindfulness meditation-based stress reduction intervention on rates of skin clearing in patients with moderate to severe psoriasis undergoing phototherapy (UVB) and photochemotherapy (PUVA). Psychosomatic Medicine, 60(5), 625–632. https://doi.org/10.1097/00006842-199809000-00020.

    Article  PubMed  Google Scholar 

  • Krägeloh, C. U., Henning, M. A., Medvedev, O., Feng, X. J., Moir, F., Billington, R., & Siegert, R. J. (2019). Mindfulness-based intervention research characteristics approaches and developments. London and New York: Routledge.

    Book  Google Scholar 

  • Lau, M. A., Bishop, S. R., Segal, Z. V., Buis, T., Anderson, N. D., Carlson, L., et al. (2006). The Toronto Mindfulness Scale: Development and validation. Journal of Clinical Psychology, 62(12), 1445–1467.

    Article  Google Scholar 

  • Ledesma, D., & Kumano, H. (2009). Mindfulness-based stress reduction and cancer: A meta-analysis. Psycho-Oncology, 18(6), 571–579. https://doi.org/10.1002/pon.1400.

    Article  PubMed  Google Scholar 

  • Levinson, D. B., Stoll, E. L., Kindy, S. D., Merry, H. L., & Davidson, R. J. (2014). A mind you can count on: Validating breath counting as a behavioral measure of mindfulness. Frontiers in Psychology, 5, 1202. https://doi.org/10.3389/fpsyg.2014.01202.

    Article  PubMed  PubMed Central  Google Scholar 

  • Libet, B. (2004). Mind time: The temporal factor in consciousness. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Ma, S. H., & Teasdale, J. D. (2004). Mindfulness-based cognitive therapy for depression: Replication and exploration of differential relapse prevention effects. Journal of Consulting and Clinical Psychology, 72(1), 31–40. https://doi.org/10.1037/0022-006X.72.1.31.

    Article  PubMed  Google Scholar 

  • MacDonald, H. Z., & Baxter, E. E. (2017). Mediators of the relationship between dispositional mindfulness and psychological well-being in female college students. Mindfulness, 8(2), 398–407. https://doi.org/10.1007/s12671-016-0611-z.

    Article  Google Scholar 

  • Massion, A. O., Teas, J., Herbert, J. R., Wetheimer, M. D., & Kabat-Zinn, J. (1995). Meditation, melatonin and breast/prostate cancer: Hypothesis and preliminary data. Medical Hypotheses, 44(1), 39–46. https://doi.org/10.1016/0306-9877(95)90299-6.

    Article  PubMed  Google Scholar 

  • Medvedev, O. N., Krägeloh, C. U., Narayanan, A., & Siegert, R. J. (2017a). Measuring mindfulness: Applying Generalizability Theory to distinguish between state and trait. Mindfulness, 8(4), 1036–1046. https://doi.org/10.1007/s12671-017-0679-0.

    Article  Google Scholar 

  • Medvedev, O. N., Norden, P. A., Krägeloh, C. U., & Siegert, R. J. (2018). Investigating unique contributions of dispositional mindfulness facets to depression, anxiety, and stress in general and student populations. Mindfulness, 9(6), 1757–1767. https://doi.org/10.1007/s12671-018-0917-0.

    Article  Google Scholar 

  • Medvedev, O. N., Siegert, R. J., Kersten, P., & Krägeloh, C. U. (2017b). Improving the precision of the Five Facet Mindfulness Questionnaire using a Rasch approach. Mindfulness, 8(4), 995–1008. https://doi.org/10.1007/s12671-016-0676-8.

    Article  Google Scholar 

  • Paterson, J., Medvedev, O. N., Sumich, A., Tautolo, E., Krägeloh, C. U., Sisk, R., et al. (2017). Distinguishing transient versus stable aspects of depression in New Zealand Pacific Island children using Generalizability Theory. Journal of Affective Disorders, 227, 698–704. https://doi.org/10.1016/j.jad.2017.11.075.

    Article  PubMed  Google Scholar 

  • Ramanaiah, N. V., Franzen, M., & Schill, T. (1983). A psychometric study of the State-Trait Anxiety inventory. Personality Assessment, 47, 531–535.

    Article  Google Scholar 

  • Segal, Z. V., Williams, J. M. G., & Teasdale, J. D. (2002). Mindfulness-based cognitive therapy for depression: A new approach to preventing relapse. New York: Guilford Press.

    Google Scholar 

  • Shapiro, S. L., Astin, J. A., Bishop, S. R., & Cordova, M. (2005). Mindfulness-based stress reduction for health care professionals: Results from a randomized trial. International Journal of Stress Management, 12(2), 164–176. https://doi.org/10.1037/1072-5245.12.2.164.

    Article  Google Scholar 

  • Shavelson, R. J., & Webb, N. M. (1991). Generalizability theory: A primer (Vol. 1). Thousand Oaks: Sage Publications, Inc.

    Google Scholar 

  • Shavelson, R. J., Webb, N. M., & Rowley, G. L. (1989). Generalizability theory. American Psychologist, 44, 599–612.

    Article  Google Scholar 

  • Shoukri, M. M., Asyali, M. H., & Donner, A. (2004). Sample size requirements for the design of reliability study: Review and new results. Statistical Methods in Medical Research, 13, 251–271.

    Article  Google Scholar 

  • Spielberger, C. D. (1999). Manual for the state-trait anger expression inventory-2. Odessa, FL: Psychological Assessment Resources.

    Google Scholar 

  • Spielberger, C. D., Gorsuch, R. L., & Lushene, R. E. (1970). Test manual for the state trait anxiety inventory. Palo Alto: Consulting Psychologists Press.

    Google Scholar 

  • Stucki, G., Daltroy, L., Katz, J. N., Johannesson, M., & Liang, M. H. (1996). Interpretation of change scores in ordinal clinical scales and health status measures: The whole may not equal the sum of the parts. Journal of Clinical Epidemiology, 49(7), 711–717. https://doi.org/10.1016/0895-4356(96)00016-9.

    Article  PubMed  Google Scholar 

  • Suen, H. K., & Lei, P. W. (2007). Classical versus generalizability theory of measurement. Educational Measurement, 4, 1–13.

    Google Scholar 

  • Swiss Society for Research in Education Working Group. (2006). EDUG User Guide. Neuchatel: IRDP.

    Google Scholar 

  • Tanay, G., & Bernstein, A. (2013). State Mindfulness Scale (SMS): development and initial validation. Psychological Assessment, 25(4), 1286–1299.

    Article  Google Scholar 

  • Tang, Y., Hölzel, B. K., & Posner, M. I. (2015). Traits and states in mindfulness meditation. Nature Reviews Neuroscience, 17(1), 59–59. https://doi.org/10.1038/nrn.2015.7.

    Article  PubMed  Google Scholar 

  • Taylor, T. A., Medvedev, O. N., Owens, R. G., & Siegert, R. J. (2017). Development and validation of the State Contentment Measure. Personality and Individual Differences, 119, 152–159. https://doi.org/10.1016/j.paid.2017.07.010.

    Article  Google Scholar 

  • Vispoel, W. P., Morris, C. A., & Kilinc, M. (2018). Applications of generalizability theory and their relations to classical test theory and structural equation modeling. Psychological Methods, 23(1), 1–26. https://doi.org/10.1037/met0000107.

    Article  PubMed  Google Scholar 

Download references

Funding

The data used in this study were from the doctoral work of the last author funded by the Vice-Chancellor’s Scholarship of Auckland University of Technology.

Author information

Authors and Affiliations

  1. School of Psychology, University of Waikato, Private Bag 3105, Hamilton, 3240, New Zealand

    Quoc C. Truong & Oleg N. Medvedev

  2. Department of Psychology, Auckland University of Technology, Auckland, New Zealand

    Christian U. Krägeloh, Richard J. Siegert & Jason Landon

Authors
  1. Quoc C. Truong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Christian U. Krägeloh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Richard J. Siegert
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jason Landon
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Oleg N. Medvedev
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

QCT: designed and conducted the study, analyzed the data, and wrote the paper. CUK: collaborated with developing the study and writing the manuscript. RJS: collaborated with developing the study, collecting the data and editing the manuscript. JL: collaborated with collecting the data and writing the manuscript. ONM: collaborated with designing and conducting the study, analyzing the data, and writing the paper.

Corresponding author

Correspondence to Oleg N. Medvedev.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Informed Consent

All participants involved in this study provided their informed consent.

Ethics Statement

The study complied with the guidelines of the Auckland University of Technology ethics committee, which is based on internationally accepted ethical standards.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(DOCX 18 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Truong, Q.C., Krägeloh, C.U., Siegert, R.J. et al. Applying Generalizability Theory to Differentiate Between Trait and State in the Five Facet Mindfulness Questionnaire (FFMQ). Mindfulness 11, 953–963 (2020). https://doi.org/10.1007/s12671-020-01324-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12671-020-01324-7

Keywords

Search

Navigation