Abstract
Objectives
There is mixed psychometric evidence for the Five-Facet Mindfulness Questionnaire’s (FFMQ) Observing factor (FFMQ-Observing). Recent efforts to improve this construct produced a new Observing Scale consisting of three factors: Body Observing, Emotion Awareness, and External Perception. Using a sample of mostly nonmeditating emergency telecommunicators (TCs), this study explored this new Observing Scale’s factor structure, its viability as a replacement for the FFMQ-Observing factor, and its convergent validity.
Methods
The FFMQ and additional mindfulness items from the new Observing Scale were administered via an online survey to emergency TCs (N = 242, Mage = 41.84, SD = 9.80, range = 18–72). We performed exploratory factor analysis (EFA) on the Observing Scale, confirmatory factor analysis (CFA) on a novel five-factor model integrating the Observing Scale with the FFMQ (excluding FFMQ-Observing), and correlations among the Observing Scale, the FFMQ, and mindfulness-based practices.
Results
EFA suggested four factors for the Observing Scale: Internal Body Observing, External Body Observing, Emotion Awareness, and External Perception. CFA failed to validate our integrated model, but the Observing Scale was positively correlated with the FFMQ and mindfulness-based practices.
Conclusions
This study provides preliminary support for an improved Observing Scale, while suggesting a novel, four-factor structure in emergency TCs. Although the Observing Scale was not compatible with the FFMQ, this may reflect measurement error rather than model misspecification given evidence of content overlap and distinctive forms of Body Observing. Future attempts to validate the new Observing Scale in larger samples are encouraged before it may be recommended as an alternative to the FFMQ-Observing factor.
Similar content being viewed by others
References
Alsubaie, M., Abbott, R., Dunn, B., Dickens, C., Keil, T. F., Henley, W., & Kuyken, W. (2017). Mechanisms of action in mindfulness-based cognitive therapy (MBCT) and mindfulness-based stress reduction (MBSR) in people with physical and/or psychological conditions: A systematic review. Clinical Psychology Review, 55, 74–91. https://doi.org/10.1016/j.cpr.2017.04.008
Baer, R. A., Samuel, D. B., & Lykins, E. L. (2011). Differential item functioning on the five facet mindfulness questionnaire is minimal in demographically matched meditators and nonmeditators. Assessment, 18(1), 3–10. https://doi.org/10.1177/1073191110392498
Baer, R. A., Smith, G. T., & Allen, K. B. (2004). Assessment of mindfulness by self-report: The Kentucky inventory of mindfulness skills. Assessment, 11(3), 191–206. https://doi.org/10.1177/1073191104268029
Baer, R. A., Smith, G. T., Hopkins, J., Krietemeyer, J., & Toney, L. (2006). Using self-report assessment methods to explore facets of mindfulness. Assessment, 13(1), 27–45. https://doi.org/10.1177/1073191105283504
Baer, R. A., Smith, G. T., Lykins, E., Button, D., Krietemeyer, J., Sauer, S., Walsh, E., Duggan, D., & Williams, J. M. G. (2008). Construct validity of the five facet mindfulness questionnaire in meditating and nonmeditating samples. Assessment, 15(3), 329–342. https://doi.org/10.1177/1073191107313003
Bandalos, D. L., & Finney, S. J. (2001). Item parceling issues in structural equation modeling. In G.A. Marcoulides & R.E. Schumacker (Eds.), New developments and techniques in structural equation modeling (p. 269-296). Lawrence Erlbaum Associates Publishers.
Barnes, S. M., & Lynn, S. J. (2010). Mindfulness skills and depressive symptoms: A longitudinal study. Imagination, Cognition and Personality, 30(1), 77–91. https://doi.org/10.2190/IC.30.1.e
Bergomi, C., Tschacher, W., & Kupper, Z. (2013). The assessment of mindfulness with self-report measures: Existing scales and open issues. Mindfulness, 4(3), 191–202. https://doi.org/10.1007/s12671-012-0110-9
Bohlmeijer, E., ten Klooster, P. M., Fledderus, M., Veehof, M., & Baer, R. (2011). Psychometric properties of the five facet mindfulness questionnaire in depressed adults and development of a short form. Assessment, 18(3), 308–320. https://doi.org/10.1177/1073191111408231
Brown, D. B., Bravo, A. J., Roos, C. R., & Pearson, M. R. (2015). Five facets of mindfulness and psychological health: Evaluating a psychological model of the mechanisms of mindfulness. Mindfulness, 6(5), 1021–1032. https://doi.org/10.1007/s12671-014-0349-4
Brown, K. W., & Ryan, R. M. (2003). The benefits of being present: Mindfulness and its role in psychological well-being. Journal of Personality Social Psychology, 84(4), 822–848. https://doi.org/10.1037/0022-3514.84.4.822
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K.A. Bollen & J.S. Long (Eds.), Testing structural equation models (pp. 136-162), SAGE Publications, Inc.
Buchheld, N., Grossman, P., & Walach, H. (2001). Measuring mindfulness in insight meditation (Vipassana) and meditation-based psychotherapy: The development of the Freiburg Mindfulness Inventory (FMI). Journal for Meditation and Meditation Research, 1(1), 11–34
Cardaciotto, L., Herbert, J. D., Forman, E. M., Moitra, E., & Farrow, V. (2008). The assessment of present-moment awareness and acceptance: The Philadelphia Mindfulness Scale. Assessment, 15(2), 204–223. https://doi.org/10.1177/1073191107311467
Carpenter, J. K., Conroy, K., Gomez, A. F., Curren, L. C., & Hofmann, S. G. (2019). The relationship between trait mindfulness and affective symptoms: a meta-analysis of the Five Facet Mindfulness Questionnaire (FFMQ). Clinical Psychology Review, 74(101785). https://doi.org/10.1016/j.cpr.2019.101785
Cash, M., & Whittingham, K. (2010). What facets of mindfulness contribute to psychological well-being and depressive, anxious, and stress-related symptomatology? Mindfulness, 1(3), 177–182. https://doi.org/10.1007/s12671-010-0023-4
Cattell, R. B. (1966). The scree plot test for the number of factors. Multivariate Behavioral Research, 1, 140–161. https://doi.org/10.1207/s15327906mbr0102_10
Cattell, R. B., & Vogelmann, S. (1977). A comprehensive trial of the Scree and KG criteria for determining the number of factors. Multivariate Behavioral Research, 12, 289–325. https://doi.org/10.1207/s15327906mbr1203_2
Cebolla, A., García-Palacios, A., Soler, J., Guillen, V., Baños, R., & Botella, C. (2012). Psychometric properties of the Spanish validation of the five facets of mindfulness questionnaire (FFMQ). The European Journal of Psychiatry, 26(2), 118–126. https://doi.org/10.4321/S0213-61632012000200005
Chadwick, P., Hember, M., Symes, J., Peters, E., Kuipers, E., & Dagnan, D. (2008). Responding mindfully to unpleasant thoughts and images: Reliability and validity of the Southampton mindfulness questionnaire (SMQ). British Journal of Clinical Psychology, 47(4), 451–455. https://doi.org/10.1348/014466508X314891
Christopher, M. S., Neuser, N. J., Michael, P. G., & Baitmangalkar, A. (2012). Exploring the psychometric properties of the five facet mindfulness questionnaire. Mindfulness, 3(2), 124–131. https://doi.org/10.1007/s12671-011-0086-x
Conway, J. M., & Huffcutt, A. I. (2003). A review and evaluation of exploratory factor analysis practices in organizational research. Organizational Research Methods, 6(2), 147–168. https://doi.org/10.1177/1094428103251541
Costello, A. B., & Osborne, J. (2005). Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10(1). https://doi.org/10.7275/jyj1-4868
Curtiss, J., & Klemanski, D. H. (2014). Factor analysis of the five facet mindfulness questionnaire in a heterogeneous clinical sample. Journal of Psychopathology and Behavioral Assessment, 36(4), 683–694. https://doi.org/10.1007/s10862-014-9429-y
Curtiss, J., Klemanski, D. H., Andrews, L., Ito, M., & Hofmann, S. G. (2017). The conditional process model of mindfulness and emotion regulation: An empirical test. Journal of Affective Disorders, 212, 93–100. https://doi.org/10.1016/j.jad.2017.01.027
Davidson, R. J. (2016). Mindfulness-based cognitive therapy and the prevention of depressive relapse: Measures, mechanisms, and mediators. JAMA Psychiatry, 73(6), 547–548. https://doi.org/10.1001/jamapsychiatry.2016.0135
de Winter, J. C. F., & Dodou, D. (2012). Factor recovery by principal axis factoring and maximum likelihood factor analysis as a function of factor pattern and sample size. Journal of Applied Statistics, 39(4), 695–710. https://doi.org/10.1080/02664763.2011.610445
Enders, C. K., & Bandalos, D. L. (2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling, 8(3), 430–457. https://doi.org/10.1207/S15328007SEM0803_5
Feldman, G., Hayes, A., Kumar, S., Greeson, J., & Laurenceau, J.-P. (2007). Mindfulness and emotion regulation: The development and initial validation of the cognitive and affective mindfulness scale-revised (CMS-R). Journal of Psychopathology and Behavioral Assessment, 29(3), 177–190. https://doi.org/10.1007/s10862-006-9035-8
Feng, X. J., Krägeloh, C. U., Billington, D. R., & Siegert, R. J. (2018). To what extent is mindfulness as presented in commonly used mindfulness questionnaires different from how it is conceptualized by senior ordained Buddhists? Mindfulness, 9(2), 441–460. https://doi.org/10.1007/s12671-017-0788-9
Fernandez, A. C., Wood, M. D., Stein, L. A., & Rossi, J. S. (2010). Measuring mindfulness and examining its relationship with alcohol use and negative consequences. Psychology of Addictive Behaviors, 24(4), 608–616. https://doi.org/10.1037/a0021742
Fridman, J., Barrett, L. F., Wormwood, J. B., & Quigley, K. S. (2019). Applying the theory of constructed emotion to police decision making. Frontiers in Psychology, 10(1946). https://doi.org/10.3389/fpsyg.2019.01946
Goldberg, S. B., Tucker, R. P., Greene, P. A., Davidson, R. J., Wampold, B. E., Kearney, D. J., & Simpson, T. L. (2018). Mindfulness-based interventions for psychiatric disorders: A systematic review and meta-analysis. Clinical Psychology Review, 59, 52–60. https://doi.org/10.1016/j.cpr.2017.10.011
Grossman, P. (2019). On the porosity of subject and object in ‘mindfulness’ scientific study: Challenges to ‘scientific’ construction, operationalization and measurement of mindfulness. Current Opinion in Psychology, 28, 102–107. https://doi.org/10.1016/j.copsyc.2018.11.008
Gu, J., Strauss, C., Crane, C., Barnhofer, T., Karl, A., Cavanagh, K., & Kuyken, W. (2016). Examining the factor structure of the 39-item and 15-item versions of the five facet mindfulness questionnaire before and after mindfulness-based cognitive therapy for people with recurrent depression. Psychological Assessment, 28(7), 791. https://doi.org/10.1037/pas0000263
Guttman, L. (1954). Some necessary conditions for common-factor analysis. Psychometrika, 19, 149–161. https://doi.org/10.1007/BF02289162
Hair, J. F., Jr., Black, W. C., Babin, B. J., & Anderson, R. E. (2009). Multivariate data analysis: a global perspective. Pearson Education, Inc.
Frank E Harrell Jr, with contributions from Charles Dupont and many others. (2020). Hmisc: Harrell Miscellaneous. R package version 4.4–1, https://CRAN.R-project.org/package=Hmisc
Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (1999). Acceptance and commitment therapy: An experiential approach to behavior change. Guilford Press.
Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179–185. https://doi.org/10.1007/BF02289447
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Jamshidian, M., & Bentler, P. M. (1999). ML estimation of mean and covariance structures with missing data using complete data routines. Journal of Educational and Behavioral Statistics, 24(1), 21–24. https://doi.org/10.3102/10769986024001021
Kabat-Zinn, J. (1990). Full catastrophe living: Using the wisdom of your body and mind to face stress, pain and illness. Delta.
Kabat-Zinn, J., Lipworth, L., & Burney, R. (1985). The clinical use of mindfulness meditation for the self-regulation of chronic pain. Journal of Behavioral Medicine, 8(2), 163–190. https://doi.org/10.1007/BF00845519
Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20, 141–151. https://doi.org/10.1177/001316446002000116
Kaiser, H. F. (1970). A second generation Little Jiffy. Psychometrika, 35, 401–417. https://doi.org/10.1007/BF02291817
Kiken, L. G., Garland, E. L., Bluth, K., Palsson, O. S., & Gaylord, S. A. (2015). From a state to a trait: Trajectories of state mindfulness in meditation during intervention predict changes in trait mindfulness. Personality and Individual Differences, 81, 41–46. https://doi.org/10.1016/j.paid.2014.12.044
Lavender, J. M., Gratz, K. L., & Tull, M. T. (2011). Exploring the relationship between facets of mindfulness and eating pathology in women. Cognitive Behaviour Therapy, 40(3), 174–182. https://doi.org/10.1080/16506073.2011.555485
Lilja, J. L., Lundh, L. G., Josefsson, T., & Falkenström, F. (2013). Observing as an essential facet of mindfulness: A comparison of FFMQ patterns in meditating and non-meditating individuals. Mindfulness, 4(3), 203–212. https://doi.org/10.1007/s12671-012-0111-8
Lilly, M. M., & Allen, C. E. (2015). Psychological inflexibility and psychopathology in 9–1-1 TCs. Journal of Traumatic Stress, 28(3), 262–266. https://doi.org/10.1002/jts.22004
Lilly, M., Calhoun, R., Painter, I., Beaton, R., Stangenes, S., Revere, D., Baseman, J., & Meischke, H. (2019). Destress emergency—an online mindfulness-based intervention in reducing stress among emergency medical dispatchers: A randomised controlled trial. Occupational and Environmental Medicine, 76(10), 705–711.
Lilly, M. M., & Pierce, H. (2013). PTSD and depressive symptoms in 911 TCs: The role of peritraumatic distress and world assumptions in predicting risk. Psychological Trauma: Theory, Research, Practice, and Policy, 5(2), 135–141. https://doi.org/10.1037/a0026850
Linehan, M. (1993). Skills training manual for treating borderline personality disorder. Guilford Press.
Little, R. J. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202. https://doi.org/10.1080/01621459.1988.10478722
MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130. https://doi.org/10.1037/1082-989X.1.2.130
Neuser, N. J. (2010). Examining the factors of mindfulness: a confirmatory factor analysis of the five facet mindfulness questionnaire (Doctoral dissertation, Pacific University).
Park, T., Reilly-Spong, M., & Gross, C. R. (2013). Mindfulness: A systematic review of instruments to measure an emergent patient-reported outcome (PRO). Quality of Life Research, 22(10), 2639–2659. https://doi.org/10.1007/s11136-013-0395-8
Pierce, H., & Lilly, M. M. (2012). Duty-related trauma exposure in 911 TCs: Considering the risk for posttraumatic stress. Journal of Traumatic Stress, 25(2), 211–215. https://doi.org/10.1002/jts.21687
Pituch, K. A., & Stevens, J. P. (2016). Applied multivariate statistics for the social sciences: Analyses with SAS and IBM’s SPSS. Routledge.
Raphiphatthana, B., Jose, P. E., & Kielpikowski, M. (2016). How do the facets of mindfulness predict the constructs of depression and anxiety as seen through the lens of the tripartite theory? Personality and Individual Differences, 93, 104–111. https://doi.org/10.1016/j.paid.2015.08.005
Revelle, W. (2020). psych: procedures for psychological, psychometric, and personality research. Northwestern University, Evanston, Illinois. R package version 2.0.8, https://CRAN.R-project.org/package=psych
Revelle, W., & Rocklin, T. (1979). Very simple structure: An alternative procedure for estimating the optimal number of interpretable factors. Multivariate Behavioral Research, 14(4), 403–414. https://doi.org/10.1207/s15327906mbr1404_2
Rosseel, Y. (2012). “lavaan: an R package for structural equation modeling.” Journal of Statistical Software, 48(2), 1–36. http://www.jstatsoft.org/v48/i02/
Rudkin, E., Medvedev, O. N., & Siegert, R. J. (2018). The five-facet mindfulness questionnaire: Why the observing subscale does not predict psychological symptoms. Mindfulness, 9(1), 230–242. https://doi.org/10.1007/s12671-017-0766-2
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23–74.
Siegling, A. B., & Petrides, K. V. (2016). Zeroing in on mindfulness facets: Similarities, validity, and dimensionality across three independent measures. PLoS ONE, 11(4), e0153073. https://doi.org/10.1371/journal.pone.0153073
Steiner, D. L. (1994). Figuring out factors: The use and misuse of factor analysis. Canadian Journal of Psychiatry, 39(3), 135–140. https://doi.org/10.1177/070674379403900303
Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics. Pearson Education, Inc.
Van Dam, N. T., van Vugt, M. K., Vago, D. R., Schmalzl, L., Saron, C. D., Olendzki, A., Meissner, T., Lazar, S. W., Kerr, C. E., Gorchov, J., Fox, K. C. R., Field, B. A., Britton, W. B., Brefczynski-Lewis, J. A., & Meyer, D. E. (2018). Mind the hype: A critical evaluation and prescriptive agenda for research on mindfulness and meditation. Perspectives on Psychological Science, 13(1), 36–61. https://doi.org/10.1177/1745691617709589
Velicer, W. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41(3), 321–327. https://doi.org/10.1007/BF02293557
Williams, M. J., Dalgleish, T., Karl, A., & Kuyken, W. (2014). Examining the factor structures of the five facet mindfulness questionnaire and the self-compassion scale. Psychological Assessment, 26(2), 407. https://doi.org/10.1037/a0035566
Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127
Author information
Authors and Affiliations
Contributions
A. R.: designed and executed the study, prepared and analyzed data, wrote the abstract, discussion, and part of the method and results, and reviewed and edited the manuscript. B. L.: assisted with study design, wrote the introduction, and reviewed and edited the manuscript. J. P.: analyzed data, wrote part of the method and results, and reviewed and edited the manuscript. M. L.: collaborated in study design and editing of the final manuscript. B. L. and J. P. contributed equally to this work. All authors approved the final version of the manuscript for submission.
Corresponding author
Ethics declarations
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of Northern Illinois University’s Institutional Review Board and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Reffi, A.N., Laman-Maharg, B., Pawirosetiko, J.S. et al. Measuring Mindfulness in Emergency Telecommunicators: A Preliminary Study of a Revised Observing Construct. Mindfulness 12, 2339–2353 (2021). https://doi.org/10.1007/s12671-021-01708-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12671-021-01708-3