Abstract
The purpose of this study was to validate the 9-item abbreviated version of Maslach Burnout Inventory-General Survey. The sample consisted of 347 basic-education teachers from Peru with a mean age of 46.9 years old (n = 194 women), selected non-randomly. The Maslach Burnout Inventory-General Survey (MBI-GS), short version (MBI-GS-S) with items included in the MBI-GS, and the Ultra short version of the Utrecht Work Engagement Scale (UWES-3) were applied. Validity evidence based on internal structure and its relation to other variables was probed. Internal structure was analyzed with exploratory structural equation modeling (ESEM). The equivalence between the MBI-GS-S and the MBI-GS was then assessed according to reliability, score distribution, association between versions and association with other variables (engagement, sex and age). A strong equivalence between MBI-GS and MBI-GS short version was demonstrated in the psychometrics analyzed. The study showed the potential usefulness of the MBI-GS short version for the economic and efficient measurement of burnout in Spanish-speaking populations.
This is a preview of subscription content, log in via an institution to check access.
Data availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Awa, W. L., Plaumann, M., & Walter, U. (2010). Burnout prevention: A review of intervention programs. Patient Education and Counseling, 78, 184–190. https://doi.org/10.1016/j.pec.2009.04.008
Bakker, A. B., & Demerouti, E. (2017). Job demands–resources theory: Taking stock and looking forward. Journal of Occupational Health Psychology, 22(3), 273–285. https://doi.org/10.1037/ocp0000056
Bandalos, D. L. (2021). Item meaning and order as causes of correlated residuals in confirmatory factor analysis. Structural Equation Modeling: A Multidisciplinary Journal, 28(6), 903–913. https://doi.org/10.1080/10705511.2021.1916395
Belzak, W. C. M. (2020). Testing differential item functioning in small samples. Multivariate Behavioral Research, 55(5), 722–747. https://doi.org/10.1080/00273171.2019.1671162
Calderón-De la Cruz, G. A., Merino Soto, C., Reyes Ayala, I., & Luna Yon, K. V. (2022). Validación en trabajadores peruanos de la versión ultra reducida del Utrech Work Engagement. Archivos de Prevención de Riesgos Laborales, 25(1), 25–33. https://doi.org/10.12961/aprl.2022.25.01.03
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum associates.
Cortina, J. (1993). What is coefficient alpha: An examination of theory and applications. Journal of Applied Psychology, 78, 98–104. https://doi.org/10.1037/0021-9010.78.1.98
Curran, P. G. (2016). Methods for the detection of carelessly invalid responses in survey data. Journal of Experimental Social Psychology, 66, 4–19. https://doi.org/10.1016/j.jesp.2015.07.006
Dai, S., Wang, X., & Svetina, D. (2021). TestDataImputation: Missing item responses imputation for test and assessment data. R package version 2.3. https://cran.r-project.org/web/packages/TestDataImputation/TestDataImputation.pdf. Accessed 01 Dec 2023
Denison, A. J., & Wiernik, B. M. (2020). Careless response processes are heterogeneous: Comment on Goldammer et al. (2020). https://doi.org/10.31234/osf.io/9rk4w
Diedenhofen, B., & Musch, J. (2015). cocor: A comprehensive solution for the statistical comparison of correlations. PLoS ONE, 10(4), Article e0121945. https://doi.org/10.1371/journal.pone.0121945
Diedenhofen, B., & Musch, J. (2016). cocron: A web interface and R package for the statistical comparison of Cronbach’s alpha coefficients. International Journal of Internet Science, 11, 51–60.
Dominguez-Lara, S., & Merino-Soto, C. (2019). Medición con ítem único del agotamiento emocional académico en estudiantes universitarios peruanos: Evidencias de validez y confiabilidad. Revista Iberoamericana de Diagnóstico y Evaluación–e Avaliação Psicológica. RIDEP, 50(1), 45–56. https://doi.org/10.21865/RIDEP50.1.04
Edú-Valsania, S., Laguía, A., & Moriano, J. A. (2022). Burnout: A review of theory and measurement. International Journal of Environmental Research and Public Health, 19(3), Article 1780. https://doi.org/10.3390/ijerph19031780
Feldt, L. S., Woodruff, D. J., & Salih, F. A. (1987). Statistical inference for coefficient alpha. Applied Psychological Measurement, 11(1), 93–103. https://doi.org/10.1177/014662168701100107
Fernández-Arata, M., Dominguez-Lara, S., & Merino-Soto, C. (2017a). Ítem único de burnout académico y su relación con autoeficacia académica en estudiantes universitarios. Enfermería Clínica, 27(1), 60–61. https://doi.org/10.1016/j.enfcli.2016.07.001
Fernández-Arata, M., Merino-Soto, C., & Domínguez-Lara, S. (2017b). Ítem único en la medición del burnout: Resultados preliminares. Revista Cubana de Enfermería, 33(1), 1–4.
Galesic, M., & Bosnjak, M. (2009). Effects of questionnaire length on participation and indicators of response quality in a web survey. Public Opinion Quarterly, 73(2), 349–360. https://doi.org/10.1093/poq/nfp031
Gibson, A. M., & Bowling, N. A. (2020). The effects of questionnaire length and behavioral consequences on careless responding. European Journal of Psychological Assessment, 36(2), 410–420. https://doi.org/10.1027/1015-5759/a000526
Goering, D. D., Shimazu, A., Zhou, F., Wada, T., & Sakai, R. (2017). Not if, but how they differ: A meta-analytic test of the nomological networks of burnout and engagement. Burnout Research, 5, 21–34. https://doi.org/10.1016/j.burn.2017.05.003
Heene, M., Bollmann, S., & Bühner, M. (2014). Much ado about nothing, or much to do about something? Effects of scale shortening on criterion validity and mean differences. Journal of Individual Differences, 35, 245–249. https://doi.org/10.1027/1614-0001/a000146
Hermida, R. (2015). The problem of allowing correlated errors in structural equation modeling: Concerns and considerations. Computational Methods in Social Sciences (CMSS), 3(1), 5–17.
Hittner, J. B., May, K., & Silver, N. C. (2003). A Monte Carlo evaluation of tests for comparing dependent correlations. The Journal of General Psychology, 130, 149–168. https://doi.org/10.1080/00221300309601282
Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Jodoin, M. G., & Gierl, M. J. (2001). Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14(4), 329–349. https://doi.org/10.1207/S15324818AME1404_2
Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2022). semTools: Useful tools for structural equation modeling. R package version 0.5–6. https://cran.r-project.org/web/packages/semTools/semTools.pdf. Accessed 15 Dec 2023
Juárez García, A., Merino-Soto, C., Fernández-Arata, M., Flores-Jiménez, C., Caraballo, M., & Camacho-Cristiá, C. (2020). Validación transcultural y funcionamiento diferencial del Maslach Burnout Inventory-General Survey en docentes de tres países latinoamericanos. Avances en Psicología Latinoamericana, 38(1), 135–156. https://doi.org/10.12804/revistas.urosario.edu.co/apl/a.6621
Kim, J., & Oshima, T. C. (2013). Effect of multiple testing adjustment in differential item functioning detection. Educational and Psychological Measurement, 73(3), 458–470. https://doi.org/10.1177/0013164412467033
Knox, M., Willard-Grace, R., Huang, B., & Grumbach, K. (2018). Maslach burnout inventory and a self-defined, single-item burnout measure produce different clinician and staff burnout estimates. Journal of General Internal Medicine, 33(8), 1344–1351. https://doi.org/10.1007/s11606-018-4507-6
Kopalle, P. K., & Lehmann, D. R. (1997). Alpha inflation? The impact of eliminating scale items on Cronbach's alpha. Organizational Behavior and Human Decision Processes, 70(3), 189–197. https://doi.org/10.1006/obhd.1997.2702
Kost, R. G., & de Rosa, J. C. (2018). Impact of survey length and compensation on validity, reliability, and sample characteristics for ultrashort-, short-, and long-research participant perception surveys. Journal of Clinical and Translational Science, 2(1), 31–37. https://doi.org/10.1017/cts.2018.18
Lai, J. S., Teresi, J., & Gershon, R. (2005). Procedures for the analysis of differential item functioning (DIF) for small sample sizes. Evaluation & the Health Professions, 28(3), 283–294. https://doi.org/10.1177/0163278705278276
Leiter, M. P. (2006). The areas of worklife model of burnout: Tests of mediation relationships. Ergonomia: An. International Journal, 28(4), 327–341.
Leiter, M. P. & Shaughnessy, K. (2006). The areas of worklife model of burnout: tests of mediation relationships. Ergonomia, 4(28), 327-341.
Levy, P. (1967). The correction for spurious correlation in the evaluation of short-form tests. Journal of Clinical Psychology, 23(1), 84–86. https://doi.org/10.1002/1097-4679(196701)23:1%3c84::aid-jclp2270230123%3e3.0.co;2-2
Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202. https://doi.org/10.1080/01621459.1988.10478722
Maslach, C., & Leiter, M. P. (1997). The truth about burnout. Josset-Bass Publishers.
Maslach, C., & Leiter, M. P. (2016). Understanding the burnout experience: Recent research and its implications for psychiatry. World Psychiatry: Official Journal of the World Psychiatric Association, 15(2), 103–111. https://doi.org/10.1002/wps.20311
Maslach, C., Jackson, S. E., Leiter, M. P., Schaufeli, W. B., & Schwab, R. L. (1986). Maslach burnout inventory. Consulting Psychologists Press.
Maslach, C., Jackson, S. E., & Leiter, M. P. (1996). Maslach burnout inventory manual (3rd ed.). Consulting Psychologists Press.
Maydeu-Olivares, A. (2017). Maximum likelihood estimation of structural equation models for continuous data: Standard errors and goodness of fit. Structural Equation Modeling: A Multidisciplinary Journal, 24(3), 383–394. https://doi.org/10.1080/10705511.2016.1269606
McCormack, H. M., MacIntyre, T. E., O’Shea, D., Herring, M. P., & Campbell, M. J. (2018). The prevalence and cause(s) of burnout among applied psychologists: A systematic review. Frontiers of Psychology, 9, Article 1897. https://doi.org/10.3389/fpsyg.2018.01897
McManus, I. C., Winder, B. C., & Gordon, D. (2002). The causal links between stress and burnout in a longitudinal study of UK doctors. Lancet, 359(9323), 2089–2090. https://doi.org/10.1016/s0140-6736(02)08915-8
Meade, A. W., & Craig, S. B. (2012). Identifying careless responses in survey data. Psychological Methods, 17(3), 437–455. https://doi.org/10.1037/a0028085
Merino-Soto, C., & Fernández-Arata, M. (2017). Ítem único de burnout en estudiantes de educación superior: Estudio de validez de contenido. Educación Médica, 18(3), 195–198. https://doi.org/10.1016/j.edumed.2016.06.019
Merino-Soto, C., & Fernández-Arata, M. (2020). Ítem único de burnout académico: Correlato con MBI-S en el nivel de los ítems. Educación Médica, 21(1), 61–62. https://doi.org/10.1016/j.edumed.2018.10.004
Merino-Soto, C., Juárez-García, A., Altamirano-Bringas, A., & Velarde-Mercado, B. (2018). Una medida muy breve del burnout: Evidencia de validez de constructo en trabajadores peruanos. Ansiedad y Estrés, 24(2–3), 131–135. https://doi.org/10.1016/j.anyes.2018.07.001
Merino-Soto, C., Lozano-Huamán, M., Lima-Mendoza, S., Calderón de la Cruz, G., Juárez-García, A., & Toledano-Toledano, F. (2022). Ultrashort version of the Utrecht work engagement scale (UWES-3): A psychometric assessment. International Journal of Environmental Research and Public Health, 19(2), Article 890. https://doi.org/10.3390/ijerph19020890.
Riley, M. R., Mohr, D. C., Waddimba, A., & C. (2018). The reliability and validity of three-item screening measures for burnout: Evidence from group-employed health care practitioners in upstate New York. Journal of the International Society for the Investigation of Stress, 34(1), 187–193. https://doi.org/10.1002/smi.2762
Rohland, B. M., Kruse, G. R., & Rohrer, J. E. (2004). Validation of a single-item measure of burnout against the Maslach burnout inventory among physicians. Stress and Health: Journal of the International Society for the Investigation of Stress, 20(2), 75–79. https://doi.org/10.1002/smi.1002
Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
Schaufeli, W. B., Shimazu, A., Hakanen, J., Salanova, M., & De Witte, H. (2019). An ultra-short measure for work engagement: The UWES-3 validation across five countries. European Journal of Psychological Assessment, 35(4), 577–591. https://doi.org/10.1027/1015-5759/a000430
Schoeni, R. F., Stafford, F., Mcgonagle, K. A., & Andreski, P. (2013). Response rates in National Panel Surveys. The Annals of the American Academy of Political and Social Science, 645(1), 60–87. https://doi.org/10.1177/0002716212456363
Shi, D., & Maydeu-Olivares, A. (2020). The effect of estimation methods on SEM fit indices. Educational and Psychological Measurement, 80(3), 421–445. https://doi.org/10.1177/0013164419885164
Shoman, Y., Marca, S. C., Bianchi, R., Godderis, L., van der Molen, H. F., & Guseva Canu, I. (2021). Psychometric properties of burnout measures: A systematic review. Epidemiology and Psychiatric Sciences, 30, Article e8. https://doi.org/10.1017/S2045796020001134.
Sijtsma, K., & van der Ark, L. A. (2003). Investigation and treatment of missing item scores in test and questionnaire data. Multivariate Behavioral Research, 38(4), 505–528. https://doi.org/10.1207/s15327906mbr3804_4
Silvestrin, M., & de Beer, L. T. (2022). esemComp: ESEM-within-CFA syntax composer. R package version 0.2. https://mateuspsi.github.io/esemComp. Accessed 01 Dec 2023
Taris, T. W., Ybema, J. F., & Beek, I. V. (2017). Burnout and engagement: Identical twins or just close relatives? Burnout Research, 5, 3–11. https://doi.org/10.1016/j.burn.2017.05.002
Tierney, N., Cook, D., McBain, M., & Fay, C. (2021). naniar: Data structures, summaries, and visualisations for missing data. R package version 0.6.1. https://CRAN.R-project.org/package=naniar. Accessed 13 Jan 2023
Wells, C. S. (2022). MeasInv: Collection of methods to detect dichotomous and polytomous Differential Item Functioning (DIF). R package version 0.1.0. https://github.com/cswells1/MeasInv/. Accessed 15 Jan 2023
West, C. P., Dyrbye, L. N., Satele, D. V., Sloan, J. A., & Shanafelt, T. D. (2012). Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. Journal of General Internal Medicine, 27(11), 1445–1452. https://doi.org/10.1007/s11606-012-2015-7
Yang, C., Nay, S., & Hoyle, R. H. (2010). Three approaches to using lengthy ordinal scales in structural equation models: Parceling, latent scoring, and shortening scales. Applied Psychological Measurement, 34(2), 122–142. https://doi.org/10.1177/0146621609338592
Yentes R. D., & Wilhelm, F. (2021). Careless: Procedures for computing indices of careless responding. R package version 1.2.1. https://cran.r-project.org/web/packages/careless/citation.html. Accessed 06 Dec 2023
Zumbo B. D. (1999). A handbook on the theory and methods of differential item functioning (DIF): Logistic regression modeling as a unitary framework for binary and Likert-type (ordinal) item scores. Directorate of Human Resources Research and Evaluation, Department of National Defense.
Acknowledgments
We acknowledge to Participants institutions and teachers.
Author information
Authors and Affiliations
Contributions
Conceptualization: César Merino-Soto, Manuel Fernández-Arata; Methodology: César Merino-Soto, Gustavo Calderón-De la Cruz; Formal analysis and investigation: César Merino-Soto, Gustavo Calderón-De la Cruz; Writing - original draft preparation: César Merino-Soto; Writing - review and editing: César Merino-Soto, Gustavo Calderón-De la Cruz, Manuel Fernández-Arata; Funding acquisition: Manuel Fernández-Arata; Resources: Manuel Fernández-Arata; Supervision: Gustavo Calderón-De la Cruz.
Corresponding author
Ethics declarations
Ethical approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. The study was granted granted exemption from requiring ethics approval because the study was not an intervention, no identifying information was obtained, and the survey contains statements innocuous to the participant’s well-being.
Informed consent
Informed consent was obtained from all individual participants included in the study.
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Merino-Soto, C., Calderón-De la Cruz, G. & Fernández-Arata, M. Maslach Burnout Inventory-General Survey’s abbreviated measurement: validation in Peruvian teachers. Occup Health Sci 7, 631–644 (2023). https://doi.org/10.1007/s41542-023-00149-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41542-023-00149-9