Relative Technical Efficiency Assessment of Mental Health Services: A Systematic Review
The current prevalence of mental disorders demands improved ways of the management and planning of mental health (MH) services. Relative technical efficiency (RTE) is an appropriate and robust indicator to support decision-making in health care, but it has not been applied significantly in MH. This article systematically reviews the empirical background of RTE in MH services following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Finally, 13 studies were included, and the findings provide new standard classifications of RTE variables, efficiency determinants and strategies to improve MH management and planning.
KeywordsSystematic review Relative technical efficiency Mental health service Mental health care DEA
We would like to thank Carlos Pereira, José Juan Uriarte, Enrique Pinilla (Mental Health Network of Bizkaia), Álvaro Iruin and Andrea Gabilondo (Mental Health Network of Gipuzkoa) for the support.
This study was funded by the Carlos III Health Institute (Ministry of Health of Spain) (Project PI15/01986) and co-funded by FEDER funds.
Compliance with Ethical Standards
Conflict of interest
The authors declare no conflict of interest.
This study does not contain any studies with human participants or animals performed by any of the authors.
This study does not contain any studies with human participants.
References marked with an asterisk indicate studies included in the systematic review
- *Alexander, J. A., Wheeler, J. R. C., Nahra, T. A., & Lemak, C. H. (1998). Managed care and technical efficiency in outpatient substance abuse treatment units. Journal of Behavioral Health Services and Research, 25(4), 377–396. https://doi.org/10.1007/BF02287509.
- *Blank, J. L. T., & Valdmanis, V. G. (2005). A modified three-stage data envelopment analysis. The European Journal of Health Economics, 6(1), 65–72. https://doi.org/10.1007/s10198-004-0260-3.
- *Corredoira, R. A., Chilingerian, J. A., & Kimberly, J. R. (2011). Analyzing performance in addiction treatment: An application of data envelopment analysis to the state of Maryland system. Journal of Substance Abuse Treatment, 41(1), 1–13. https://doi.org/10.1016/j.jsat.2011.01.006.
- *Gibert, K., García-Alonso, C., & Salvador-Carulla, L. (2010). Integrating clinicians, knowledge and data: Expert-based cooperative analysis in healthcare decision support. Health Research Policy and Systems, 8, 28. https://doi.org/10.1186/1478-4505-8-28.
- *Halsteinli, V., Kittelsen, S. A. C., & Magnussen, J. (2001). Scale, efficiency and organization in Norwegian psychiatric outpatient clinics for children. The Journal of Mental Health Policy and Economics, 4(2), 79–90.Google Scholar
- *Kontodimopoulos, N., Bellali, T., Labiris, G., & Niakas, D. (2006). Investigating sources of inefficiency in residential mental health facilities. Journal of Medical Systems, 30(3), 169–176.Google Scholar
- *Moran, V., & Jacobs, R. (2013). An international comparison of efficiency of inpatient mental health care systems. Health Policy, 112(1–2), 88–99. https://doi.org/10.1016/j.healthpol.2013.06.011.
- *Nahra, T. A., Mendez, D., & Alexander, J. A. (2009). Employing super-efficiency analysis as an alternative to DEA: An application in outpatient substance abuse treatment. European Journal of Operational Research, 196(3), 1097–1106. https://doi.org/10.1016/j.ejor.2008.04.022.
- *Ozcan, Y. A., McCue, M. J., & Okasha, A. A. (1996). Measuring the technical efficiency of psychiatric hospitals. Journal of Medical Systems, 20(3), 141–150. https://doi.org/10.1007/BF02281992.
- *Salvador-Carulla, L., García-Alonso, C. R., González-Caballero, J. L., & Garrido-Cumbrera, M. (2007). Use of an operational model of community care to assess technical efficiency and benchmarking of small mental health areas in Spain. The Journal of Mental Health Policy and Economics, 10(2), 87–100.Google Scholar
- *Torres-Jiménez, M., García-Alonso, C. R., Salvador-Carulla, L., & Fernández-Rodríguez, V. (2015). Evaluation of system efficiency using the Monte Carlo DEA: The case of small health areas. European Journal of Operational Research, 242(2), 525–535. https://doi.org/10.1016/j.ejor.2014.10.019.
- *Tyler, L. H., Ozcan, Y. A., & Wogen, S. E. (1995). Mental health case management and technical efficiency. Journal of Medical Systems, 19(5), 413–423.Google Scholar
- *Yeh, J., White, K. R., & Ozcan, Y. A. (1997). Efficiency evaluation of community-based youth services in Virginia. Community Mental Health Journal, 33(6), 487–499. https://doi.org/10.1023/A:1025096502578.
- American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders. Arlington, TX: American Psychiatric Association. https://doi.org/10.1176/appi.books.9780890425596.744053.CrossRefGoogle Scholar
- Banker, R. D., Charnes, A., & Cooper, W. W. (1984). Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science, 30(9), 1078–1092. http://econpapers.repec.org/RePEc:inm:ormnsc:v:30:y:1984:i:9:p:1078-1092.
- Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2(6), 429–444. http://econpapers.repec.org/RePEc:eee:ejores:v:2:y:1978:i:6:p:429-444.
- Emrouznejad, A., Parker, B. R., & Tavares, G. (2008). Evaluation of research in efficiency and productivity: A survey and analysis of the first 30 years of scholarly literature in DEA. Socio-economic Planning Sciences, 42(3), 151–157. https://doi.org/10.1016/j.seps.2007.07.002.CrossRefGoogle Scholar
- Ferrier, G. D., & Valdmanis, V. G. (2002). Exploring psychiatric hospital performance using data envelopment analysis and cluster analysis. Journal d’Economie Medicale, 20(3–4), 143–153. https://www.scopus.com/inward/record.uri?eid=2-s2.0-0036588661&partnerID=40&md5=4dfe8cbc35afb2b4514aab556a3d6e56.
- Killaspy, H., White, S., Dowling, S., Krotofil, J., McPherson, P., Sandhu, S., et al. (2016). Adaptation of the Quality Indicator for Rehabilitative Care (QuIRC) for use in mental health supported accommodation services (QuIRC-SA). BMC Psychiatry, 16(1), 101. https://doi.org/10.1186/s12888-016-0799-4.CrossRefPubMedPubMedCentralGoogle Scholar
- Lin, J. R., Chen, C. Y., & Peng, T. K. (2017). Study of the relevance of the quality of care, operating efficiency and inefficient quality competition of senior care facilities. International Journal of Environmental Research and Public Health. https://doi.org/10.3390/ijerph14091047.CrossRefPubMedPubMedCentralGoogle Scholar
- Montagni, I., Salvador-Carulla, L., Mcdaid, D., Straßmayr, C., Endel, F., Näätänen, P., et al. (2017). The REFINEMENT Glossary of terms: An international terminology for mental health systems assessment. Administration and Policy in Mental Health and Mental Health Services Research. https://doi.org/10.1007/s10488-017-0826-x.CrossRefGoogle Scholar
- Priebe, S., Saidi, M., Want, A., Mangalore, R., & Knapp, M. (2009). Housing services for people with mental disorders in England: Patient characteristics, care provision and costs. Social Psychiatry and Psychiatric Epidemiology, 44(10), 805–814. https://doi.org/10.1007/s00127-009-0001-0.CrossRefPubMedGoogle Scholar
- References marked with an asterisk indicate studies included in the systematic review.Google Scholar
- Salvador-Carulla, L., Alvarez-Galvez, J., Romero, C., Gutiérrez-Colosía, M. R., Weber, G., McDaid, D., et al. (2013). Evaluation of an integrated system for classification, assessment and comparison of services for long-term care in Europe: The eDESDE-LTC study. BMC Health Services Research, 13(1), 218. https://doi.org/10.1186/1472-6963-13-218.CrossRefPubMedPubMedCentralGoogle Scholar
- Takundwa, R., Jowett, S., McLeod, H., & Peñaloza-Ramos, M. C. (2017). The effects of environmental factors on the efficiency of clinical commissioning groups in England: A data envelopment analysis. Journal of Medical Systems, 41(6), 1–7. https://doi.org/10.1007/s10916-017-0740-5.CrossRefGoogle Scholar
- Tavares, G. (2002). A bibliography of Data Envelopment Analysis (1978–2001). RRR (Rutgers Research Report, p 186). http://rutcor.rutgers.edu/2002.html, http://rutcor.rutgers.edu/pub/rrr/reports2002/1_2002.pdf.
- Thornicroft, G., & Tansella, M. (2009). Better mental health care (Cambridge edition). Cambridge University Press.Google Scholar
- World Health Organization. (2005). Mental health policy, plans and programmes. Mental health policy and service guidance packages (pp 1–122). http://www.who.int/mental_health/policy/services/2_policy plans prog_WEB_07.pdf.
- World Health Organization. (2010). ATLAS on Substance Use (2010)—Resources for the prevention and treatment of substance use disorders. Chapter 2. Health Services. France. http://www.who.int/substance_abuse/activities/msbatlaschtwo.pdf?ua=1.
- World Health Organization. (2017). Mental disorders. http://www.who.int/mediacentre/factsheets/fs396/en/.
- World Health Organization. (2018). The International Classification of Diseases 11th Revision. Retrieved October 8, 2018, from https://icd.who.int/.