Skip to main content
Log in

How efficient are Greek hospitals? A case study using a double bootstrap DEA approach

  • Original Paper
  • Published:
The European Journal of Health Economics Aims and scope Submit manuscript

Abstract

The purpose of this study was to measure Greek hospital performance using different input–output combinations, and to identify the factors that influence their efficiency thus providing policy makers with valuable input for the decision-making process. Using a unique dataset, we estimated the productive efficiency of each hospital through a bootstrapped data envelopment analysis (DEA) approach. In a second stage, we explored, using a bootstrapped truncated regression, the impact of environmental factors on hospitals’ technical and scale efficiency. Our results reveal that over 80 % of the examined hospitals appear to have a technical efficiency lower than 0.8, while the majority appear to be scale efficient. Moreover, efficiency performance differed with inclusion of medical examinations as an additional variable. On the other hand, bed occupancy ratio appeared to affect both technical and scale efficiency in a rather interesting way, while the adoption of advanced medical equipment and the type of hospital improves scale and technical efficiency, correspondingly. The findings of this study on Greek hospitals’ performance are not encouraging. Furthermore, our results raise questions regarding the number of hospitals that should operate, and which type of hospital is more efficient. Finally, the results indicate the role of medical equipment in performance, confirming its misallocation in healthcare expenditure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. Total expenditure on health as percent of GDP was 9.7 and 10.1 for 2009 and 2008, respectively (WHO) [1].

  2. Table 1 presents a list of studies that refers to evaluation of Greek hospitals, examining their efficiency and productivity.

  3. We are aware that traditional DEA has proven to be an effective and versatile tool for health care efficiency measurement; a thorough literature review shows its use has spread throughout hospital performance measurement. Hollingsworth et al. [15] and Hollingsworth [16, 17] provide a comprehensive review of the literature focusing on non-parametric measurement of efficiency in health care. Furthermore, O’Neil et al. [18] provide a systematic review and taxonomy of hospital efficiency studies that utilize DEA and related techniques for efficiency measurement.

  4. A representative example concerning the comparison of DEA and SFA for the hospital’s case can be found in Chirikos and Sear [20].

  5. The main advantages and disadvantages of the SF and DEA approaches are discussed analytically by Coelli et al. [21].

  6. This procedure took place in 2008, as part of a PhD thesis on health technology efficiency carried out in the Department of Economics of University of Patras.

  7. One of the referees of this paper raised the issue of cost data, noting that the health care efficiency literature included numerous studies that examine the role of cost variables in hospital efficiency. We appreciate this valuable comment but data restrictions did not allow us to conduct an analogous examination.

  8. Many patients proceed with preventive (or not) medical tests that sometimes led to new admissions or readmissions to the same hospital.

  9. Model 1 uses the number of beds, doctors and nurses as input variables while number of surgeries, days of treatment and medical examinations are used as output variables. Model 3 uses number of medical examinations as a additional input variable.

  10. The same tests were applied in the case of the different input–output combinations. However, our results did not provide any difference for both scale and technical efficiency. These results are available upon request.

  11. Gaussian Kernel function was used in all density estimations. Our estimation using alternative functions (i.e., uniform, epanechnicov) were identified to those obtained by Gaussian. For our estimation, we used STAT 10. The optimal bandwidth provided by STAT minimizes the mean integrated squared error if a Gaussian Kernel function is used and varies between 0.01 and 0.04.

References

  1. World Health Organization (WHO): National Health Accounts. Geneva (2010)

  2. Greek Ministry of Health and Social Solidarity Report. Athens (2011)

  3. Athanassopoulos, A.D., Gounaris, C., Sissouras, A.: A descriptive assessment of the cost and production efficiency of the general hospitals in Greece. Health Care Manag. Sci. 2, 97–106 (1999)

    Article  PubMed  CAS  Google Scholar 

  4. Athanassopoulos, D., Gounaris, C.: Assessing the technical allocative efficiency of hospital operation in Greece and its resource allocation implication. Eur. J. Oper. Res. 133, 416–431 (2001)

    Article  Google Scholar 

  5. Giokas, D.I.: Greek hospitals: how well their resources are used Omega. Int. J. Manag. Sci. 29(1), 73–83 (2001)

    Google Scholar 

  6. Polyzos, N.M.: Striving towards efficiency in the Greek hospitals by reviewing case mix classifications. Health Policy 61(3), 305–328 (2002)

    Article  PubMed  Google Scholar 

  7. Niakas, D., Theodorou, M., Liaropoulos, L.: Can privatising selected services benefit the public healthcare system? The Greek case. Appl. Health Econ. 4(3), 153–157 (2005)

    Article  Google Scholar 

  8. Kontodimopoulos, N., Nanos, P., Niakas, D.: Balancing efficiency of health services and equity of access in remote areas in Greece. Health Policy 76(1), 49–57 (2006)

    Article  PubMed  Google Scholar 

  9. Aletras, V., Kontodimopoulos, N., Zagouldoudis, A., Niakas, D.: The short-term effect on technical and scale efficiency of establishing regional health systems and general management in Greek NHS hospitals. Health Policy 83(2), 236–245 (2007)

    Article  PubMed  Google Scholar 

  10. Katharaki, M.: Approaching the management of hospital units with an operation research technique: the case of 32 Greek obstetric and gynaecology public units. Health Policy 85(1), 19–31 (2008)

    Article  PubMed  Google Scholar 

  11. Flokou, A., Kontodimopoulos, N., Niakas, D.: Employing post-DEA Cross-evaluation and cluster analysis in a sample of Greek NHS Hospitals. J. Med. Syst. 35(5), 1–14 (2011)

    Article  Google Scholar 

  12. Dimas, G., Goula, A., Soulis, S.: Productive performance and its components in Greek public hospitals. Oper. Res. 12(1), 15–27 (2012)

    Google Scholar 

  13. Tsekouras, K., Papathanassopoulos, F., Kounetas, K., Pappous, G.: Does the adoption of new technology boost productive efficiency in the public sector? the case of ICUs system. Int. J. Prod. Econ. 128(1), 427–433 (2010)

    Article  Google Scholar 

  14. Androutsou, L., Geitona, M., Yfantopoulos, J.: Measuring efficiency and productivity across hospitals in the Regional Health Authority of Thessaly, in Greece. J. Health Manag. 13(2), 121–140 (2011)

    Article  Google Scholar 

  15. Hollingsworth, B., Dawson, P.J., Maniadakis, N.: Efficiency measurement of health care: a review of non-parametric methods and applications. Health Care Manag. Sci. 2(3), 161–172 (1999)

    Article  PubMed  CAS  Google Scholar 

  16. Hollingsworth, B.: Non-parametric and parametric applications measuring efficiency in health care. Health Care Manag. Sci. 6(4), 203–218 (2003)

    Article  PubMed  Google Scholar 

  17. Hollingsworth, B.: The measurement of efficiency and productivity of health care delivery. Health Econ. 17(10), 1107–1128 (2008)

    Article  PubMed  Google Scholar 

  18. O’Neil, L., Rauner, M., Heidenberger, K., Kraus, M.: A cross-national comparison and taxonomy of DEA-based hospital efficiency studies. Soc. Econ. Plan. Sci. 42(3), 158–189 (2008)

    Article  Google Scholar 

  19. Fried, H.O., Lovell, C.A.K., Schmidt, S.C.: Efficiency and productivity. In: Fried, H.O., Lovell, C.A.K., Schmidt, S.C. (eds.) The measurement of productive efficiency and productivity growth, pp. 3–91. Oxford University Press, New York (2008)

    Chapter  Google Scholar 

  20. Chirikos, T.N., Sear, A.M.: Measuring hospital efficiency: a comparison of two approaches. Health Serv Res 34(6), 1389–1408 (2000)

    PubMed  CAS  Google Scholar 

  21. Coelli, T.J., Prasada, D.S.R., Battese, G.E.: An Introduction to efficiency and productivity analysis. Kluwer, Boston (2005)

    Google Scholar 

  22. Simar, L., Wilson, P.W.: Sensitivity analysis of efficiency scores: how to bootstrap in nonparametric frontier models. Manag. Sci. 44, 49–61 (1998)

    Article  Google Scholar 

  23. Simar, L., Wilson, P.W.: Estimating and bootstrapping Malmquist indices. Eur. J. Oper. Res. 115, 459–471 (1999)

    Article  Google Scholar 

  24. Simar, L., Wilson, P.W.: A general methodology for bootstrapping in nonparametric frontier models. J. Appl. Stat. 27, 779–802 (2000)

    Article  Google Scholar 

  25. Simar, L., Wilson, P.W.: Estimation and inference in two-stage, semi-parametric models of production processes. J. Econ. 136, 31–64 (2007)

    Google Scholar 

  26. Charnes, A., Cooper, W.W., Rhodes, E.: Measuring the efficiency of decision making units. Eur. J. Oper. Res. 2, 429–444 (1978)

    Article  Google Scholar 

  27. Banker, R.D., Charnes, A., Cooper, W.W.: Some models for estimating technical and scale inefficiencies in Data Envelopment Analysis. Manag. Sci. 30, 1078–1092 (1984)

    Article  Google Scholar 

  28. Efron, B.: Bootstrap methods: another Look at the Jackknife. Ann. Stat. 7(1), 1–26 (1979)

    Article  Google Scholar 

  29. Efron, B.: The Jackknife, Bootstrap, and Other Resampling Plans. Siam monograph No. 38, CBMS-NSF. Philadelphia (1982)

  30. Efron, B., Tibshirani, R.J.: An introduction to the bootstrap. Chapman & Hall, New York (1993)

    Google Scholar 

  31. Simar, L.: Estimating efficiencies from frontier models with panel data: a comparison of parametric, non-parametric and semi-parametric methods with bootstrapping. J. Prod. Anal. 3(1–2), 171–203 (1992)

    Article  Google Scholar 

  32. Assaf, A.: Bootstrapped scale efficiency measures of UK airports. J. Air Transp. Manag. 16, 42–44 (2010)

    Article  Google Scholar 

  33. Butler, J.R.G.: Hospital cost analysis. Kluwer, Boston (1995)

    Book  Google Scholar 

  34. Mutter, R., Valdmanis, V., Rosko, M.: High versus lower quality hospitals: a comparison of environmental characteristics and technical efficiency. Health Serv. Outcome Res. Meth 10(3–4), 134–153 (2010)

    Article  Google Scholar 

  35. Ozcan, Y.A., Lins, M.E., Lobo, M.S.C., da Silva, A.C.M., Fiszman, R., Pereira, B.B.: Evaluating the performance of Brazilian university hospitals. Ann. Oper. Res. 178(1), 247–261 (2010)

    Article  Google Scholar 

  36. Esroy, K., Kavuncubasi, S., Ozcan, A.Y., Harris, M.J.: Technical efficiencies of Turkish hospitals: DEA approach. J. Med. Syst. 21(2), 67–74 (1997)

    Article  Google Scholar 

  37. Kirigia, J.M., Emrouznejad, A., Cassoma, B., Asbu, E.Z., Barry, S.A.: Performance assessment method for hospitals: the case of municipal hospitals in Angola. J. Med. Syst. 32(6), 509–519 (2008)

    Article  PubMed  Google Scholar 

  38. Sahin, I., Ozcan, Y.A., Ozgen, H.: Assessment of hospital efficiency under health transformation program in Turkey Cent. Eur. J. Oper. Res. 19(1), 19–37 (2011)

    Article  Google Scholar 

  39. Ozcan, Y.A., Luke, R.D.: A national study of the efficiency of hospitals in urban markets. Health Serv. Res. 27(6), 719–739 (1993)

    PubMed  CAS  Google Scholar 

  40. Watcharasriroj, B., Tang, J.C.S.: The effects of size and information technology on hospital efficiency. J. High Tech. Manag. Res. 15(1), 1–16 (2004)

    Article  Google Scholar 

  41. Kuntz, L., Scholtes, S., Vera, A.: Incorporating efficiency in hospital-capacity planning in Germany. Eur. J. Health. Econ. 8, 213–223 (2007)

    Article  PubMed  Google Scholar 

  42. Ludwig, M., Van Merode, F., Groot, W.: Principal agent relationships and the efficiency of hospitals. Eur. J. Health Econ. 11(3), 291–304 (2010)

    Article  PubMed  Google Scholar 

  43. Zuckerman, S., Hadley, J., Iczzoni, L.: Measuring hospital efficiency with frontier cost functions. J. Health Econ. 13, 255–280 (1994)

    Article  PubMed  CAS  Google Scholar 

  44. Puenpatom, R.A., Rosenman, R.: Efficiency of Thai provincial public hospitals during the introduction of universal health coverage using capitation. Health Care Manag. Sci. 11, 319–338 (2008)

    Article  PubMed  Google Scholar 

  45. Argote, L., Ingram, P.: Knowledge transfer: a basis for competitive advantage in firms. Organ. Behav. Hum. Dec 82(1), 150–169 (2000)

    Article  Google Scholar 

  46. Brown, H.S., Pagan, J.A.: Managed care and the scale efficiency of US Hospitals. Int. J. Health Care Fi. 6, 278–289 (2006)

    Article  Google Scholar 

  47. Jovanovic, B., Nyarko, Y.: Learning by doing and the choice of technology. Econometrica 64, 43–60 (1996)

    Article  Google Scholar 

  48. Silverman, B.W.: Density estimation for statistics and data analysis. In: Monographs on Statistics and Applied Probability. Chapman and Hall, London (1986)

Download references

Acknowledgments

The authors are most grateful to hospital managers and personnel for their help. We also thank the managing director of the Research Center for Biomaterials, EKEVYL S.A., as well as the Ministry of Health and Social Solidarity for their assistance and answers concerning data collection. Any remaining errors are the sole responsibility of the authors.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kostas Kounetas.

Appendix: A double bootstrap estimator algorithm

Appendix: A double bootstrap estimator algorithm

The steps in this procedure borrow heavily from Simar and Wilson [25], and are quite simple to implement; the complete bootstrap algorithm can be illustrated as follows:

  1. 1.

    Obtain the efficiency scores \( \widehat{{\theta_{1} }},\widehat{{\theta_{2} }}, \ldots ,\widehat{{\theta_{n} }} \) for each hospital \( i = 1,2, \ldots ,n \) as in Eq. (1) by solving the linear programming model.

  2. 2.

    Use a smooth bootstrap to generate a random sample size of N \( \theta_{{{\rm B}1}} ,\theta_{{{\rm B}2}} , \ldots ,\theta_{{{\rm B}n}} \) from \( \widehat{{\theta_{1} }},\widehat{{\theta_{2} }}, \ldots ,\widehat{{\theta_{n} }} \) where:

\( \theta_{i}^{*} = \overline{B} + \frac{{\widetilde{{\theta_{i} }}^{*} - \overline{B} }}{{\left(1 + {\raise0.7ex\hbox{${h^{2} }$} \!\mathord{\left/ {\vphantom {{h^{2} } {\widehat{{\sigma_{\theta }^{2} }}}}}\right.\kern-0pt} \!\lower0.7ex\hbox{${\widehat{{\sigma_{\theta }^{2} }}}$}}\right)^{{{\raise0.7ex\hbox{$1$} \!\mathord{\left/ {\vphantom {1 2}}\right.\kern-0pt} \!\lower0.7ex\hbox{$2$}}}} }} \) and \( \widetilde{{\theta_{i} }}^{*} = \left\{ {_{{2 - \theta_{{{\rm B}i}} - h\varepsilon_{i}^{*} ,if \, \theta_{{{\rm B}i}} + h\varepsilon_{i}^{*} < 1}}^{{\theta_{{{\rm B}i}} + h\varepsilon_{i}^{*} ,if \, \theta_{{{\rm B}i}} + h\varepsilon_{i}^{*} \ge 1}} } \right\} \).

Denote that \( \overline{B} = {\raise0.7ex\hbox{${\sum\limits_{i = 1}^{n} {\theta_{{{\rm B}i}} } }$} \!\mathord{\left/ {\vphantom {{\sum\limits_{i = 1}^{n} {\theta_{{{\rm B}i}} } } n}}\right.\kern-0pt} \!\lower0.7ex\hbox{$n$}} \) and \( \widehat{{\sigma_{\theta }^{2} }} = {\raise0.7ex\hbox{${\sum\limits_{i = 1}^{n} {(\widehat{{\theta_{i} }} - \widehat{{\overline{{\theta_{i} }} }})^{2} } }$} \!\mathord{\left/ {\vphantom {{\sum\limits_{i = 1}^{n} {(\widehat{{\theta_{i} }} - \widehat{{\overline{{\theta_{i} }} }})^{2} } } n}}\right.\kern-0pt} \!\lower0.7ex\hbox{$n$}} \), h is the smoothing parameter of the kernel density estimate of original efficiency estimates, and \( \varepsilon_{i}^{*} ,i = 1,2, \ldots ,n \) are random draws from the standard normal. Note that h is chosen via the maximizing the likelihood cross-validation function and using reflecting method described by Silverman [48].

  1. 3.

    Compute the bootstrap estimate of technical efficiency for each hospital \( i = 1,2, \ldots ,n \) using the ratio \( {\raise0.7ex\hbox{${\widehat{{\theta_{i} }}}$} \!\mathord{\left/ {\vphantom {{\widehat{{\theta_{i} }}} {\theta_{i}^{*} }}}\right.\kern-0pt} \!\lower0.7ex\hbox{${\theta_{i}^{*} }$}} \).

  2. 4.

    Resolve the original DEA model using the adjusted outputs to obtain \( \widetilde{{\theta_{k} }}^{*} \)

  3. 5.

    Repeat steps (2)–(4) to obtain a set of estimates, i.e., each hospital will have B estimates of Θ. For this analysis 2,000 samples were generated for each hospital.

Bias corrected estimates of original technical efficiency scores are derived through \( \widetilde{{\theta_{i} }} = \widehat{{\theta_{i} }} - \widehat{{{\text{bias}}_{i} }},\,\,\widehat{{{\text{bias}}_{i} }} = \frac{1}{B}\widehat{{\theta_{iB}^{*} }} - \widehat{{\theta_{i} }} \).

Truncated regression to account for environmental variables

The bootstrap algorithm examining the exogenous determinants of TE and SE efficiency is presenting as follows:

  1. 1.

    Use the original data to compute \( \widehat{{\theta_{i} }} \) by the DEA method for each hospital \( i = 1,2, \ldots ,n \).

  2. 2.

    Use the ML method to obtain the parameter estimates \( \widehat{\beta },\widehat{\sigma } \) from the truncated regression.

  3. 3.

    Now loop over the next four steps \( {\rm B} \) times to obtain a set of bootstrap estimates.

    1. 3.1

      For \( i = 1,2, \ldots ,M \) draw \( \varepsilon_{i}^{*} \) from \( N(0,\widehat{\sigma }_{\varepsilon } ) \) with left truncation \( (1 - \widehat{{\beta^{'} }}z_{i} ) \)

    2. 3.2

      Then compute the following equation \( \theta_{i}^{*} = \widehat{{\beta^{'} }}z_{i} + \varepsilon_{i}^{*} ,i = 1,2, \ldots ,M \)

    3. 3.3

      Set \( x_{i} ,y_{i}^{*} = {\raise0.7ex\hbox{${y_{i} \widehat{{\theta_{i} }}}$} \!\mathord{\left/ {\vphantom {{y_{i} \widehat{{\theta_{i} }}} {\theta_{i}^{*} }}}\right.\kern-0pt} \!\lower0.7ex\hbox{${\theta_{i}^{*} }$}}, \, \forall i = 1,2, \ldots ,M \)

    4. 3.4

      Compute \( \widehat{{\theta_{i}^{*} }} = \theta_{i} (x_{i} ,y_{i} ),\quad \forall i = 1,2, \ldots ,M \) replacing \( (x_{i} ,y_{i} ){\text{ with }}(x_{i}^{*} ,y_{i}^{*} ) \).

  4. 4.

    Compute the bias-corrected estimator using the bootstrap estimates and the original estimates.

  5. 5.

    Estimate the truncated regression of \( \widehat{{\widehat{{\theta_{i} }}}} \) on \( z_{i} \) using the maximum likelihood (ML) method.

  6. 6.

    Repeat the next three steps \( {\rm B}_{1} \) times to obtain a set of estimators.

    1. 6.1

      For \( i = 1,2, \ldots ,M \), \( \varepsilon_{i} \) is drawn from \( N(0,\widehat{{\widehat{\sigma }}}_{\varepsilon } ) \) with left truncation \( (1 - \widehat{{\widehat{{\beta^{'} }}}}z_{i} ) \).

    2. 6.2

      For \( i = 1,2, \ldots ,M \) compute \( \theta_{i}^{**} = \widehat{{\widehat{{\beta^{'} }}}}z_{i} + \varepsilon_{i}^{**} ,i = 1,2, \ldots ,M \)

    3. 6.3

      The ML method is used again to estimate the truncated regression of \( \theta_{i}^{**} \) on \( z_{i} \) providing \( \widehat{{\widehat{{\beta^{'} }}}},\widehat{{\widehat{\sigma }}}_{\varepsilon } \) estimates.

  7. 7.

    Construct the confidence intervals for the efficiency scores.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kounetas, K., Papathanassopoulos, F. How efficient are Greek hospitals? A case study using a double bootstrap DEA approach. Eur J Health Econ 14, 979–994 (2013). https://doi.org/10.1007/s10198-012-0446-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10198-012-0446-z

Keywords

JEL Classification

Navigation