Skip to main content

Advertisement

Log in

Comparing the Efficiency of Hospitals in Italy and Germany: Nonparametric Conditional Approach Based on Partial Frontier

  • Published:
Health Care Management Science Aims and scope Submit manuscript

Abstract

Traditional nonparametric frontier techniques to measure hospital efficiency have been criticized for their deterministic nature and the inability to incorporate external factors into the analysis. Moreover, efficiency estimates represent a relative measure meaning that the implications from a hospital efficiency analysis based on a single-country dataset are limited by the availability of suitable benchmarks. Our first objective is to demonstrate the application of advanced nonparametric methods that overcome the limitations of the traditional nonparametric frontier techniques. Our second objective is to provide guidance on how an international comparison of hospital efficiency can be conducted using the example of two countries: Italy and Germany. We rely on a partial frontier of order-m to obtain efficiency estimates robust to outliers and extreme values. We use the conditional approach to incorporate hospital and regional characteristics into the estimation of efficiency. The obtained conditional efficiency estimates may deviate from the traditional unconditional efficiency estimates, which do not account for the potential influence of operational environment on the production possibilities. We nonparametrically regress the ratios of conditional to unconditional efficiency estimates to examine the relation of hospital and regional characteristics with the efficiency performance. We show that the two countries can be compared against a common frontier when the challenges of international data compatibility are successfully overcome. The results indicate that there are significant differences in the production possibilities of Italian and German hospitals. Moreover, hospital characteristics, particularly bed-size category, ownership status, and specialization, are significantly related to differences in efficiency performance across the analyzed hospitals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Kruk ME, Freedman LP (2008) Assessing health system performance in developing countries: a review of the literature. Health Policy 85(3):263–276

    Article  Google Scholar 

  2. Hollingsworth B (2008) The measurement of efficiency and productivity of health care delivery. Health Economics 17(10):1107–1128

    Article  Google Scholar 

  3. Ozcan YA (2014) Health Care benchmarking and performance evaluation An assessment using data envelopment analysis (DEA), 2nd edn. Springer, Newton, MA

    Google Scholar 

  4. Daraio C, Simar L (2007) Advanced robust and nonparametric methods in efficiency analysis [electronic resource]: Methodology and applications, vol 4. Springer, New York

    Google Scholar 

  5. Daraio C, Bonaccorsi A, Simar L (2015) Efficiency and economies of scale and specialization in european universities: a directional distance approach. J Informetrics 9(3):430–448. doi:10.1016/j.joi.2015.03.002

    Article  Google Scholar 

  6. De Witte K, Marques RC (2010) Designing performance incentives, an international benchmark study in the water sector. Central European Journal of Operations Research 18(2):189–220

    Article  Google Scholar 

  7. Medin E, Häkkinen U, Linna M, Anthun KS, Kittelsen SA, Rehnberg C (2013) international hospital productivity comparison: experiences from the nordic countries. Health Policy 112(1):80–87

    Article  Google Scholar 

  8. Dervaux B, Ferrier GD, Leleu H, Valdmanis V (2004) Comparing French and US hospital technologies: a directional input distance function approach. Applied Economics 36(10):1065–1081

    Article  Google Scholar 

  9. Mobley LR IV, Magnussen J (1998) An international comparison of hospital efficiency: does institutional environment matter? Applied Economics 30(8):1089–1100

    Article  Google Scholar 

  10. Steinmann L, Dittrich G, Karmann A, Zweifel P (2004) Measuring and comparing the (in) efficiency of german and swiss hospitals. The European Journal of Health Economics 5(3):216–226

    Article  Google Scholar 

  11. Mateus C, Joaquim I, Nunes C (2015) Measuring hospital efficiency—comparing four european countries. European Journal of Public Health 25(suppl 1):52–58

    Article  Google Scholar 

  12. Cazals C, Florens J-P, Simar L (2002) Nonparametric frontier estimation: a robust approach. J Econometrics 106(1):1–25

    Article  Google Scholar 

  13. Daraio C, Simar L (2005) Introducing environmental variables in nonparametric frontier models: a probabilistic approach. Journal of Productivity Analysis 24(1):93–121

    Article  Google Scholar 

  14. Bădin L, Daraio C, Simar L (2014) Explaining inefficiency in nonparametric production models: the state of the art. Annals of Operations Research 214(1):5–30

    Article  Google Scholar 

  15. Cordero JM, Alonso-Morán E, Nuño-Solinis R, Orueta JF, Arce RS (2015) Efficiency assessment of primary care providers: a conditional nonparametric approach. European Journal of Operational Research 240(1):235–244

    Article  Google Scholar 

  16. Ferreira D, Marques R (2014) Should inpatients be adjusted by their complexity and severity for efficiency assessment? Evidence from Portugal. Health Care Manag Sci:1–15. doi:10.1007/s10729-014-9286-y

  17. Barbetta GP, Turati G, Zago AM (2007) Behavioral differences between public and private not-for-profit hospitals in the italian national health service. Health Economics 16(1):75–96

    Article  Google Scholar 

  18. Berta P, Callea G, Martini G, Vittadini G (2010) The effects of upcoding, cream skimming and readmissions on the italian hospitals efficiency: a population-based investigation. Economic Modelling 27(4):812–821

    Article  Google Scholar 

  19. Cellini R, Pignataro G, Rizzo I (2000) Competition and efficiency in health care: an analysis of the italian case. Int Tax Public Finan 7(4–5):503–519

    Article  Google Scholar 

  20. Daidone S, D’Amico F (2009) Technical efficiency, specialization and ownership form: evidences from a pooling of italian hospitals. Journal of Productivity Analysis 32(3):203–216

    Article  Google Scholar 

  21. Matranga D, Bono F, Casuccio A, Firenze A, Marsala L, Giaimo R, Sapienza F, Vitale F (2013) Evaluating the effect of organization and context on technical efficiency: a second-stage dea analysis of italian hospitals. Epidemiology, Biostatistics and Public Health 11(1):1–11

  22. Siciliani L (2006) Estimating Technical Efficiency in the Hospital Sector with Panel Data. Applied Health Economics and Health Policy 5(2):99–116

    Article  Google Scholar 

  23. Atella V, Belotti F, Daidone S, Ilardi G, Marini G (2012) Cost-containment policies and hospital efficiency: evidence from a panel of Italian hospitals. CEIS Working Paper No 228. doi:10.2139/ssrn.2038398

  24. Herr A (2008) Cost and technical efficiency of german hospitals: does ownership matter? Health Economics 17(9):1057–1071

    Article  Google Scholar 

  25. Herr A, Schmitz H, Augurzky B (2011) Profit efficiency and ownership of german hospitals. Health Economics 20(6):660–674

    Article  Google Scholar 

  26. Herwartz H, Strumann C (2012) On the effect of prospective payment on local hospital competition in Germany. Health Care Manag Sci 15(1):48–62

    Article  Google Scholar 

  27. Staat M (2006) Efficiency of hospitals in germany: a dea-bootstrap approach. Applied Economics 38(19):2255–2263

    Article  Google Scholar 

  28. Tiemann O, Schreyögg J (2009) Effects of ownership on hospital efficiency in germany. Business Research 2(2):115–145

    Article  Google Scholar 

  29. Tiemann O, Schreyögg J (2012) Changes in hospital efficiency after privatization. Health Care Management Science 15(4):310–326. doi:10.1007/s10729-012-9193-z

    Article  Google Scholar 

  30. Lindlbauer I, Schreyögg J (2014) The relationship between hospital specialization and hospital efficiency: do different measures of specialization lead to different results? Health Care Management Science 17(4):365–378

    Article  Google Scholar 

  31. Büchner VA, Hinz V, Schreyögg J (2014) Health systems: changes in hospital efficiency and profitability. Health Care Manag Sci: 1–14. doi:10.1007/s10729-014-9303-1

  32. Ferrer F, de Belvis AG, Valerio L, Longhi S, Lazzari A, Fattore G, Ricciardi W, Maresso A (2014) Italy: health system review. Health Systems in Transition 16(4):1–168

    Google Scholar 

  33. OECD (2014) Health statistics. Organisation for Economic Co-Operation and Development (OECD). doi:10.1787/health-data-en

    Google Scholar 

  34. Piacenza M, Turati G, Vannoni D (2010) Restructuring hospital industry to control public health care expenditure: the role of input substitutability. Economic Modelling 27(4):881–890. doi:10.1016/j.econmod.2009.10.006

    Article  Google Scholar 

  35. Tauchmann H (2012) Partial frontier efficiency analysis. Stata J 12(3):461–478

  36. Bădin L, Daraio C, Simar L (2010) Optimal bandwidth selection for conditional efficiency measures: a data-driven approach. The European Journal of Health Economics 201(2):633–640

    Google Scholar 

  37. Jeong S-O, Park BU, Simar L (2010) Nonparametric conditional efficiency measures: asymptotic properties. Annals of Operations Research 173(1):105–122

    Article  Google Scholar 

  38. Simar L, Wilson PW (2011) Two-Stage DEA: caveat emptor. Journal of Productivity Analysis 36(2):205–218

    Article  Google Scholar 

  39. Simar L, Wilson PW (2007) Estimation and inference in two-stage, semi-parametric models of production processes. J Econometrics 136(1):31–64

    Article  Google Scholar 

  40. Daraio C, Simar L, Wilson PW (2010) Testing whether two-stage estimation is meaningful in non-parametric models of production. ISBA Discussion Papers,

  41. Bădin L, Daraio C, Simar L (2012) How to measure the impact of environmental factors in a nonparametric production model. Eur J Health Econ 223(3):818–833

    Google Scholar 

  42. Simar L (2003) Detecting outliers in frontier models: a simple approach. Journal of Productivity Analysis 20(3):391–424

    Article  Google Scholar 

  43. De Witte K, Kortelainen M (2013) What explains the performance of students in a heterogeneous environment? conditional efficiency estimation with continuous and discrete environmental variables. Applied Economics 45(17):2401–2412

    Article  Google Scholar 

  44. Li Q, Racine JS (2008) Nonparametric estimation of conditional cdf and quantile functions with mixed categorical and continuous data. Journal of Business & Economic Statistics 26(4):423–434

    Article  Google Scholar 

  45. Hayfield T, Racine JS (2008) Nonparametric econometrics: The np package. J Stat Softw 27(5):1–32

  46. OECD (2014) Regional Statistics. Organisation for Economic Co-Operation and Development (OECD). doi:10.1787/region-data-en

    Google Scholar 

  47. Worthington AC (2004) Frontier efficiency measurement in health care: a review of empirical techniques and selected applications. Medical Care Research and Review 61(2):135–170

    Article  Google Scholar 

  48. Linna M, Häkkinen U, Peltola M, Magnussen J, Anthun KS, Kittelsen S, Roed A, Olsen K, Medin E, Rehnberg C (2010) Measuring cost efficiency in the nordic hospitals—a cross-sectional comparison of public hospitals in 2002. Health Care Management Science 13(4):346–357

    Article  Google Scholar 

  49. Varabyova Y, Schreyögg J (2013) International comparisons of the technical efficiency of the hospital sector: panel data analysis of oecd countries using parametric and non-parametric approaches. Health Policy 112(1):70–79

    Article  Google Scholar 

  50. Clark JR, Huckman RS (2012) Broadening focus: spillovers, complementarities, and specialization in the hospital industry. Management Science 58(4):708–722

    Article  Google Scholar 

  51. Kobel C, Theurl E (2013) Hospital specialisation within a DRG-framework: The Austrian case. Working papers in economics and statistics,

  52. DeLellis NO, Ozcan YA (2013) Quality outcomes among efficient and inefficient nursing homes: a national study. Health Care Manage R 38(2):156–165

    Article  Google Scholar 

  53. Narcı HÖ, Ozcan YA, Şahin İ, Tarcan M, Narcı M (2015) An examination of competition and efficiency for hospital industry in Turkey. Health Care Manag Sci 18(4):407–418. doi:10.1007/s10729-014-9315-x

  54. Zwanziger J, Melnick GA (1988) The effects of hospital competition and the medicare pps program on hospital cost behavior in california. Journal of Health Economics 7(4):301–320

    Article  Google Scholar 

  55. Carr WJ, Feldstein PJ (1967) The relationship of cost to hospital size. Inquiry 4(2):45–65

    Google Scholar 

  56. Tiemann O, Schreyögg J, Busse R (2012) Hospital ownership and efficiency: a review of studies with particular focus on germany. Health Policy 104(2):163–171

    Article  Google Scholar 

  57. Ettelt S, Thomson S, Nolte E, Mays N (2007) The regulation of competition between publicly-financed hospitals. London School of Hygiene and Tropical Medicine, London, UK

  58. Araújo C, Barros CP, Wanke P (2014) Efficiency determinants and capacity issues in brazilian for-profit hospitals. Health Care Management Science 17(2):126–138

    Article  Google Scholar 

  59. Porter ME (2010) What is value in health care? New Engl J Med 363(26):2477–2481. doi:10.1056/NEJMp1011024

    Article  Google Scholar 

  60. Fattore G, Torbica A (2006) Inpatient reimbursement system in italy: how do tariffs relate to costs? Health Care Management Science 9(3):251–258

    Article  Google Scholar 

Download references

Acknowledgments

We express our gratitude to Kristof De Witte for providing the R code, which we used for our analysis, and to Cinzia Daraio for providing the MATLAB code, which we used for reference. We thank Bruce Hollingsworth for his guidance in the conceptualization stage of the study. We also thank our three anonymous reviewers for providing insightful comments and suggesting ways to improve our study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yauheniya Varabyova.

Appendix

Appendix

1.1 The unconditional efficiency measure

The production technology is described by the vector of inputs \( X\in {R}_{+}^p \) and the vector of outputs \( Y\in {R}_{+}^q \). The production set Ψ includes all technically feasible combinations of inputs and outputs and is defined as follows:

$$ \varPsi =\left\{\left(x,y\right)\ |\ \mathrm{x}\ \mathrm{can}\ \mathrm{produce}\ y\right\}. $$
(1)

Cazals et al. [12] and Daraio & Simar [13] proposed a probabilistic formulation to describe the production process using the joint probability function:

$$ {H}_{XY}H\left(x,y\right)= Prob\left(X\le x,\mathrm{Y}\ge y\right), $$
(2)

in which H XY (x, y) is the probability that a decision-making unit (DMU) operating at (x, y) will be dominated.

In the output-oriented case, the joint probability function H XY (x, y) can be decomposed as follows:

$$ \begin{array}{c}\hfill {H}_{XY}\left(x,y\right)= Prob\left(\ Y\ge y|X\le x\right) Prob\left(X\le x\right)\hfill \\ {}\hfill ={S}_{Y\Big|X}\left(y|x\right){F}_X(x),\hfill \end{array} $$
(3)

in which F X (x) is the cumulative distribution function of X and S Y|X (y| x) is the conditional survival function of Y.

Under free disposability, the Farrell-Debreu output-oriented efficiency is given by:

$$ \lambda \left(x,y\right)=\mathit{\sup}\left\{\lambda |{S}_{Y\Big|X}\left(\lambda y|x\right)>0\right\}. $$
(4)

The nonparametric estimator of λ(x, y) is obtained from the empirical version of the conditional survival function:

$$ {\widehat{S}}_{Y\Big|X,n}\left(y|x\right)=\frac{\sum_{i=1}^nI\left({x}_i\le x,{y}_i\ge y\right)}{\sum_{i=1}^nI\left({x}_i\le x\right)}, $$
(5)

where I(∙) is an indicator function that takes the value of one if the argument is true and zero otherwise.

To obtain robust estimates, Cazals et al. [12] suggested estimating the partial efficiency measure (of order-m) by comparing a unit (x, y) to m randomly selected peers from the population of units producing more output than y. The order-m output-oriented efficiency measure is given by the following integral:

$$ {\widehat{\lambda}}_{m,n}\left(x,y\right)={\int}_0^{\infty}\left(1-{\left(1-{\widehat{S}}_{Y\Big|X,n}\left(uy|x\right)\right)}^m\right)du $$
(6)

1.2 The conditional efficiency measure

Cazals et al. [12] and Daraio & Simar [13] demonstrated the conditional measures of efficiency by incorporating the set of environmental variables ZR r that might explain part of the production process.

The attainable conditional production set can be expressed by:

$$ {\varPsi}^Z=\left\{\left(x,y\right)\right|Z=z,x\ \mathrm{can}\ \mathrm{produce}\ y\Big\}. $$

The conditional measure of output-oriented efficiency must be adapted to the condition Z = z and is given by:

$$ \lambda \left(x,y|z\right)=\mathit{\sup}\left\{\lambda |{S}_{Y\Big|X,Z}\left(\lambda y|x,z\right)>0\right\}, $$
(7)

in which S Y|X , Z (y| x , z) = prob(Y ≥ y| X ≤ x, Z = z) is the conditional survival function.

Owing to the equality constraint Z = z, the nonparametric estimation of S Y|X , Z (y| x , z) differs from the unconditional case because a smoothing technique in z is used. This technique requires using a kernel estimator:

$$ {\widehat{S}}_{Y\Big|X,Z,n}\left(y|x,\mathrm{z}\right)=\frac{\sum_{i=1}^nI\left({x}_i\le x,{y}_i\ge y\right)K\left(\left(z-{z}_i\right)/{h}_n\right)}{\sum_{i=1}^nI\left({x}_i\le x\right)K\left(\left(z-{z}_i\right)/{h}_n\right)}, $$
(8)

in which K(∙) is some kernel function with compact support and h n is the observation-specific bandwidth. De Witte & Kortelainen [43] suggested employing the kernel function of Li & Racine [44], which accommodates continuous, ordered, and unordered discrete environmental variables.

Similarly to the unconditional order-m efficiency, the conditional measure of output-oriented order-m efficiency is obtained by the following integral:

$$ {\widehat{\lambda}}_{m,n}\left(x,y|z\right)={\int}_0^{\infty}\left(1-{\left(1-{\widehat{S}}_{Y\Big|X,Z,n}\left(uy|x,z\right)\right)}^m\right)du $$
(9)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Varabyova, Y., Blankart, C.R., Torbica, A. et al. Comparing the Efficiency of Hospitals in Italy and Germany: Nonparametric Conditional Approach Based on Partial Frontier. Health Care Manag Sci 20, 379–394 (2017). https://doi.org/10.1007/s10729-016-9359-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10729-016-9359-1

Keywords

Navigation