Abstract
Traditional nonparametric frontier techniques to measure hospital efficiency have been criticized for their deterministic nature and the inability to incorporate external factors into the analysis. Moreover, efficiency estimates represent a relative measure meaning that the implications from a hospital efficiency analysis based on a single-country dataset are limited by the availability of suitable benchmarks. Our first objective is to demonstrate the application of advanced nonparametric methods that overcome the limitations of the traditional nonparametric frontier techniques. Our second objective is to provide guidance on how an international comparison of hospital efficiency can be conducted using the example of two countries: Italy and Germany. We rely on a partial frontier of order-m to obtain efficiency estimates robust to outliers and extreme values. We use the conditional approach to incorporate hospital and regional characteristics into the estimation of efficiency. The obtained conditional efficiency estimates may deviate from the traditional unconditional efficiency estimates, which do not account for the potential influence of operational environment on the production possibilities. We nonparametrically regress the ratios of conditional to unconditional efficiency estimates to examine the relation of hospital and regional characteristics with the efficiency performance. We show that the two countries can be compared against a common frontier when the challenges of international data compatibility are successfully overcome. The results indicate that there are significant differences in the production possibilities of Italian and German hospitals. Moreover, hospital characteristics, particularly bed-size category, ownership status, and specialization, are significantly related to differences in efficiency performance across the analyzed hospitals.
Similar content being viewed by others
References
Kruk ME, Freedman LP (2008) Assessing health system performance in developing countries: a review of the literature. Health Policy 85(3):263–276
Hollingsworth B (2008) The measurement of efficiency and productivity of health care delivery. Health Economics 17(10):1107–1128
Ozcan YA (2014) Health Care benchmarking and performance evaluation An assessment using data envelopment analysis (DEA), 2nd edn. Springer, Newton, MA
Daraio C, Simar L (2007) Advanced robust and nonparametric methods in efficiency analysis [electronic resource]: Methodology and applications, vol 4. Springer, New York
Daraio C, Bonaccorsi A, Simar L (2015) Efficiency and economies of scale and specialization in european universities: a directional distance approach. J Informetrics 9(3):430–448. doi:10.1016/j.joi.2015.03.002
De Witte K, Marques RC (2010) Designing performance incentives, an international benchmark study in the water sector. Central European Journal of Operations Research 18(2):189–220
Medin E, Häkkinen U, Linna M, Anthun KS, Kittelsen SA, Rehnberg C (2013) international hospital productivity comparison: experiences from the nordic countries. Health Policy 112(1):80–87
Dervaux B, Ferrier GD, Leleu H, Valdmanis V (2004) Comparing French and US hospital technologies: a directional input distance function approach. Applied Economics 36(10):1065–1081
Mobley LR IV, Magnussen J (1998) An international comparison of hospital efficiency: does institutional environment matter? Applied Economics 30(8):1089–1100
Steinmann L, Dittrich G, Karmann A, Zweifel P (2004) Measuring and comparing the (in) efficiency of german and swiss hospitals. The European Journal of Health Economics 5(3):216–226
Mateus C, Joaquim I, Nunes C (2015) Measuring hospital efficiency—comparing four european countries. European Journal of Public Health 25(suppl 1):52–58
Cazals C, Florens J-P, Simar L (2002) Nonparametric frontier estimation: a robust approach. J Econometrics 106(1):1–25
Daraio C, Simar L (2005) Introducing environmental variables in nonparametric frontier models: a probabilistic approach. Journal of Productivity Analysis 24(1):93–121
Bădin L, Daraio C, Simar L (2014) Explaining inefficiency in nonparametric production models: the state of the art. Annals of Operations Research 214(1):5–30
Cordero JM, Alonso-Morán E, Nuño-Solinis R, Orueta JF, Arce RS (2015) Efficiency assessment of primary care providers: a conditional nonparametric approach. European Journal of Operational Research 240(1):235–244
Ferreira D, Marques R (2014) Should inpatients be adjusted by their complexity and severity for efficiency assessment? Evidence from Portugal. Health Care Manag Sci:1–15. doi:10.1007/s10729-014-9286-y
Barbetta GP, Turati G, Zago AM (2007) Behavioral differences between public and private not-for-profit hospitals in the italian national health service. Health Economics 16(1):75–96
Berta P, Callea G, Martini G, Vittadini G (2010) The effects of upcoding, cream skimming and readmissions on the italian hospitals efficiency: a population-based investigation. Economic Modelling 27(4):812–821
Cellini R, Pignataro G, Rizzo I (2000) Competition and efficiency in health care: an analysis of the italian case. Int Tax Public Finan 7(4–5):503–519
Daidone S, D’Amico F (2009) Technical efficiency, specialization and ownership form: evidences from a pooling of italian hospitals. Journal of Productivity Analysis 32(3):203–216
Matranga D, Bono F, Casuccio A, Firenze A, Marsala L, Giaimo R, Sapienza F, Vitale F (2013) Evaluating the effect of organization and context on technical efficiency: a second-stage dea analysis of italian hospitals. Epidemiology, Biostatistics and Public Health 11(1):1–11
Siciliani L (2006) Estimating Technical Efficiency in the Hospital Sector with Panel Data. Applied Health Economics and Health Policy 5(2):99–116
Atella V, Belotti F, Daidone S, Ilardi G, Marini G (2012) Cost-containment policies and hospital efficiency: evidence from a panel of Italian hospitals. CEIS Working Paper No 228. doi:10.2139/ssrn.2038398
Herr A (2008) Cost and technical efficiency of german hospitals: does ownership matter? Health Economics 17(9):1057–1071
Herr A, Schmitz H, Augurzky B (2011) Profit efficiency and ownership of german hospitals. Health Economics 20(6):660–674
Herwartz H, Strumann C (2012) On the effect of prospective payment on local hospital competition in Germany. Health Care Manag Sci 15(1):48–62
Staat M (2006) Efficiency of hospitals in germany: a dea-bootstrap approach. Applied Economics 38(19):2255–2263
Tiemann O, Schreyögg J (2009) Effects of ownership on hospital efficiency in germany. Business Research 2(2):115–145
Tiemann O, Schreyögg J (2012) Changes in hospital efficiency after privatization. Health Care Management Science 15(4):310–326. doi:10.1007/s10729-012-9193-z
Lindlbauer I, Schreyögg J (2014) The relationship between hospital specialization and hospital efficiency: do different measures of specialization lead to different results? Health Care Management Science 17(4):365–378
Büchner VA, Hinz V, Schreyögg J (2014) Health systems: changes in hospital efficiency and profitability. Health Care Manag Sci: 1–14. doi:10.1007/s10729-014-9303-1
Ferrer F, de Belvis AG, Valerio L, Longhi S, Lazzari A, Fattore G, Ricciardi W, Maresso A (2014) Italy: health system review. Health Systems in Transition 16(4):1–168
OECD (2014) Health statistics. Organisation for Economic Co-Operation and Development (OECD). doi:10.1787/health-data-en
Piacenza M, Turati G, Vannoni D (2010) Restructuring hospital industry to control public health care expenditure: the role of input substitutability. Economic Modelling 27(4):881–890. doi:10.1016/j.econmod.2009.10.006
Tauchmann H (2012) Partial frontier efficiency analysis. Stata J 12(3):461–478
Bădin L, Daraio C, Simar L (2010) Optimal bandwidth selection for conditional efficiency measures: a data-driven approach. The European Journal of Health Economics 201(2):633–640
Jeong S-O, Park BU, Simar L (2010) Nonparametric conditional efficiency measures: asymptotic properties. Annals of Operations Research 173(1):105–122
Simar L, Wilson PW (2011) Two-Stage DEA: caveat emptor. Journal of Productivity Analysis 36(2):205–218
Simar L, Wilson PW (2007) Estimation and inference in two-stage, semi-parametric models of production processes. J Econometrics 136(1):31–64
Daraio C, Simar L, Wilson PW (2010) Testing whether two-stage estimation is meaningful in non-parametric models of production. ISBA Discussion Papers,
Bădin L, Daraio C, Simar L (2012) How to measure the impact of environmental factors in a nonparametric production model. Eur J Health Econ 223(3):818–833
Simar L (2003) Detecting outliers in frontier models: a simple approach. Journal of Productivity Analysis 20(3):391–424
De Witte K, Kortelainen M (2013) What explains the performance of students in a heterogeneous environment? conditional efficiency estimation with continuous and discrete environmental variables. Applied Economics 45(17):2401–2412
Li Q, Racine JS (2008) Nonparametric estimation of conditional cdf and quantile functions with mixed categorical and continuous data. Journal of Business & Economic Statistics 26(4):423–434
Hayfield T, Racine JS (2008) Nonparametric econometrics: The np package. J Stat Softw 27(5):1–32
OECD (2014) Regional Statistics. Organisation for Economic Co-Operation and Development (OECD). doi:10.1787/region-data-en
Worthington AC (2004) Frontier efficiency measurement in health care: a review of empirical techniques and selected applications. Medical Care Research and Review 61(2):135–170
Linna M, Häkkinen U, Peltola M, Magnussen J, Anthun KS, Kittelsen S, Roed A, Olsen K, Medin E, Rehnberg C (2010) Measuring cost efficiency in the nordic hospitals—a cross-sectional comparison of public hospitals in 2002. Health Care Management Science 13(4):346–357
Varabyova Y, Schreyögg J (2013) International comparisons of the technical efficiency of the hospital sector: panel data analysis of oecd countries using parametric and non-parametric approaches. Health Policy 112(1):70–79
Clark JR, Huckman RS (2012) Broadening focus: spillovers, complementarities, and specialization in the hospital industry. Management Science 58(4):708–722
Kobel C, Theurl E (2013) Hospital specialisation within a DRG-framework: The Austrian case. Working papers in economics and statistics,
DeLellis NO, Ozcan YA (2013) Quality outcomes among efficient and inefficient nursing homes: a national study. Health Care Manage R 38(2):156–165
Narcı HÖ, Ozcan YA, Şahin İ, Tarcan M, Narcı M (2015) An examination of competition and efficiency for hospital industry in Turkey. Health Care Manag Sci 18(4):407–418. doi:10.1007/s10729-014-9315-x
Zwanziger J, Melnick GA (1988) The effects of hospital competition and the medicare pps program on hospital cost behavior in california. Journal of Health Economics 7(4):301–320
Carr WJ, Feldstein PJ (1967) The relationship of cost to hospital size. Inquiry 4(2):45–65
Tiemann O, Schreyögg J, Busse R (2012) Hospital ownership and efficiency: a review of studies with particular focus on germany. Health Policy 104(2):163–171
Ettelt S, Thomson S, Nolte E, Mays N (2007) The regulation of competition between publicly-financed hospitals. London School of Hygiene and Tropical Medicine, London, UK
Araújo C, Barros CP, Wanke P (2014) Efficiency determinants and capacity issues in brazilian for-profit hospitals. Health Care Management Science 17(2):126–138
Porter ME (2010) What is value in health care? New Engl J Med 363(26):2477–2481. doi:10.1056/NEJMp1011024
Fattore G, Torbica A (2006) Inpatient reimbursement system in italy: how do tariffs relate to costs? Health Care Management Science 9(3):251–258
Acknowledgments
We express our gratitude to Kristof De Witte for providing the R code, which we used for our analysis, and to Cinzia Daraio for providing the MATLAB code, which we used for reference. We thank Bruce Hollingsworth for his guidance in the conceptualization stage of the study. We also thank our three anonymous reviewers for providing insightful comments and suggesting ways to improve our study.
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
1.1 The unconditional efficiency measure
The production technology is described by the vector of inputs \( X\in {R}_{+}^p \) and the vector of outputs \( Y\in {R}_{+}^q \). The production set Ψ includes all technically feasible combinations of inputs and outputs and is defined as follows:
Cazals et al. [12] and Daraio & Simar [13] proposed a probabilistic formulation to describe the production process using the joint probability function:
in which H XY (x, y) is the probability that a decision-making unit (DMU) operating at (x, y) will be dominated.
In the output-oriented case, the joint probability function H XY (x, y) can be decomposed as follows:
in which F X (x) is the cumulative distribution function of X and S Y|X (y| x) is the conditional survival function of Y.
Under free disposability, the Farrell-Debreu output-oriented efficiency is given by:
The nonparametric estimator of λ(x, y) is obtained from the empirical version of the conditional survival function:
where I(∙) is an indicator function that takes the value of one if the argument is true and zero otherwise.
To obtain robust estimates, Cazals et al. [12] suggested estimating the partial efficiency measure (of order-m) by comparing a unit (x, y) to m randomly selected peers from the population of units producing more output than y. The order-m output-oriented efficiency measure is given by the following integral:
1.2 The conditional efficiency measure
Cazals et al. [12] and Daraio & Simar [13] demonstrated the conditional measures of efficiency by incorporating the set of environmental variables Z∈R r that might explain part of the production process.
The attainable conditional production set can be expressed by:
The conditional measure of output-oriented efficiency must be adapted to the condition Z = z and is given by:
in which S Y|X , Z (y| x , z) = prob(Y ≥ y| X ≤ x, Z = z) is the conditional survival function.
Owing to the equality constraint Z = z, the nonparametric estimation of S Y|X , Z (y| x , z) differs from the unconditional case because a smoothing technique in z is used. This technique requires using a kernel estimator:
in which K(∙) is some kernel function with compact support and h n is the observation-specific bandwidth. De Witte & Kortelainen [43] suggested employing the kernel function of Li & Racine [44], which accommodates continuous, ordered, and unordered discrete environmental variables.
Similarly to the unconditional order-m efficiency, the conditional measure of output-oriented order-m efficiency is obtained by the following integral:
Rights and permissions
About this article
Cite this article
Varabyova, Y., Blankart, C.R., Torbica, A. et al. Comparing the Efficiency of Hospitals in Italy and Germany: Nonparametric Conditional Approach Based on Partial Frontier. Health Care Manag Sci 20, 379–394 (2017). https://doi.org/10.1007/s10729-016-9359-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10729-016-9359-1