Abstract
Conventional non-parametric linear programming (LP) based data envelopment analysis (DEA) models have the advantage of being able to estimate multiple input-output efficiency metrics but suffer from sensitivity to outliers and statistical observational noise. Previous observation-deleting approaches to the outlier/noise problem have been somewhat ad hoc usually requiring iterative LP and non-LP problem solving methods. We present the theory and methodology of quantile-DEA (qDEA), similar in concept to quantile-regression, which enables the analyst to directly use LP to obtain efficiency metrics while specifying that no more than ψ-percent of data points can lie external to the efficiency hull. Estimated qDEA-α frontiers encompassing proportion α = 1 − ψ of the data observations are contrasted to order-α frontier estimates. Quantile DEA is shown to be useful in addressing outliers in a study examining changes in relative state level agricultural efficiency measures over time.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The terminology qDEA denotes quantile DEA not to be confused with Kousmanen and Post (2002) Quadratic DEA which they denote QDEA.
- 2.
We wish to emphasize that while the qDEA process utilizes the results from a partial moment stochastic inequality to endogenously identify a set of external or “superefficient” DMUs, the set of external points are not randomly selected. This issue is discussed in more depth later in the paper.
- 3.
The resulting portfolios were found in many cases to be conservative due to the use of the LPM inequality but the resulting solutions did satisfy the requirement that no more than ψN of the income constraints were violated. Subsequent unpublished research suggested that a two stage process similar to the two-stage qDEA process discussed below would generate less conservative outcomes while still satisfying the desired limit on the number of income observations falling below g.
- 4.
- 5.
Setting ψ < 1/N will guaranty that no points will lie outside the hull i.e., obtain the conventional DEA results.
- 6.
We use the terminology “support points” to denote the points that define the hyperplane onto which the given DMU’s input-output points are projected with the distance from the initial point to the hyperplane being the estimated efficiency score. By a given DMU’s “reference set” we refer to the set of points remaining on the same side of the projection hyperplane as the given DMU.
- 7.
Table 1 lists the input and out values used in this example.
- 8.
The fact that the green point is projected using each of the green circled points is readily derived by examining the dual solution to system (5) where the resulting dual or z j values are projection weights. The dual values for all constraining equations in system (5) will be non-zero valued. The constraints associated with all external points as well the new qDEA support points will be binding in system (5).
- 9.
R code available from the authors can be used to obtain qDEA solutions with input, output, or the more general ddea DEA models.
- 10.
The authors, to date, have not been able to derive closed form expressions for the asymptotic properties of the qDEA estimates. Numerical procedures described by Geyer (2013), suggest that qDEA estimates appear to have many of the desirable features of the FDH related order-m and order-α estimators including root-n convergence and asymptotic normality. The authors have experimented extensively with the use of nCm bootstrapping as discussed by Politis et al. (1999, 2001), Geyer (2013) and Simar and Wilson (2011b) and have achieved nominal qDEA confidence interval coverage levels that compare favorably with conventional DEA results reported by Simar and Wilson.
References
Aragon, Y., Daouia, A., & Thomas-Agnan, C. (2005). Nonparametric frontier estimation: A conditional quantile-based approach. Econometric Theory, 21(2), 358–389.
Atwood, J. A. (1985). Demonstration of the use of lower partial moments to improve safety-first probability limits. American Journal of Agricultural Economics, 67, 787–793.
Atwood, J. A., Watts, M. J., Helmers, G. A., & Held, L. J. (1988). Incorporating safety-first constraints in linear programming production models. Western Journal of Agricultural Economics, 13, 29–36.
Berck, P., & Hihn, J. M. (1982). Using the semivariance to estimate safety-first rules. American Journal of Agricultural Economics, 64, 298–300.
Cazals, C., Florens, J.-P., & Simar, L. (2002). Nonparametric frontier estimation: A robust approach. Journal of Econometrics, 106, 1–25.
Charnes, A., Cooper, W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2, 429–444.
Cooper, W., Seiford, L., & Tone, K. (2006). Introduction to data envelopment analysis and its uses. New York: Springer.
Daouia, A. (2005). Asymptotic representation theory for nonstandard conditional quantiles. Journal of Nonparametric Statistics, 17, 253–268.
Daouia, A., & Laurent, T. (2013). Frontiles: Partial frontier efficiency analysis. R package version 1.2. https://CRAN.R-project.org/package=frontiles
Daouia, A., & Ruiz-Gazen, A. (2006). Robust nonparametric frontier estimators: Influence function and qualitative robustness. Statistica Sinica, 16, 1233–1253.
Daouia, A., & Simar, L. (2007). Nonparametric efficiency analysis: A multivariate conditional quantile approach. Journal of Econometrics, 140, 375–400.
Daouia, A., Florens, J.-P., & Simar, L. (2008). Frontier estimation and extreme values theory, preprint-submitted paper for publication. Available at http: www.stat.ucl.ac.be
Deprins, D., Simar, L., & Tulkens, H. (1984). Measuring labor efficiency on post offices. In P. Marchand & H. Tulkens (Eds.), The performance of public enterprises: Concepts and measurement (pp. 243–267). Amsterdam: North Holland.
Emrouznejad, A., Parker, B. R., & Tavares, G. (2008). Evaluation of research in efficiency and productivity: A survey and analysis of the first 30 years of scholarly literature in DEA. Socio-Economic Planning Sciences., 42(3), 151–157.
ERS (2016). Table 24. https://www.ers.usda.gov/data-products/agricultural-productivity-in-the-us/agricultural-productivity-in-the-us/#State-Level Tables, Price Indices and Implicit Quantities of Farm Outputs and Inputs by State, 1960–2004.
Fare, R., Grosskopf, S., & Lovell, C. A. K. (1994). Production frontiers. Cambridge: Cambridge University Press.
Farrell, M. J. (1957). The measurement of productive efficiency. Journal of the Royal Statistical Society Series A, 120, 253–281.
Farrell, M. J., & Fieldhouse, M. (1962). Estimating efficient production functions under increasing returns to scale. Journal of the Royal Statistical Society., 125, 252–267.
Fishburn, P. J. (1972). Mean-risk analysis with risk associated with below-target returns. American Economic Review., 67, 116–126.
Geyer, C. J. (2013). Statistics 5601 Notes: The Subsampling Bootstrap. University of Minnesota. Reference Material : http://www.stat.umn.edu/geyer/5601/examp/subboot.html
Kousmanen, T., & Post, T. (2002). Quadratic data envelopment analysis. Journal of the Operational Research Society, 53, 1204–1214.
Liu, J. S., Louis, Y. Y. L., Wen-Min, L., & Lin, B. J. Y. (2013). Data envelopment analysis 1978–2010: A citation-based literature survey. Omega, 41(1), 3–15. https://doi.org/10.1016/j.omega.2010.12.006.
Malmquist, S. (1953). Index numbers and indifference surfaces. Trabajos de Estatistica, 4, 209–242.
Moorsteen, R. H. (1961). On measuring productive potential and relative efficiency. Quarterly Journal of Economics, 75, 451–467.
Politis, D. N., Romano, J. P., & Wolf, M. (1999). Subsampling. New York: Springer.
Politis, D. N., Romano, J. P., & Wolf, M. (2001). On the asymptotic theory of subsampling. Statistica Sinica, 11, 1105–1124.
Shaik, S. (1998). Environmentally Adjusted Productivity [EAP] Measures for Nebraska Agriculture Sector. Ph.D. dissertation Department of Agricultural Economics, University of Nebraska-Lincoln.
Shaik, S. (2013). Does crop insurance affect the technical efficiency? a panel DEA analysis. American Journal of Agricultural Economics., 95(5), 1136–1154.
Shaik, S., Mishra, A., & Atwood, J. A. (2012). Aggregation issues in the estimation of linear programming productivity measures. Journal of Applied Economics, XV(1), 169–187.
Shephard, R. W. (1953). Cost and production functions. Princeton: Princeton University Press.
Simar, L. (2003). Detecting outliers in frontier models: a simple approach. Journal of Productivity Analysis., 20, 391–424.
Simar, L., & Wilson, P. W. (2011a). Estimation and inference in nonparametric frontier models: Recent developments and perspectives. Foundations and Trends in Econometrics, 5(3–4), 183–337.
Simar, L., & Wilson, P. W. (2011b). Inference by the m Out of n Bootstrap in nonparametric frontier models. Journal of Productivity Analysis, 36, 33–53.
Simar, L., Vanhems, A., & Wilson, P. W. (2012). Statistical inference for DEA estimators of directional distances. European Journal of Operational Research, 220, 853–864.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Atwood, J.A., Shaik, S. (2018). Quantile DEA: Estimating qDEA-alpha Efficiency Estimates with Conventional Linear Programming. In: Greene, W., Khalaf, L., Makdissi, P., Sickles, R., Veall, M., Voia, MC. (eds) Productivity and Inequality. NAPW 2016. Springer Proceedings in Business and Economics. Springer, Cham. https://doi.org/10.1007/978-3-319-68678-3_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-68678-3_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-68677-6
Online ISBN: 978-3-319-68678-3
eBook Packages: Business and ManagementBusiness and Management (R0)