Skip to main content

Advertisement

Log in

Identifying the Best Buys in U.S. Higher Education

  • Published:
Research in Higher Education Aims and scope Submit manuscript

Abstract

Which U.S. institutions of higher education offer the best value to consumers? To answer this question, we evaluate U.S. institutions relative to a data envelopment analysis (DEA) multi-factor frontier based on 2000–2001 data for 1,179 4-year institutions. The resulting DEA “best buy” scores allow the ranking of institutions by a weighted sum of institutional characteristics per dollar of average net price. The net price is calculated as tuition, fees, room, and board less per student financial aid. Institutional characteristics include SAT score, athletic expenditures, instructional expenditures, value of buildings, dorm capacity, and student body characteristics. The DEA scores indicate the distance of each institution from the “best buy” frontier for the chosen characteristics, providing an objective means of ranking institutions as the best values in higher education.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. DEA was first introduced in a Ph.D. dissertation evaluating educational programs for disadvantaged students. See Charnes et al. (1994) and Coelli et al. (1998).

  2. Even by 2005 the financial data section of the survey was only available for the 2001 academic year.

  3. The analysis modifies Rosen’s (1974) approach for the special characteristics of higher education institutions identified by Tiffany and Ankrom (1998), Clotfelter (1999), Winston (2003, 2004), Epple et al. (2003), and Martin (2004).

  4. IPEDS was created in 1986 and is accessible through the NCES Web site (http://nces.ed.gov/) for the years 1996 to the present. Earlier years are archived at the University of Michigan (http://webapp.icpsr.umich.edu/cocoon/IAED-SERIES/00102.xml). The predecessor to IPEDS was Higher Education General Information Survey or HEGIS which dates to 1967 with limited data back to 1965. These data are also archived at the International Archive of Education Data at the University of Michigan (http://webapp.icpsr.umich.edu/cocoon/IAED-SERIES/00030.xml). Some, though not all, of these data can be downloaded from the Michigan Web site.

  5. Using dollar denominated items per FTE will cause smaller institutions with less impressive totals to appear more comparable to large institutions with large totals. Using total dollars would bias the results in favor of large institutions, regardless of the quality of the attribute offered. In the absence of an ideal quality measure—an indicator of absolute quality independent of expenditures—expenditures per FTE was chosen to eliminate the pure size effect. Note that FTE includes graduate students. As a practical matter it would be virtually impossible to parse the portion of most of the measures used between graduate and undergraduate students.

  6. The Carnegie classification is an ordinal measure of research intensity. This is perhaps not ideal, but is preferable to multiple zero–one categorical values which miss the ordinal aspect altogether. DEA will allow tradeoffs between higher Carnegie classifications and lower values of other outputs (and vice versa) using the ordinal values. Use of separate dummy variables for each category will not allow these tradeoffs and results in institutions in each Carnegie category being ranked only against others in the same category.

  7. Our dataset is for the 2000–2001 academic year and was originally collected for a different research project. Even by 2005 the financial data section of the survey was only available for the 2001 academic year. Given that a primary motivation for this research was to explore the application of the DEA methodology the fact that the data might seem dated is of lesser consequence for present purposes.

  8. Federal financial aid was deliberately excluded, for two reasons. First, federal aid is distributed on the basis of uniform criteria to all participating institutions. Second, when we did attempt to include it, in more than a few instances the net price was negative.

  9. One might ask why private institutions in general are not identified explicitly. First, we reason that consumers have no basis to prefer a private to a public institution, other than for the differences in the observed characteristics that are offered. Otherwise, one must believe that there is a common unobserved characteristic set possessed by all private institutions and not offered by any public institution. Second, the methodology identifies the output of an institution per dollar of student expenditure. We argue that this fact accounts for a major difference between public and private institutions, i.e., the net price to the student consumer. Finally, the religious affiliation measure does identify a set of unobserved variables that consumers may value.

  10. The implicit assumption is, of course, that there were no substantive changes in relative entrance scores between the fall of 2000 and fall 2003.

  11. DEA may be susceptible to measurement error, but the use of data averaged over several time periods has been shown to smooth out this measurement error (Ruggiero 2006, 2007). Unfortunately, data limitations prevent the implementation of this technique here.

  12. Only 1,065 of the 1,179 schools had at least 10 schools within a 150 mile radius; only these schools were used for these calculations.

  13. There were nine estimations dropping one output; 36 estimations dropping two outputs; 84 estimations dropping three outputs; and 126 estimations dropping four outputs.

  14. A complete listing of institutions, best buy scores and attribute weights is available from the authors on request.

References

  • Abbott, M., & Doucouliagos, C. (2003). The efficiency of Australian Universities: A data envelopment analysis. Economics of Education Review, 22, 89–97.

    Article  Google Scholar 

  • Archibald, R. B., & Feldman, D. H. (2008). Graduation rates and accountability: Regressions versus production frontiers. Research in Higher Education, 49(1), 80–100.

    Article  Google Scholar 

  • Athanassopoulos, A., & Shalle E. (1997). An investigation on the cost and value added efficiencies of higher education institutions in the UK using data envelopment analysis. Education Economics Journal, 5(2).

  • Avery, C., Glickman M., Hoxby C., & Metrick A. (2004). A revealed preference ranking of U.S. Colleges and Universities. NBER Working Paper No. 10803 http://smai.emath.fr/IMG/pdf_RI296_Shanghai.pdf.

  • Behrman, J., Kletzer, L., McPherson, M., & Shapiro, M. O. (1998). Microeconomics of college choice, careers, and wages. Annals of the American Academy of Political and Social Science, 559, 12–23.

    Article  Google Scholar 

  • Berkelaar, M., et al. (2010). lpSolve: Interface to Lp solve v.5.5 to solve linear/integer programs. R package version 5.6.5. http://CRAN.R-project.org/package=lpSolve.

  • Billaut, J.-C., Bouyssou, D., Vincke, P. (2009). Should you believe in the shanghai ranking? An MCDM view. http://smai.emath.fr/IMG/pdf_RI296_Shanghai.pdf. Retrieved Nov 12, 2009.

  • Bivand, R., et al. (2011). spdep: Spatial dependence: Weighting schemes, statistics and models. R package version 0.5-31. http://CRAN.R-project.org/package=spdep.

  • Black, D. A., & Smith, J. A. (2004). How robust is the evidence on the effects of college quality? Evidence from matching. Journal of Econometrics, 121(1), 99–124.

    Article  Google Scholar 

  • Bougnol, M.-L., & Dulá, J. H. (2006). Validating DEA as a ranking tool: An application of DEA to assess performance in higher education. Annals of Operations Research, 145, 339–365.

    Article  Google Scholar 

  • Brooks, R. L. (2005). Measuring university quality. The Review of Higher Education, 29(1), 1–21.

    Article  Google Scholar 

  • Brown, W. O. (2001). Sources of funds and quality effects in higher education. Economics of Education Review, 20(3), 289–295.

    Article  Google Scholar 

  • Burness, J. F. (2008). The rankings game: Who’s playing whom? The Chronicle of Higher Education, 55(2), A80.

    Google Scholar 

  • Buss, C., Parker, J., & Rivenburg, J. (2004). Cost, quality and enrollment demand at liberal arts colleges. Economics of Education Review, 23(1), 57–65.

    Article  Google Scholar 

  • Charnes, A., et al. (1994). Data envelopment analysis: Theory, methodology, and application. Norwell: Kluwer Academic Publishers.

    Google Scholar 

  • Cleveland, W. S. (1979). Robust locally weighted regression and smoothing scatterplots. Journal of American Statistical Association, 74, 829–836.

    Article  Google Scholar 

  • Clotfelter, C. T. (1999). The familiar but curious economics of higher education: Introduction to a symposium. Journal of Economics Perspectives, 13(1), 13–36.

    Article  Google Scholar 

  • Coelli, T., Prasada Rao, D. S., & Battese, G. E. (1998). An introduction to efficiency and productivity analysis. Boston: Kluwer Academic Publishers.

    Book  Google Scholar 

  • Cooper, W. W., Seiford, L. M., & Tone, K. (2007). Data envelopment analysis: A comprehensive text with models, applications, references and DEA-solver software (2nd ed., p. xxxviii). New York: Springer. (490).

    Google Scholar 

  • DesJardins, S. L., Dundar, H., & Darwin, D. H. (1999). Modeling the college application decision process in a land-grant university. Economics of Education Review, 18(1), 117–132.

    Article  Google Scholar 

  • Dill, D., & Soo, M. (2005). Academic quality, league tables, and public policy: A cross-national analysis of university ranking systems. Higher Education, 49(4), 495–533.

    Article  Google Scholar 

  • Eckles, J. E. (2010). Evaluating the efficiency of top liberal arts colleges. Research in Higher Education, 51(3), 266–293.

    Article  Google Scholar 

  • Eff, E. A., & Klein, C. C. (2010). What can we learn from education production studies? Eastern Economic Journal, 36(4), 450–479.

    Article  Google Scholar 

  • Ehrenberg, R. G. (2003). Method or Madness? Inside the USNWR College Rankings. Working paper, ILR collection, Cornell University. Available from http://digitalcommons.ilr.cornell.edu/cgi/viewcontent.cgi?article=1043&context=workingpapers.

  • Emrouznejad, A. (2008). Data envelopment analysis homepage. www.DEAzone.com. Last viewed July 8 2009.

  • Epple, D., Romano, R., & Sieg, H. (2003). Peer effects, financial aid, and selection of students into colleges and universities: An empirical analysis. Journal of Applied Econometrics, 18(5), 501–525.

    Article  Google Scholar 

  • Field, K. (2008). A bill that took longer than a Bachelor’s Degree. The Chronicle of Higher Education, 54(48), 1.

    Google Scholar 

  • Flegg, T., & Allen, D. (2007). Does expansion cause congestion? The case of the older british universities, 1994 to 2004. Education Economics, 15(1), 75–102.

    Article  Google Scholar 

  • Getis, A., & Ord, J. K. (1992). The analysis of spatial association by use of distance statistics. Geographical Analysis, 24, 189–206.

    Article  Google Scholar 

  • Gimenez, V. M., & Martinez, J. L. (2006). Cost efficiency in the university: A departmental evaluation model. Economics of Education Review, 25(5), 543–553.

    Article  Google Scholar 

  • Glenn, D. (2007). Economists concoct new method for comparing graduation rates. The Chronicle of Higher Education, 54(5), 1.

    Google Scholar 

  • Henningsen, A. (2010). linprog: Linear programming/optimization. R package version 0.9-0. http://CRAN.R-project.org/package=linprog.

  • Hoxby, C. M. (Ed.). (2004). College choices: The economics of where to go, when to go, and how to pay for it. Chicago, Illinois: National Bureau of Economic Research.

    Google Scholar 

  • Johnes, J. (2006). Data envelopment analysis and its application to the measurement of efficiency in higher education. Economics of Education Review, 25(3), 273–288.

    Article  Google Scholar 

  • Johnes, G., & Johnes, J. (1993). Measuring the research performance of UK economics departments—an application of data envelopment analysis. Oxford Economic Papers-New Series, 45(2), 332–347.

    Google Scholar 

  • Johnes, G., & Johnes, J. (1995). Research funding and performance in UK university departments of economics—a frontier analysis. Economics of Education Review, 14(3), 301–314.

    Article  Google Scholar 

  • Kumbhakar, S. C., & Knox Lovell, C. A. (2000). Stochastic frontier analysis. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Lewis, H. F., Sexton, T. R., & Lock, K. A. (2007). Player salaries, organizational efficiency, and competitiveness in major league baseball. Journal of Sports Economics, 8(3), 266–294.

    Article  Google Scholar 

  • Liu, N. C., & Cheng, Y. (2005). The academic ranking of world universities. Higher Education in Europe, 30(2), 127–136.

    Article  Google Scholar 

  • Marshall, E., & Shortle, J. (2005). Using DEA and VEA to evaluate quality of life in the Mid-Atlantic States. Agricultural and Resource Economics Review, 34(2), 185–203.

    Google Scholar 

  • Martin, R. E. (2004). Tuition discounting without tears. Economics of Education Review, 23(2), 177–189.

    Article  Google Scholar 

  • Mayer-Foulkes, D. (2002). On the dynamics of quality student enrollment at institutions of higher education. Economics of Education Review, 21(5), 481–489.

    Article  Google Scholar 

  • McCormick, R. E., & Tinsley, M. (1987). Athletics versus academics? Evidence from SAT scores. Journal of Political Economy, 95(5), 1103–1116.

    Article  Google Scholar 

  • McMillen, D. P., Singell, L. D., Jr, & Waddell, G. R. (2007). Spatial competition and the price of college. Economic Inquiry, 45(4), 817–833.

    Article  Google Scholar 

  • Pike, G. R. (2004). Measuring quality: A comparison of U.S. news rankings and NSSE benchmarks. Research in Higher Education, 45(2), 193–208.

    Article  Google Scholar 

  • Rosen, S. (1974). Hedonic prices and implicit markets: Product differentiation in pure competition. Journal of Political Economy, 82(1), 34–55.

    Article  Google Scholar 

  • Ruggiero, J. (2006). Measurement error, education production and data envelopment analysis. Economics of Education Review, 25(3), 327–333.

    Article  Google Scholar 

  • Ruggiero, J. (2007). A comparison of DEA and the stochastic frontier model using panel data. International Transactions in Operations Research, 14(3), 259–266.

    Article  Google Scholar 

  • Sarrico, C. S., Hogan, S. M., Dyson, R. G., & Athanassopoulos, A. D. (1997). Data envelopment analysis and university selection. The Journal of the Operational Research Society., 48(12), 1163–1177.

    Google Scholar 

  • Strayer, W. (2002). The returns to school quality: College choice and earnings. Journal of Labor Economics, 20(3), 475–503.

    Article  Google Scholar 

  • Tauer, L. W., Fried, H. O., & Fry, W. E. (2007). Measuring efficiencies of academic departments within a college. Education Economics, 15(4), 473–489.

    Article  Google Scholar 

  • Tiffany, F. G., & Ankrom, J. A. (1998). The competitive use of price discrimination by colleges. Eastern Economic Journal, 24(1), 99–110.

    Google Scholar 

  • Turner, D. (2008). World university rankings. International Perspectives on Education and Society, 9, 27–61.

    Article  Google Scholar 

  • van Biesebroeck, J. (2007). Robustness of productivity estimates. Journal of Industrial Economics, 55(3), 529–569.

    Article  Google Scholar 

  • van Raan, A. F. J. (2005). Fatal attraction: Ranking of universities by bibliometric methods. Scientometrics, 62, 133–145.

    Article  Google Scholar 

  • Winston, G. C. (2003). Toward a theory of tuition: Prices, peer wages, and competition in higher education. The Williams Project on the Economics of Higher Education, Discussion Paper 65.

  • Winston, G. C. (2004). Differentiation among US colleges and universities. Review of Industrial Organization, 24(4), 331–354.

    Article  Google Scholar 

  • William, Y., Tooraj, J., Michael, P. (2007). “Incorporating the price of quality in efficiency analysis: the case of electricity distribution regulation in the UK.” Cambridge working papers in economics, Faculty of Economics, University of Cambridge, 24 pp.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Christopher C. Klein.

Appendix

Appendix

See Table 7.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Eff, E.A., Klein, C.C. & Kyle, R. Identifying the Best Buys in U.S. Higher Education. Res High Educ 53, 860–887 (2012). https://doi.org/10.1007/s11162-012-9259-2

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11162-012-9259-2

Keywords

Navigation