Skip to main content

Advertisement

Log in

Measuring performance change in Scottish hospitals: a Malmquist and times-series approach

  • Published:
Health Services and Outcomes Research Methodology Aims and scope Submit manuscript

Abstract

We applied a Malmquist approach to assess levels and change of efficiency and technology in Scottish hospitals. The biased corrected Malmquist index, the efficiency change index, and the technology change index appear to vacillate improving and regressing over the four time intervals with the overall indices (2003–2007). We did not detect steady movement in these measures in one way or another, but we have advanced the literature by employing a time-series trend analysis to gauge changes without the obfuscation by white noise. By using regression, we found a definite and statistically significant trend of improvement, from the first period as it affects the final period of the performance measures. This lends some encouragement to Scottish hospital management that they are doing more with less—which is particularly relevant in times of more austerity in government spending but without a decrease in demand. A longer time period would be necessary in order to ascertain if improvements would be achieved, overall, even with increases and decreases in performance during intervening time periods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Notes

  1. A benefit of using these data to study Scottish hospitals, as compared to the usual data employed in studies of U. S. hospitals, is the availability of physicians in the former but due to contractual arrangements missing in the latter.

References

  • Antony, J., Kumar, M.: Lean and six sigma methodologies in NHS Scotland: an empirical study and directions for future research. Qual. Innov. Prosper. 16(2), 19–34 (2012)

  • Bevan, G.: Performance measurement of “knights” and “knaves”: differences in approaches and impacts in British countries after devolution. J. Comp. Policy Anal. Res. Pract. 12(1–2), 33–56 (2010). doi:10.1080/13876980903076187

    Article  Google Scholar 

  • Bevan, G.: Regulation and system management. In: Mays, N., Dixon, A., Jones, L. (eds.) Understanding New Labour’s Market Reforms of the English NHS. The King’s Fund, London (2011)

    Google Scholar 

  • Caves, D.W., Christensen, L.R., Diewert, W.E.: The economic theory of index numbers and the measurement of input, output, and productivity. Econometrica 50, 1393–1414 (1982)

    Article  Google Scholar 

  • Connolly, S., Bevan, G., Mays, N.: Funding and Performance of Healthcare Systems in the Four Countries of the UK Before and After Devolution. The Nuffield Trust, London (2010)

    Google Scholar 

  • Coelli, T., Rao, D., Battese, G.: An Introduction to Efficiency and Productivity Analysis. Kluewer Academic Publishers, Boston (1998)

    Book  Google Scholar 

  • Färe, R., Grosskopf, S., Lindgren, B., Roos, P.: Productivity changes in Swedish pharmacies 1980–1989: a nonparametric approach. J. Prod. Anal. 3, 85–101 (1992)

    Article  Google Scholar 

  • Färe, R., Grosskopf, S., Lovell, C.: Production Frontiers. Cambridge University Press, Cambridge (1994)

    Google Scholar 

  • Färe, R., Grosskopf, S., Lindgren, B., Roos, P.: Productivity developments in Swedish hospitals: a Malmquist output index approach. In: Data Envelopment Analysis: Theory, Methodology, and Applications, pp. 253–272. Springer, Dordrecht (1994)

  • Färe, R., Grosskopf, S., Roos, P.: Productivity and quality changes in Swedish pharmacies. Int. J. Prod. Econ. 39, 137–147 (1995)

    Article  Google Scholar 

  • Farrar, S., Yi, D., Sutton, M., Chalkley, M., Scott, A.: Has payment by results affected the way that English hospitals provide care? Difference-in-differences analysis. Br. Med. J. 339, 554–562 (2009)

    Article  Google Scholar 

  • Ferrari, A.: Market oriented reforms of health services: a non-parametric analysis. Serv. Ind. J. 26, 1–13 (2006)

    Article  Google Scholar 

  • Gerard, K., Roderick, P.: Comparison of apparent efficiency of haemodialysis satellite units in England and Wales using data envelopment analysis. Int. J. Technol. Assess. Health Care 19, 533–539 (2003)

    Article  PubMed  Google Scholar 

  • Grifell-Tatjéa, E., Lovell, C.A.K.: A note on the Malmquist productivity index. Econ. Lett. 47(2), 169–175 (1995)

    Article  Google Scholar 

  • Harker, R.: NHS Funding and Expenditure. House of Commons Library, Edinburgh (2012)

    Google Scholar 

  • Hollingsworth, B.: The measurement of efficiency and productivity of health care delivery. Health Econ. 17, 1107–1128 (2008)

    Article  PubMed  Google Scholar 

  • Hollingsworth, B., Parkin, D.: The efficiency of Scottish acute hospitals: an application of data envelopment analysis. IMA J. Math. Appl. Med. Biol. 12, 161–173 (1995)

    Article  CAS  PubMed  Google Scholar 

  • Hollingsworth, B., Parkin, D.: The efficiency of the delivery of neonatal care in the UK. J. Public Health 23, 47–50 (2001)

    Article  CAS  Google Scholar 

  • Hollingsworth, B., Parkin, D.: Efficiency and productivity change in the English National Health Service: can data envelopment analysis provide a robust and useful measure? J. Health Serv. Res. Policy 8, 230–236 (2003)

    Article  PubMed  Google Scholar 

  • Jacobs, R.: Alternative methods to examine hospital efficiency: data envelopment analysis and stochastic frontier analysis. Health Care Manag. Sci. 4, 103–115 (2001)

    Article  CAS  PubMed  Google Scholar 

  • Jacobs, R., Smith, P.C., Street, A.: Measuring Efficiency in Health Care: Analytic Techniques and Health Policy. Cambridge University Press, Cambridge (2006)

    Book  Google Scholar 

  • Maniadakis, N., Hollingsworth, B., Thanassoulis, E.: The impact of the internal market on hospital efficiency, productivity and service quality. Health Care Manag. Sci. 2, 75–85 (1999)

    Article  CAS  PubMed  Google Scholar 

  • Maniadakis, N., Thanassoulis, E.: Assessing productivity changes in UK hospitals reflecting technology and input prices. Appl. Econ. 32, 1575–1589 (2000)

    Article  Google Scholar 

  • NHS Group.: The NHS Outcomes Framework 2015/16. Department of Health, Edinburgh (2014)

  • Nishimizu, M., Page, J.: Total factor productivity growth, technological progress and technical efficiency change: dimensions of productivity change in Yugoslavia, 1965–78. Econ. J. 92, 920–936 (1982)

    Google Scholar 

  • Parkin, D., Hollingsworth, B.: Measuring production efficiency of acute hospitals in Scotland, 1991–94: validity issues in data envelopment analysis. Appl. Econ. 29, 1425–1433 (1997)

    Article  Google Scholar 

  • Public Expenditure Statistical Analysis (PESA).: HM Treasury/Office for National Statistics (2008)

  • Propper, C., Sutton, M., Whitnall, C., Windmeijer, F.: Incentives and targets in hospital care: evidence from a natural experiment. J. Public Econ. 94, 318–335 (2010)

    Article  Google Scholar 

  • Radnor, Z., Walley, P., Stephens, A., Bucci, G.: Evaluation of the Lean Approach to Business Management and Its Use in the Public Sector. Scottish Executive Social Research, Edinburgh (2006)

    Google Scholar 

  • Scottish Executive Health Department.: Rebuilding our National Health Service. Edinburgh (2001)

  • Scottish Executive.: Building a Better Scotland, Efficient Government—Securing Efficiency, Effectiveness and Productivity. Edinburgh (2004)

  • Semenick, A., Sickles, R.: Time series analysis of deregulation dynamics and technical efficiency: the case of the U.S. airline industry. Int. Econ. Rev. 41, 203–218 (2000)

    Article  Google Scholar 

  • Shepard, R.: Theory of Cost and Production Functions. Princeton University Press, Princeton (1970)

    Google Scholar 

  • Simar, L., Wilson, P.: Sensitive analysis of efficiency scores: how to bootstrap in nonparametric frontier models. Manag. Sci. 44, 49–61 (1998)

    Article  Google Scholar 

  • Simar, L., Wilson, P.: Estimating and bootstrapping Malmquist indices. Eur. J. Oper. Res. 115, 459–471 (1999)

    Article  Google Scholar 

  • Simar, L., Wilson, P.: Statistical inference in nonparametric frontier models: recent developments and perspectives. In: Fried, H., Lovell, C., Schmidt, S. (eds.) The Measurement of Productive Efficiency and Productivity Growth. Oxford University Press, Oxford (2008)

    Google Scholar 

  • Street, A.: How much confidence should we place in efficiency estimates? Health Econ. 12, 895–907 (2003)

    Article  PubMed  Google Scholar 

  • Thanassoulis, E., Portela, M., Despic, O.: Data envelopment analysis: the mathematical programming approach to efficiency analysis. In: Fried, H.O., Lovell, C.A.K., Schmidt, S.S. (eds.) The Measurement of Productive Efficiency and Productivity Growth. Oxford University Press, Oxford (2008)

    Google Scholar 

  • The Future of the NHS in Scotland (2008). http://www.gov.scot/News/Releases/ 2008/07/08141818

  • Wilson, P.: FEAR: a software package for frontier efficiency analysis with R. Socio Econ. Plan. Sci. 42(4), 247–254 (2008)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Michael Rosko.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Valdmanis, V., Rosko, M., Mancuso, P. et al. Measuring performance change in Scottish hospitals: a Malmquist and times-series approach. Health Serv Outcomes Res Method 17, 113–126 (2017). https://doi.org/10.1007/s10742-016-0151-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10742-016-0151-y

Keywords

Navigation