Skip to main content
SpringerLink
Log in

Apples and oranges: The aggregation problem in publications analysis

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

A major difficulty with bibliometric measures of departmental research contributions based upon publications counts has concerned the summing of publications of different types. An attempt is made in this paper to bypass this aggregation problem by appeal to the methods of Data Envelopment Analysis (DEA). In this way we investigate the technical efficiency of UK university departments of economics as producers of research. The data set used is an extended version of the one which informed the recent Universities Funding Council peer review, and the results obtained here are compared with those obtained by the Council. We conclude that, although due caution is needed in the interpretation of results, DEA has a positive contribution to make in the development of meaningful indicators of university performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. B.R. Martin, J. Irvine, Assessing basic research,Research Policy, 12 (1983) 61–90.

    Google Scholar 

  2. G. Johnes, Research performance indicators in the university sector,Higher Education Quarterly, 42 (1988) 54–71.

    Google Scholar 

  3. G. Johnes, Ranking university departments: problems and opportunities,Politics, 9 (2) (1989) 16–22.

    Google Scholar 

  4. B. Meltzer, The productivity of social scientists,American Journal of Sociology, 55 (1949) 25–29.

    Google Scholar 

  5. D. Crane, Scientists at major and minor universities: a study of productivity and recognition,American Sociological Review, 30 (1965) 699–714.

    Google Scholar 

  6. A. Schubert, T. Braun, Some scientometric measures of publishing performance for 85 Hungarian research institutes,Scientometrics, 3 (1981) 379–388.

    Google Scholar 

  7. G. Johnes, Measures of research output: university departments of economics in the UK, 1984–88,Economic Journal, 100 (1990) 556–560.

    Google Scholar 

  8. G.B. Dantzig, Maximization of a linear function of variables subject to linear inequalities, in:T.C. Koopmans, (Ed.)Activity Analysis of Production and Allocation, Wiley, New York, 1951.

    Google Scholar 

  9. M.J. Farrell, The measurement of productive efficiency,Journal of the Royal Statistical Society, Series A, 120 (1957) 253–290.

    Google Scholar 

  10. A. Charnes, W.W. Cooper, E. Rhodes, Measuring the efficiency of decision making units,European Journal of Operational Research, 2 (1978) 429–444.

    Google Scholar 

  11. T.R. Sexton, The methodology of data envelopment analysis, in:R.H. Silkman, (Ed.)Measuring Efficiency: An Assessment of Data Envelopment Analysis, Jossey-Bass, San Francisco, 1986.

    Google Scholar 

  12. A. Boussofiane, R.E. Dyson, E. Thanassoulis, Applied Data Envelopment Analysis,European Journal of Operational Research, 52 (1991) 1–15.

    Google Scholar 

  13. C. Tomkins, R.H. Green, An experiment in the use of data envelopment analysis for evaluating the efficiency of UK university departments of accounting,Financial Accountability and Management, 4 (1988) 147–164.

    Google Scholar 

  14. J.E. Beasley, Comparing university departments,Omega, 18 (1990) 171–183.

    Google Scholar 

  15. G. Johnes, J. Johnes, Measuring the research performance of UK economics departments: an application of Data Envelopment Analysis,Oxford Economic Papers, forthcoming.

  16. E. Thanassoulis, R.G. Dyson, M.G. Foster, Relative efficiency assessments using Data Envelopment Analysis: an application to data on rates departments,Journal of the Operational Research Society, 38 (1987) 397–491.

    Google Scholar 

  17. H.D. Sherman, Managing productivity of health care organizations, in:R.H. Silkman, (Ed.),Measuring Efficiency: An Assessment of Data Envelopment Analysis, Jossey-Bass, San Francisco, 1986.

    Google Scholar 

  18. A. Charnes, T. Clark, W.W. Cooper, B. Golany, A developmental study of Data Envelopment Analysis in measuring the efficiency of maintenance units is the US air force,Annals of Operational Research, 2 (1985) 95–112.

    Google Scholar 

  19. J. Flemming, The use of assessments of British university teaching, and especially research, for the allocation of resources: a personal view,European Economic Review, 35 (1991) 612–618.

    Google Scholar 

  20. A.M. Diamond, The core journals of economics,Current Contents, 21 (1) (1989) 4–11.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Economics, The Management School, Lancaster University, LA1 4YX, Lancaster, UK

    Geraint Johnes & Jill Johnes

Authors
  1. Geraint Johnes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jill Johnes
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Johnes, G., Johnes, J. Apples and oranges: The aggregation problem in publications analysis. Scientometrics 25, 353–365 (1992). https://doi.org/10.1007/BF02028091

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02028091

Keywords

Search

Navigation