Abstract
PREST's experience of evaluation is not as an isolated activity, but as one that has grown out of, and is still embedded in, a broader programme of work on science policy and management. This reflects a conviction that evaluation should be embedded in a wider management system including verifiable objectives and sound feedback mechanisms. The key to successful evaluation is meticulous planning and evaluation design. PREST's evaluation work has been based mostly on surveys of opinion supplemented by statistical data. In any evaluation the different actors may all agree overtly on their objectives, but covertly have different and incompatible aims. In this situation PREST apply transparent principles of procedure. Evaluation has had a significant effect on the science and technology management culture. In a few cases it is possible to distinguish a direct link between evaluation findings and subsequent decisions. Usually, however, it is difficult to do so with precision, because evaluation is but one of several influences on policy development. The demand for evaluation will probably intensify, perhaps including simpler, more automatic approaches. There may also be an increased interest in more refined qualitative approaches.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
M. Gibbons, L. Georghiou, “Evaluation of Research—a selection of current practices” OECD, Paris, 1987: this publication provides an early example of PREST's methodological work.
K. Guy, L. Georghiou, et al.,Evaluation of the Alvey Programme for Advanced Information Technology, HMSO, London, 1991.
P. N. Cunningham et al., “Analysis of Experience in the use of Verifiable Objectives”, Commission of the European Communities, EUR15634, Luxembourg, 1994.
K. Barker, I. Miles, P. Street, “Assessment of Research on Environmental Design and Performance of Buildings” Report to the UK Department of the Environment, 1994.
L. Georghiou, H. Cameron, J. A. Stein, M. Nedeva et al., “The Impact of European Community Policies for Research and Development upon Science and Technology in the United Kingdom—a report prepared for the Commission of the European Communities and the Office of Science and Technology,” HMSO, 1993.
E. Ormala et al., “Evaluation of EUREKA Industrial and Economic Effects,” EUREKA Secretariat 1993.
A. J. Dale, K. E. Barker, The Evaluation of EUREKA: a pan-European collaborative evaluation of a Pan-European collaborative technology programme, submitted toResearch Evaluation.
N. Reeve et al., “LINK Power Electronic Devices and Derived Systems Programme—final evaluation study” Report to the UK Department of Trade and Industry, 1994.
Malmborg et al., “Evaluation of the Biomolecular Engineering Programme—BEP (1982–1986) and the Biotechnology Action Programme—BAP (1985–1989)” Commission of the European Communities, Luxembourg, 1988.
J. Dooge et al., “Evaluation of the Research and Development Programmes in the Field of the Environment (1981–1985 and 1986–1990),” Commission of the European Communities EUR 11953, Luxembourg, 1990.
P. N. Cunningham, “Bibliometric Study of NPL Publications” In:A. Challoner, E. Davis, P. Hills, “National Physical Laboratory Division of Radiation Science and Acoustics—Evaluation Report”, DTI, London, 1990.
P. N. Cunningham, “Bibliometric Study of NPL Publications” In:E. Davis, K. Gullick, P. Hills, “National Physical Laboratory Division of Mechanical and Optical Metrology—Evaluation Report,” DTI, London, 1990.
P. N. Cunningham, “Bibliometric Study of NPL Publications” in:A. Challoner, K. Cunion, P. Hills, “National Physical Laboratory Basic Metrology Programme—Evaluation Report,” DTI, London, 1992.
P. N. Cunningham, A. Dale, “Evaluation of the ESRC Management Teaching Fellowship Scheme,” Report to the Economic and Social Research Council, 1992.
For a fuller account of some impacts of evaluation see.K. Barker,Science and Public Policy, 21 (1994) 405.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hills, P. Prest's experience of evaluation. Scientometrics 34, 401–414 (1995). https://doi.org/10.1007/BF02018008
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF02018008