Abstract
This study presents an approach to harnessing the power of case studies for research evaluation calledR&D value mapping (RVM). While this method uses case studies in the traditional manner to provide in-depth insights, it also structures case studies through an analytical framework that yields quantitative data and less subjective “lessons learned”. When properly applied, RVM can yield an inventory of outcomes and empirical generalizations regarding the determining variables. A particular advantage of the approach is that it not only provides an indication of the type and amount (though not a single numerical index) of outcome, but also gives insight into the reasons outcomes are achieved. Thus, RVM is useful for policy management strategies seeking to replicate success. The specific steps associated with the RVM method are illustrated through studies that have applied the technique.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Averch, H. A. “Economic Approaches to the Evaluation of Research”.Evaluation Review 18(1), 1994, pp. 77–88.
Bard, J. F., R. Balachandra, and P. E. Kaufmann, “An Interactive Approach to R&D Project Selection and Termination”,IEEE Transactions on Engineering Management 35, 1988, pp. 139–146.
Bozeman, B., et al.,R&D Impacts at the New York State Energy Research and Development Authority: Final Report. Syracuse, NY: Center for Technology and Information Policy, Syracuse University, 1992.
Bozeman, B., and F. Donez. “Brookhaven National Laboratory, Superconducting Materials and Magnet Technology”. Case study prepared for Sandia National Laboratories, 1996.
Bozeman, B., and J. Melkers (eds.),Evaluating R&D Impacts: Methods and Practice. Norwell, MA: Kluwer Publishing, 1993.
Bozeman, B., and J. D. Roessner.Prototype Case Studies for R&D Value Mapping. Atlanta: Technology Policy and Assessment Program, Georgia Institute of Technology.
Monograph prepared for Sandia National Laboratories, 1995.
Bozeman, B., P. Shapira, and J. Youtie. “Designs for Evaluating Impacts of the Georgia Research Alliance”. Study prepared for the Office of Planning and Budget, State of Georgia, 1996.
Brown, M. A., L. G. Berry, and R. K. Goel. “Guidelines for Successfully Transferring Government-Sponsored Innovations”.Research Policy 20, 1991, pp. 121–143.
Bullock, R. J. and M. E. Tubbs. The Case Meta-Analysis Method for OD.Research in Organizational Change and Development 1, 1987, pp. 171–228.
Carter, C. F., and B. R. Williams.Industry and Technical Progress: Factors Governing the Speed of Application of Science to Industry. London: Oxford University Press, 1957.
Freeman, C. “Economics of Research and Development”. InScience, Technology and Society: A Cross-Disciplinary Perspective, ed. I. Spiegel-Rosing and D. De Solla Price. London: Sage Publications, 1977.
Illinois Institute of Technology Research Institute.Technology in Retrospect and Critical Events in Science. Washington, DC: National Science Foundation, 1968.
Jewkes, J., D. Sawers, and R. Stillerman.The Sources of Invention, 2nd edition. New York: W.W. Norton & Co., 1969.
Kerpelman, L. C., and S. J. Fitzsimmons.Methods for the Strategic Evaluations of Research Programs: The State of the Art. Washington, DC: National Science Foundation, 1985.
Kingsley, G. “The Use of Case Studies in R&D Impact Evaluations”. InEvaluating R&D Impacts: Methods and Practice, ed. B. Bozeman and J. Melkers. Norwell, MA: Kluwer Publishing, 1993, pp. 17–42.
Kingsley, G., and B. Bozeman. “Charting the Routes to Commercialization: The Absorption and Transfer of Energy Conservation Technologies”.International Journal of Global Energy Issues 9, 1997, pp. 8–15.
Kingsley, G., and M. C. Farmer. “Using Technology Absorption as an Evaluation Criterion: The Case of a State R&D Program”. School of Public Policy Working Paper 97-02. Georgia Institute of Technology, Atlanta, GA, 1997.
Kingsley, G., B. Bozeman, and K. Coker. “Technology Transfer and Absorption: An ‘R&D Value-Mapping’ Approach to Evaluation”.Research Policy 25, 1996, pp. 967–995.
Kreilkamp, K. “Hindsight and the Real World of Science Policy”.Science Studies 1, 1971, pp. 43–66.
Langrish, J., M. Gibbons, W. G. Evans, and F. R. Jevons.Wealth from Knowledge. London: MacMillan, 1972.
Larsson, R. “Case Survey Methodology: Quantitative Analysis of Patterns across Case Studies”.Academy of Management Journal 36(6), 1993, pp. 1515–1546.
Layton, E. “Conditions of Technological Development”. InScience, Technology and Society: A Cross-Disciplinary Perspective, ed. I. Spiegel-Rosing and D. De Solla Price. London: Sage Publications, 1977.
Logsdon, J. M., and C. B. Rubin.An Overview Of Federal Research Evaluation Activities. Washington, DC: National Science Foundation, 1985.
Luukhonen-Gronow, T. “Scientific Research Evaluation: A Review of Methods and Various Contexts for Their Application”.R&D Management 17, 1987, pp. 207–221.
Meyer-Krahmer, F. “Evaluation of Industrial Innovation Policy: Concepts, Methods and Lessons”. InGovernment Innovation Policy: Design, Implementation, Evaluation, ed. J. D. Roessner. New York: St. Martin's Press, 1988.
Mowery, D. C., and N. Rosenberg. “The Influence of Market Demand upon Innovation: A Critical Review of Some Recent Empirical Studies”. InInside the Black Box: Technology and Economics, ed. N. Rosenberg. New York: Cambridge University Press, 1982.
Nelson, R. R. “Government Stimulus of Technological Progress: Lessons from American History”. InGovernment and Technical Progress: A Cross-Industry Analysis, ed. R. R. Nelson. New York: Pergamon Press, 1982.
Rao, I. K. “Strategies for Best Practice in Research and Technology Institutes—An Overview of a Benchmarking Exercise”.Scientometrics 35(2), February 1996, pp. 265–270.
Roessner, J. D. “Whisker-Reinforced Ceramics at Oak Ridge National Laboratory”, Case study prepared for Sandia National Laboratories, 1996.
Roessner, J. D., “Government Innovation Policy: Design, Implementation, Evaluation. New York: St. Martin's Press, 1988.
Roessner, J. D., B. Bozeman, F. Donez, and T. Schofield. “Understanding Thin Film Deposition at the Stanford Syncrotron Radiation Laboratory”. Case study prepared for Sandia National Laboratories, 1996.
Roessner, J. D., and T. Schofield. “Understanding Thin Film Deposition at the Stanford Syncrotron Radiation Laboratory”. Case study prepared for Sandia National Laboratories, 1996.
Ronayne, J.Science in Government. London: Edward Arnold (Publishers) Ltd, 1984.
Rush, H., M. Hobday, J. Bessant, and E. Arnold. “Strategies for Best Practice in Research and Technology Institutes—An Overview of a Benchmarking Exercise”.R&D Management 25(1), 1995, pp. 17–31.
Science Policy Research Unit (SPRU).Success and Failure in Industrial Innovation. London: Center for the Study of Industrial Innovation, 1972.
Sherwin, C. W., and R. S. Isenson. “Project Hindsight: Defense Department Study of the Utility of Research”.Science 156, 1967, pp. 1571–1577.
Utterback, J. M., M. Meyer, E. Roberts,and G. Reitberger. “Technology and Industrial Innovation in Sweden: A Study of Technology-Based Firms Formed Between 1965 and 1980”.Research Policy 17, 1988, 15–26.
Wolf, P. J., “A Case Survey of Bureaucratic Effectiveness in U.S. Cabinet Agencies: Preliminary Results”.Journal of Public Administration Research and Theory 3(2), 1993, pp. 161–181.
Yin, R. K.Case Study Research: Design and Methods, 2nd Edition. Newbury Park, CA: Sage Publications, 1994.
Author information
Authors and Affiliations
Additional information
The authors gratefully acknowledge support from of the Department of Energy, Basic Energy Sciences and previous contracts from Sandia National Laboratories and the New York State Energy Research & Development Authority. A number of persons have made useful comments on the RVM method. We are particularly grateful to David Roessner, Juan Rogers, Gretchen Jordan and Iran Thomas.
Rights and permissions
About this article
Cite this article
Bozeman, B., Kingsley, G. R&D value mapping: A new approach to case study-based evaluation. J Technol Transfer 22, 33–41 (1997). https://doi.org/10.1007/BF02509643
Issue Date:
DOI: https://doi.org/10.1007/BF02509643