Skip to main content
Log in

Do not cry wolf until you are sure: The manufactured crises in evaluation research

  • Published:
Policy Sciences Aims and scope Submit manuscript

Abstract

This article argues that the so-called crisis in evaluation is phenomenological rather than empirical. That is, our statements about evaluation, the presentational strategies used to define our expertise, and the ceremonies surrounding the dissemination of results are more problematic than what it is we actually do. If we can avoid calling attention to imaginary wolves, people might well listen when we do have something to say.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Binder, Arnold and Gilbert Geis (1983). Methods of Research in Criminology and Criminal Justice. New York: McGraw-Hill.

    Google Scholar 

  • Campbell, D. T. and J. C. Stanley (1966). Experimental and Quasi-Experimental Designs for Research. Skokie, IL: Rand McNally.

    Google Scholar 

  • Caplan, Nathan (1979). “The two-communities theory and knowledge utilization,” American Behavioral Scientist 22: 459–470.

    Google Scholar 

  • Carton, Bayard L. and Michael Harmon (1981). “Action theory in practice: toward theory without conspiracy,” Public Administration Review 41: 535–541.

    Google Scholar 

  • Chelimsky, Eleanor (1982). “Making evaluations relevant to congressional needs,” GAO Review 17: 22–27.

    Google Scholar 

  • Cook, T. D. and D. T. Campbell (1979). Quasi-Experimentation: Design and Analysis Issues for Field Settings. Skokie, IL: Rand McNally.

    Google Scholar 

  • Chen, Huey-Tsyh and Peter H. Rossi (1981). “The multi-goal, theory driven approach to evaluation: a model linking basic and applied social science,” in H. E. Freeman and M. A. Solomon (eds.), Evaluation Studies Review Annual, vol. 6. Beverly Hills: Sage.

    Google Scholar 

  • Cronbach, Lee J. and Associates (1980). Toward Reform of Program Evaluation. San Francisco: Jossey-Bass.

    Google Scholar 

  • Deal, Terrence E. and Allan A. Kennedy (1982). Corporate Cultures: The Rites and Rituals of Corporate Life. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Edelman, Murray (1977). Political Language: Words That Succeed and Policies That Fail. New York: Academic Press.

    Google Scholar 

  • Fishman, R. (1977). “An evaluation of criminal recidivism in projects providing rehabilitation and diversion services in New York City,” Journal of Criminal Law and Criminology 68: 283–305.

    Google Scholar 

  • Freeman, Howard E. and Marian A. Solomon (1981). “Introduction: evaluation and the uncertain '80's,” in H. E. Freeman and M. A. Solomon (eds.), Evaluation Studies Review Annual, vol. 6. Beverly Hills: Sage.

    Google Scholar 

  • Gieryn, Thomas F. (1983). “Boundary-work and the demarcation of science from non-science,” American Sociological Review 48: 781–795.

    Google Scholar 

  • Gilsinan, James F. (1973). “Ethnomethodology and symbolic interaction: a comparison,” The Rocky Mountain Social Science Journal 10: 73–83.

    Google Scholar 

  • Gilsinan, James F. (1984). “Information and knowledge development potential: the public vs. private sector jobs demonstration project,” Evaluation Review 8: 371–388.

    Google Scholar 

  • Glaser, Daniel (1980). “The interplay of theory, issues, policy, and data,” in Klein and Teilmann (eds.), Handbook of Criminal Justice Evaluation. Beverly Hills: Sage.

    Google Scholar 

  • Guba, Egon (1978). Toward A Methodology of Naturalistic Inquiry In Educational Evaluation. Los Angeles: Center for the Study of Evaluation, U. of Calif.

    Google Scholar 

  • Hackler, J. C. (1978). The Prevention of Crime: The Great Stumble Forward. Toronto: Methuen.

    Google Scholar 

  • House, E. R. (1982). “Introduction: scientific and humanistic evaluations,” in E. R. House (ed.), Evaluation Studies Review Annual. Beverly Hills: Sage.

    Google Scholar 

  • Lerman, P. (1975). Community Treatment and Social Control. Chicago: Univ. of Chicago Press.

    Google Scholar 

  • Levi-Strauss, Claude (1963). Structural Anthropology. New York: Basic Books.

    Google Scholar 

  • Lindblom, Charles E. and David Cohen (1979). Useable Knowledge. New Haven: Yale University Press.

    Google Scholar 

  • Lipton, D., R. Martinson and J. Wilks (1975). The Effectiveness of Correctional Treatment. New York: Prager.

    Google Scholar 

  • Meltsner A. J.and C. Bellavita (1983). The Policy Organization. Beverly Hills: Sage.

    Google Scholar 

  • Merton, Robert (1973). The Sociology of Science. Chicago: Univ. of Chicago Press.

    Google Scholar 

  • Nakamura, R. T. and F. Smallwood (1980). The Politics of Policy Implementation. New York: Basic Books.

    Google Scholar 

  • Palumbo, Dennis J. and David Nachmias (1983). “The preconditions for successful evaluation: is there an ideal paradigm?” Policy Sciences 16: 67–79.

    Google Scholar 

  • Prather, James E. and Frank K. Gibson (1977). “The failure of social programs,” Public Administration Review 37: 556–563.

    Google Scholar 

  • Reichardt, Charles S. and Thomas D. Cook (1979). “Beyond qualitative vs. quantitative methods,” in T. D. Cook and C. S. Reichardt (eds.), Qualitative and Quantitative Methods in Evaluation Research. Beverly Hills: Sage.

    Google Scholar 

  • Sarbin, Theodore R. (1972). “Schizophrenia is a myth, born of a metaphor, meaningless,” Psychology Today 6: 18–27.

    Google Scholar 

  • Schuman, H. (1982). “Artifacts are in the mind of the beholder,” American Sociologist 17: 21–8.

    Google Scholar 

  • Scriven, M. (1972). “Pros and cons about goal-free evaluation,” Evaluation Comment 3: 1–4.

    Google Scholar 

  • Trend, M. G. (1979). “On the reconciliation of qualitative and quantitative analyses: a case study,” in T. D. Cook and C. S. Reichardt (eds.), Qualitative and Quantitative Methods in Evaluation Research. Beverly Hills: Sage.

    Google Scholar 

  • Weick, Karl (1969). The Social Psychology of Organizing. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Weiss, Robert and Martin Rein (1969). “The evaluation of broad-aim programs: a cautionary case and a moral,” Annals of the American Academy of Political and Social Science 385: 133–142.

    Google Scholar 

  • Wilson, Thomas P.(1970). “Normative and interpretive paradigms in sociology,” in Jack D. Douglas (ed.), Understanding Everyday Life. Chicago: Aldine.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Gilsinan, J.F., Volpe, L.C. Do not cry wolf until you are sure: The manufactured crises in evaluation research. Policy Sci 17, 179–191 (1984). https://doi.org/10.1007/BF00146927

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00146927

Keywords

Navigation