Skip to main content
SpringerLink
Log in

The Relative Effectiveness of Diagnostic and Positive Test Strategies is Logically Indeterminable

  • Published:
The Psychological Record Aims and scope Submit manuscript

Abstract

Research Into the cognitive processes underlying inductive inference has not only yielded valuable data on the ways in which people go about testing hypotheses; it has also raised important questions as to what constitutes a normative test. One widely accepted assumption regarding test normativeness is the idea that diagnostic test strategy (the method of conducting crucial tests to distinguish between competing hypotheses) is generally superior to positive test strategy (the method of testing for the occurrence of events predicted by a single hypothesis). This seemingly obvious assumption, however, fails to stand up to close inspection. The relative effectiveness of positive and diagnostic test strategies varies with a factor that is, even in principle, unknowable. Specifically, test effectiveness depends upon the logical relationship between the sets of events predicted by the hypotheses under investigation and the set of events that logically follows from the truth; and the tester never knows what this relationship is. Considerations of a test’s potential to falsify, including Bayesian considerations of the probability of predicted events given that a particular hypothesis is not true, are essential to optimal hypothesis testing. However, the construction and consideration of specified alternatives prior to testing is not essential.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • BARON, J., BEATTIE, J., & HERSHEY, J. C. (1988). Heuristics and biases in diagnostic reasoning II. Congruence, information, and certainty. Organizational Behavior and Human Decision Processes, 42, 88–110.

    Article  Google Scholar 

  • BASSOK, M., & TROPE, Y. (1984). People’s strategies for testing hypotheses about another’s personality: Confirmatory or diagnostic? Social Cognition, 2, 199–216.

    Article  Google Scholar 

  • BRUNER, J. (1957). On perceptual readiness. Psychological Review, 64, 123–152.

    Article  PubMed  Google Scholar 

  • CECI, S. J., & BRONFENBRENNER, U. (1991). On the demise of everyday memory. American Psychologist, 46, 27–31.

    Article  Google Scholar 

  • CHAMBERLIN, T. (1897). The method of multiple working hypotheses. Journal of Geology, 5, 837–848.

    Article  Google Scholar 

  • EVANS, J. St. B. T. (1983). Selective processes in reasoning. In J. St. B. T. Evans (Ed.), Thinking and reasoning: Psychological approaches (pp. 135. 163). London: Routledge & Kegan Paul.

    Google Scholar 

  • FARRIS, H., & REVLIN, R. (1989a). Sensible reasoning in two tasks: Rule discovery and hypothesis evaluation. Memory and Cognition, 17, 221–232.

    Article  PubMed  Google Scholar 

  • FARRIS, H., & REVLIN, R. (1989b). The discovery process: A counterfactual strategy. In Social Studies in Science, Vol. 1. (pp. 497–513). London: Sage.

    Article  Google Scholar 

  • FISCHHOFF, B., SLOVIC, P., & LICHTENSTEIN, S. (1978). Fault trees: Sensitivity of estimated failure probabilities to problem representation. Journal of Experimental Psychology: Human Perception and Performance, 4, 330–344.

    Google Scholar 

  • GETTYS, C. R., & FISHER, S. D. (1979). Hypothesis plausibility and hypothesis generation. Organizational Behavior and Human Performance, 24, 93–110.

    Article  Google Scholar 

  • GETTYS, C. R., MEHLE, T., & FISHER, S. (1986). Plausibility assessments in hypothesis generation. Organizational Behavior and Human Decision Processes, 37, 14–33.

    Article  Google Scholar 

  • GLYMOUR, C. (1980). Theory and evidence (chap. 3). Princeton: Princeton University Press.

    Google Scholar 

  • GORMAN, M. E., GORMAN, M. E., LATTA, R. M., & CUNNINGHAM, G. (1984). How disconfirmatory, confirmatory and combined strategies affect group problem solving. British Journal of Psychology, 75, 65–79.

    Article  Google Scholar 

  • GORMAN, M. E., STAFFORD, A., & GORMAN, M. E. (1987). Disconfirmation and dual hypotheses on a more difficult version of Wason’s 2-4-6 task. The Quarterly Journal of Experimental Psychology, 39A, 1–28.

    Google Scholar 

  • GRIFFIN, D. W., DUNNING, D., & ROSS, L. (1990). The role of construal processes in overconfident predictions about the self and others. Journal of Personality and Social Psychology, 59, 1128–1139.

    Article  PubMed  Google Scholar 

  • HIGGINS, E. T., & BARGH, J. A. (1987). Social cognition and social perception. Annual Review of Psychology, 38, 369–425.

    Article  PubMed  Google Scholar 

  • KLAYMAN, J., & HA, Y. (1987). Confirmation, disconfirmation, and information in hypothesis testing. Psychological Review, 94, 211–228.

    Article  Google Scholar 

  • KLAYMAN, J., & HA, Y. (1989). Hypothesis testing in rule discovery: Strategy, structure, and content. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15, 596–604.

    Google Scholar 

  • LARZELERE, R. E., & SKEEN, J. H., (1984). The method of multiple hypotheses: A neglected research strategy in family studies. Journal of Family Issues, 5, 474–492.

    Article  Google Scholar 

  • MAHONEY, M. J., & DEMONBREUN, B. G. (1978). Psychology of the scientist: An analysis of problem-solving bias. Cognitive Therapy and Research, 1, 229–238.

    Article  Google Scholar 

  • MCDONALD, J. (1990). Some situational determinants of hypothesis-testing strategies. Journal of Experimental Social Psychology, 26, 255–274.

    Article  Google Scholar 

  • MCDONALD, J. (1992). Is strong inference really superior to simple inference? Synthese, 92, 261–282.

    Article  Google Scholar 

  • MCDONALD, J., & STENGER, J. (1993). Effects of hypothesis saliency on the use of positive and diagnostic test strategies. Journal of Organizational Behavior and Human Decision Processes, 56, 213–232.

    Article  Google Scholar 

  • MEHLE, T., GETTYS, C. R., MANNING, C., BACA, S., & FISHER, S. (1981). The availability explanation of excessive plausibility assessments. Acta Psychologica, 49, 127–140.

    Article  Google Scholar 

  • MYNATT, C. R., DOHERTY, M. E., & TWENEY, R. D. (1977). Confirmation bias in a simulated research environment: An experimental study of scientific inference. Quarterly Journal of Experimental Psychology, 29, 85–95.

    Article  Google Scholar 

  • MYNATT, C. R., DOHERTY, M. E., & TWENEY, R. D. (1978). Consequences of confirmation and disconfirmation in a simulated research environment. Quarterly Journal of Experimental Psychology, 30, 395–406.

    Article  Google Scholar 

  • PLATT, J. R. (1964). Strong inference. Science, 146, 347–353.

    Article  PubMed  Google Scholar 

  • POPPER, K. R. (1959). The logic of scientific discovery. London: Huchinson. (Original work published in German in 1935)

    Google Scholar 

  • POPPER, K. R. (1983). Postscript to the logic of scientific discovery Vol. 1. Realism and the aim of science. Totowa, NJ: Rowman and Littlefield.

  • SEKULER, R. (1981). In praise of strong inference. In R. Tweney, M. Doherty, & C. Mynatt (Eds.), On scientific thinking (pp. 111–112). New York: Columbia University Press.

    Google Scholar 

  • SHAKLEE, H., & FISCHHOFF, B. (1982). Strategies of information search in causal analysis. Memory and Cognition, 10, 520–530.

    Article  Google Scholar 

  • SKOV, R. B., & SHERMAN, S. J. (1986). Information-gathering processes: Diagnosticity, hypothesis-confirmatory strategies, and perceived hypothesis confirmation. Journal of Experimental Social Psychology, 22, 93–121.

    Article  Google Scholar 

  • THAGARD, P., & NISBETT, R. E. (1982). Variability and confirmation. Philosophical Studies, 50, 250–267.

    Google Scholar 

  • TROPE, Y., & BASSOK, M. (1983). Information-gathering strategies in hypothesis-testing. Journal of Experimental Social Psychology, 19, 560–576.

    Article  Google Scholar 

  • TUKEY, D. D. (1986). A philosophical and empirical analysis of subjects’ modes of inquiry in Wason’s 2-4-6 task. The Quarterly Journal of Experimental Psychology, 38A, 5–33.

    Article  Google Scholar 

  • TWENEY, R. D., DOHERTY, M. E., WORNER, W. J., PLISKE, D. B., MYNATT, C. R., GROSS, K. A., & ARKKELIN, D. L. (1980). Strategies of rule discovery in an inference task. Quarterly Journal of Experimental Psychology, 32, 109–123.

    Article  Google Scholar 

  • WASON, P. C. (1960). On the failure to eliminate hypotheses in a conceptual task. The Quarterly Journal of Experimental Psychology, 12, 129–140.

    Article  Google Scholar 

  • WASON, P., & JOHNSON-LAIRD, P. N. (1972). Psychology of reasoning: Structure and content (pp. 202–214). Cambridge: Harvard University Press.

    Google Scholar 

  • WETHERICK, N. E. (1962). Eliminative and enumerative behavior in a conceptual task. Quarterly Journal of Experimental Psychology, 14, 246–249.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Psychology, Lehman College, Bronx, NY, 10468-1589, USA

    John McDonald

Authors
  1. John McDonald
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

McDonald, J. The Relative Effectiveness of Diagnostic and Positive Test Strategies is Logically Indeterminable. Psychol Rec 45, 373–388 (1995). https://doi.org/10.1007/BF03395149

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF03395149

Search

Navigation