Abstract
The standard practice of reducing every same-different data set to two numbers (hits and false alarms) is wasteful, because the response pattern to all four stimulus pairs carries information about the decision rule adopted by the observer. We describe eight rules organized in three families: differencing, covert classification, and likelihood ratio. We prove that each family produces a characteristic pattern of (in)equalities among the response probabilities. We propose two simple qualitative tests. Is the performance on stimulus pairs AA and BB statistically indistinguishable? If not, differencing and likelihood-ratio strategies can be rejected. Is the performance on pairs AB and BA indistinguishable? If not, covert classification can be rejected. We present algorithms for fitting two covert-classification models and illustrate the new methodology in a perceptual learning experiment on visual motion-direction discrimination. The standard assumption of symmetric decision criteria was violated.
Article PDF
Similar content being viewed by others
References
Ashby, F. G., & Gott, R. E. (1988). Decision rules in the perception and categorization of multidimensional stimuli. Journal of Experimental Psychology: Learning, Memory, & Cognition, 14, 33–53.
Ashby, F. G., & Townsend, J. T. (1986). Varieties of perceptual independence. Psychological Review, 93, 154–179.
Berg, B. G. (1989). Analysis of weights in multiple observation tasks. Journal of the Acoustical Society of America, 86, 1743–1746.
Cohen, A. L., & Nosofsky, R. M. (2000). An exemplar-retrieval model of speeded same-different judgments. Journal of Experimental Psychology: Human Perception & Performance, 26, 1549–1569.
Collett, D. (2003). Modeling binary data (2nd ed.). Boca Raton, FL: Chapman & Hall/CRC.
Dai, H., Versfeld, N. J., & Green, D. M. (1996). The optimum decision rules in the same-different paradigm. Perception & Psychophysics, 58, 1–9.
Francis, M. A., & Irwin, R. J. (1995). Decision strategies and visualfield asymmetries in same-different judgments of word meaning. Memory & Cognition, 23, 301–312.
Garner, W. R. (1974). The processing of information and structure. Potomac, MD: Erlbaum.
Gourevitch, V., & Galanter, E. (1967). A significance test for one parameter isosensitivity functions. Psychometrika, 32, 25–33.
Green, D. M., & Swets, J. A. (1966). Signal detection theory and psychophysics. New York: Wiley.
Hautus, M. J., & Collins, S. (2003). An assessment of response bias for the same-different task: Implications for the single-interval task. Perception & Psychophysics, 65, 844–860.
Irwin, R. J., & Francis, M. A. (1995). Perception of simple and complex visual stimuli: Decision strategies and hemispheric differences in same-different judgments. Perception, 24, 787–809.
Irwin, R. J., & Hautus, M. J. (1997). Likelihood-ratio decision strategy for independent observations in the same-different task: An approximation to the decision-theoretic model. Perception & Psychophysics, 59, 313–316.
Irwin, R. J., Hautus, M. J., & Butcher, J. C. (1999). An area theorem for the same-different experiment. Perception & Psychophysics, 61, 766–769.
Irwin, R. J., Hautus, M. J., & Francis, M. A. (2001). Indices of response bias in the same-different experiment. Perception & Psychophysics, 63, 1091–1100.
Johnson, K. O. (1980). Sensory discrimination: Decision process. Journal of Neurophysiology, 43, 1771–1792.
Kostrikin, A. I., & Manin, Y. I. (1989). Linear algebra and geometry. New York: Gordon and Breach Science Publishers.
Lages, M., & Treisman, M. (1998). Spatial frequency discrimination: Visual long-term memory or criterion setting? Vision Research, 38, 557–572.
Laming, D. (1986). Sensory analysis. London: Academic Press.
Macmillan, N. A., & Creelman, C. D. (2005). Detection theory: A user’s guide (2nd ed.). Mahwah, NJ: Erlbaum.
MathWorks (1999). MATLAB user’s guide. Natick, MA: The Math-Works, Inc.
Miller, J. (1996). The sampling distribution of d’. Perception & Psychophysics, 58, 65–72.
Minsky, M. L., & Papert, S. A. (1969). Perceptrons. Cambridge, MA: MIT Press.
Morgan, M. J., Watamaniuk, S. N. J., & McKee, S. P. (2000). The use of an implicit standard for measuring discrimination thresholds. Vision Research, 40, 2341–2349.
Mueller, S. T., & Weidemann, C. T. (2008). Decision noise: An explanation for observed violations of signal detection theory. Psychonomic Bulletin & Review, 15, 465–494.
Nachmias, J. (2006). The role of virtual standards in visual discrimination. Vision Research, 46, 2456–2464.
Noreen, D. L. (1981). Optimal decision rules for some common psychophysical paradigms. In S. Grossberg (Ed.), Mathematical psychology and psychophysiology (pp. 237–280). Providence, RI: American Mathematical Society.
Nosofsky, R. M., & Palmeri, T. J. (1997). An exemplar-based random walk model of speeded classification. Psychological Review, 104, 266–300.
Pasternak, T., & Greenlee, M. W. (2005). Working memory in primate sensory systems. Nature Reviews Neuroscience, 6, 97–107.
Petrov, A. A. (2009). Single-interval and same-different discrimination tasks yield consistent estimates of perceptual learning of visual motion. Manuscript submitted for publication.
Platt, J. R. (1964). Strong inference: Certain systematic methods of scientific thinking may produce much more rapid progress than others. Science, 146, 347–353.
Pollack, I., & Pisoni, D. B. (1971). On the comparison between identification and discrimination tests in speech recognition. Psychonomic Science, 1, 125–126.
Popper, K. (1963). Conjectures and refutations: The growth of scientific knowledge. London: Routledge & Kegan Paul.
Romo, R., Hernández, A., Zainos, A., Lemus, L., & Brody, C. D. (2002). Neuronal correlates of decision-making in secondary somatosensory cortex. Nature Neuroscience, 5, 1217–1225.
Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning internal representations by error propagation. In D. E. Rumelhart & J. L. McClelland (Eds.), Parallel distributed processing: Exploration in the microstructure of cognition (Vol. 1, pp. 318–362). Cambridge, MA: MIT Press.
Sorkin, R. D. (1962). Extension of the theory of signal detectability to matching paradigms in psychoacoustics. Journal of the Acoustical Society of America, 34, 1745–1751.
Thomas, R. D. (1996). Separability and independence of dimensions within the same-different judgment task. Journal of Mathematical Psychology, 40, 318–341.
Vogels, R., & Orban, G. A. (1986). Decision processes in visual discrimination of line orientation. Journal of Experimental Psychology: Human Perception & Performance, 12, 115–132.
Wang, M.-F., Irwin, R. J., & Hautus, M. J. (2005). Detection-theoretic analysis of same-different judgments for the amplitude discrimination of acoustic sinusoids. Journal of the Acoustical Society of America, 117, 1305–1313.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Petrov, A.A. Symmetry-based methodology for decision-rule identification in same-different experiments. Psychonomic Bulletin & Review 16, 1011–1025 (2009). https://doi.org/10.3758/PBR.16.6.1011
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/PBR.16.6.1011