Comparing Regression Approaches in Modelling Compensatory and Noncompensatory Judgment Formation
Applied research on judgment formation, e.g. in education, is interested in identifying the underlying judgment rules from empirical judgment data. Psychological theories and empirical results on human judgment formation support the assumption of compensatory strategies, e.g. (weighted) linear models, as well as noncompensatory (heuristic) strategies as underlying judgment rules. Previous research repeatedly demonstrated that linear regression models well fitted empirical judgment data, leading to the conclusion that the underlying cognitive judgment rules were also linear and compensatory. This simulation study investigated whether a good fit of a linear regression model is a valid indicator of a compensatory cognitive judgment formation process. Simulated judgment data sets with underlying compensatory and noncompensatory judgment rules were generated to reflect typical judgment data from applied educational research. Results indicated that linear regression models well fitted even judgment data with underlying noncompensatory judgment rules, thus impairing the validity of the fit of the linear model as an indicator of compensatory cognitive judgment processes.
The preparation of this paper was supported by AFR PhD grant 2962244 of the Luxembourgish Fond Nationale de la Recherche (FNR). Grade distribution data were provided by the FNR-CORE-project TRANSEC (C08/LM/02).
- Anderson, N. H. (1974). Cognitive algebra. Integration theory applied to social attribution. In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 7, pp. 1–100). New York: Academic.Google Scholar
- Anderson, N. H., & Butzin, C. A. (1974). Performance = Motivation × Ability. An integration-theoretical analysis. Journal of Personality and Social Psychology, 30, 598–604.Google Scholar
- Bröder, A. (2002). Take the best, Dawes’ rule, and compensatory decision strategies. A regression-based classification method. Quality & Quantity, 36, 219–238.Google Scholar
- Brunswik, E. (1952). Conceptual framework of psychology. Chicago: University of Chicago Press.Google Scholar
- Ingenkamp, K. (1971). Die Fragwürdigkeit der Zensurengebung [The dubiosness of grading]. Weinheim: Beltz.Google Scholar
- Rheinberg, F. (2001). Bezugsnormen und schulische Leistungsbeurteilung [Reference norms and assessment of academic achievement]. In F. E. Weinert (Ed.), Leistungsmessung in Schulen (pp. 59–72). Weinheim: Beltz.Google Scholar