The effect of iconicity of visual displays on statistical reasoning: evidence in favor of the null hypothesis
Knowing which properties of visual displays facilitate statistical reasoning bears practical and theoretical implications. Therefore, we studied the effect of one property of visual diplays – iconicity (i.e., the resemblance of a visual sign to its referent) – on Bayesian reasoning. Two main accounts of statistical reasoning predict different effect of iconicity on Bayesian reasoning. The ecological-rationality account predicts a positive iconicity effect, because more highly iconic signs resemble more individuated objects, which tap better into an evolutionary-designed frequency-coding mechanism that, in turn, facilitates Bayesian reasoning. The nested-sets account predicts a null iconicity effect, because iconicity does not affect the salience of a nested-sets structure—the factor facilitating Bayesian reasoning processed by a general reasoning mechanism. In two well-powered experiments (N = 577), we found no support for a positive iconicity effect across different iconicity levels that were manipulated in different visual displays (meta-analytical overall effect: log OR = −0.13, 95 % CI [−0.53, 0.28]). A Bayes factor analysis provided strong evidence in favor of the null hypothesis—the null iconicity effect. Thus, these findings corroborate the nested-sets rather than the ecological-rationality account of statistical reasoning.
KeywordsIconicity Bayesian reasoning Visual displays Nested sets Bayes factor
We thank Cathleen Moore and three anonymous reviewers for their helpful comments on an earlier version of the manuscript.
- Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale: Erlbaum.Google Scholar
- Cumming, G. (2012). Understanding the new statistics: effect sizes, confidence intervals, and meta-analysis. New York: Routledge.Google Scholar
- Gaissmaier, W., Wegwarth, O., Skopec, D., Muller, A. S., Broschinski, S., & Politi, M. C. (2012). Numbers can be worth a thousand pictures: Individual differences in understanding graphical and numerical representations of health-related information. Health Psychology, 31, 286–296. doi: 10.1037/a0024850 PubMedCrossRefGoogle Scholar
- Higgins, J. P. T., & Green, S. (Eds.). (2008). Cochrane handbook for systematic reviews of interventions. Chichester: Wiley-Blackwell.Google Scholar
- Sedlmeier, P. (1999). Improving statistical reasoning: Theoretical models and practical implications. Mahwah: Erlbaum.Google Scholar
- Sirota, M., & Juanchich, M. (2011). Role of numeracy and cognitive reflection in Bayesian reasoning with natural frequencies. Studia Psychologica, 53, 151–161.Google Scholar
- Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36, 1–48.Google Scholar