Abstract
In learning contexts, people need to make realistic confidence judgments about their memory performance. The present study investigated whether second-order judgments of first-order confidence judgments could help people improve their confidence judgments of semantic memory information. Furthermore, we assessed whether different personality and cognitive style constructs help explain differences in this ability. Participants answered 40 general knowledge questions and rated how confident they were that they had answered each question correctly. They were then asked to adjust the confidence judgments they believed to be most unrealistic, thus making second-order judgments of their first-order judgments. As a group, the participants did not increase the realism of their confidence judgments, but they did significantly increase their confidence for correct items. Furthermore, participants scoring high on an openness composite were more likely to display higher confidence after both the first- and second-order judgments. Moreover, participants scoring high on the openness and the extraversion composites were more likely to display higher levels of overconfidence after both the first- and second-order judgments. In general, however, personality and cognitive style factors showed only a weak relationship with the ability to modify the most unrealistic confidence judgments. Finally, the results showed no evidence that personality and cognitive style supported first- and second-order judgments differently.
Similar content being viewed by others
Notes
It should be noted that there are some constraints to this correlation since the number of adjustments varied a lot between participants. Also correlations could not be calculated for participants that did not choose to do any adjustments.
The results with respect to the Need for Cognition scale are, although novel (for example, it was not included in the Kleitman 2008 study), consistent with the nature of this factor.
94 participants were left in the analysis for correct answers and 121 participants in the analysis for incorrect answers.
This analysis was done only for the participants who had more than 5 unrealistic items when calculating both the correct and incorrect ratio; thus, these correlations consist of 75 participants.
We did not control for the accuracy of performance because such control will be redundant given that confidence levels were split on the basis of the correctly and incorrectly answered items.
References
Buratti, S., & Allwood, C. M. (2012a). The accuracy of meta-metacognitive judgments: Regulating the realism of confidence. Cognitive Processing, 13(3), 243–253. doi:10.1007/s10339-012-0440-5.
Buratti, S., & Allwood, C.M. (2012b). Improved realism of confidence for an episodic memory event. Judgment and Decision Making, 7(5), 590–601. Retrieved from http://journal.sjdm.org/11/111121a/jdm111121a.html.
Cacioppo, J. T., Petty, R. E., & Kao, C. F. (1984). The efficient assessment of need for cognition. Journal of Personality Assessment, 48(3), 306–307. doi:10.1207/s15327752jpa4803_13.
Campbell, W. K., Goodie, A. S., & Foster, J. D. (2004). Narcissism, confidence, and risk attitude. Journal of Behavioral Decision Making, 17(4), 297–311. doi:10.1002/bdm.475.
Cesarini, D., Sandewall, Ö., & Johannesson, M. (2006). Confidence interval estimation task and the economics of overconfidence. Journal of Economic Behavior & Organization, 61, 453–470. doi:10.1016/j.jebo.2004.10.010.
Clance, P. R. (1985). The Imposter Phenomenon: Overcoming the fear that haunts your success. Atlanta: Peachtree.
Costa, P. T., & McCrae, R. R. (1988). Personality in adulthood: A six-year longitudinal study of self-reports and spouse ratings on the NEO personality inventory. Journal of Personality and Social Psychology, 54(5), 853–863. doi:10.1037/0022-3514.54.5.853.
Cutler, B. L., Penrod, S. D., & Stuve, T. E. (1988). Juror decision making in eyewitness identification cases. Law and Human Behavior, 12, 41–55. doi:10.1007/bf01064273.
Dahl, M., Allwood, C. M., Rennemark, M., & Hagberg, B. (2010). The relation between personality and the realism in confidence judgements in older adults. European Journal of Ageing, 7(4), 283–291. doi:10.1007/s10433-010-0164-2.
Dunlosky, J., Serra, M. J., Matvey, G., & Rawson, K. A. (2005). Second-order judgments about judgments of learning. The Journal of General Psychology, 132(4), 335–346. doi:10.3200/GENP.132.4.335-346.
Flavell, J.H., Miller, S.A., & Miller, P.H. (1993). Cognitive development (3rd ed.) Englewood Cliffs, NJ: Prentice-Hall.
Gabriel, M. T., Critelli, J. W., & Ee, J. S. (1994). Narcissistic illusions in self-evaluations of intelligence and attractiveness. Journal of Personality, 62(1), 143–155. doi:10.1111/j.1467-6494.1994.tb00798.x.
Goldberg, L. R. (1992). The development of markers for the Big Five structure. Psychological Assessment, 4, 26–42.
Griffin, D., & Brenner, L. (2004). In D. J. Koehler & N. Harvey (Eds.), Perspectives on probability judgment calibration. Malden: Blackwell Publishing.
Jonsson, A.-C., & Allwood, C. M. (2003). Stability and variability in the realism of confidence judgments over time, content domain, and gender. Personality and Individual Differences, 34(4), 559–574. doi:10.1016/S0191-8869(02)00028-4.
King, J. E., & Cooley, E. L. (1995). Achievement orientation and the impostor phenomenon among college students. Contemporary Educational Psychology, 20(3), 304–312. doi:10.1006/ceps.1995.1019.
Kleitman, S. (2008). Metacognition in the rationality debate. Self-confidence and its calibration. Germany: VDM Verlag Dr. Mueller.
Kleitman, S., & Costa, D. (in press). The role of a novel formative assessment tool (Stats-mIQ) and individual differences in real-life academic performance. Learning and Individual Differences.
Kleitman, S., & Stankov, L. (2001). Ecological and person-oriented aspects of metacognitive processes in test-taking. Applied Cognitive Psychology, 15(3), 321–341. doi:10.1002/acp.705.
Kleitman, S., & Stankov, L. (2007). Self-confidence and metacognitive processes. Learning and Individual Differences Journal, 17(2), 161–173.
Koriat, A., & Goldsmith, M. (1996). Monitoring and control processes in the strategic regulation of memory accuracy. Psychological Review, 103, 490–517. Vazire.
Kruglanski, A. W. (1989). Lay epistemics and human knowledge. New York: Plenum Press.
Lichtenstein, S., Fischhoff, B., & Phillips, L. D. (1982). Calibration of subjective probabilities: The state of the art up to 1980. In D. Kahneman, P. Slovic, & A. Tversky (Eds.), Judgment under uncertainty: Heuristics and biases (pp. 306–334). New York: Cambridge University Press.
McClelland, A. G. R., & Bolger, F. (1994). In G. Wright & P. Ayton (Eds.), The calibration of subjective probability: Theories and models 1980–94. New York: John Wiley and Sons.
Miller, T. M., & Geraci, L. (2011). Unskilled but aware: Reinterpreting overconfidence in low-performing students. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37(2), 502–506. doi:10.1037/a0021802.
Mirels, H. L., Greblo, P., & Dean, J. B. (2002). Judgmental self-doubt: Beliefs about one’s judgmental prowess. Personality and Individual Differences, 33(5), 741–758. doi:10.1016/S0191-8869(01)00189-1.
Nelson, T. O., & Narens, L. (1990). Metamemory: A theoretical framework and new findings. In G. H. Bower (Ed.), The psychology of learning and motivation (pp. 1–45). New York: Academic.
Nelson, T. O., & Narens, L. (1994). Why investigate metacognition? In J. Metcalfe & A. P. Shimamura (Eds.), Metacognition: Knowing about knowing (pp. 1–25). Cambridge: MIT Press.
Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175–220. doi:10.1037/1089-2680.2.2.175.
Oleson, K. C., Poehlmann, K. M., Yost, J. H., Lynch, M. E., & Arkin, R. M. (2000). Subjective overachievement: Individual differences in self-doubt and concern with performance. Journal of Personality, 68(3), 491–524. doi:10.1111/1467-6494.00104.
Pallier, G., Wilkinson, R., Danthir, V., Kleitman, S., Knezevic, G., Stankov, L., et al. (2002). The role of individual differences in the accuracy of confidence judgments. The Journal of General Psychology, 129(3), 257–299. doi:10.1080/00221300209602099.
Perfect, T. J. (2004). The role of self-rated ability in the accuracy of confidence judgements in eyewitness memory and general knowledge. Applied Cognitive Psychology, 18(2), 157–168. doi:10.1002/acp.952.
Perfect, T. J., Watson, E. L., & Wagstaff, G. F. (1993). Accuracy of confidence ratings associated with general knowledge and eyewitness memory. Journal of Applied Psychology, 78(1), 144–147. doi:10.1037/0021-9010.78.1.144.
Raskin, R., & Terry, H. (1988). A principal components analysis of the narcissistic personality inventory and further evidence of its construct validity. Journal of Personality and Social Psychology, 54, 890–902.
Roets, A., & Van Hiel, A. (2007). Separating ability from need: Clarifying the dimensional structure of the Need for Closure scale. Personality and Social Psychology Bulletin, 33(2), 266–280. doi:10.1177/0146167206294744.
Ronningstam, E. F. (2005). Identifying and understanding the narcissistic personality. New York: Oxford University Press.
Ross, S. R., Stewart, J., Mugge, M., & Fultz, B. (2001). The imposter phenomenon, achievement dispositions, and the five factor model. Personality and Individual Differences, 31(8), 1347–1355. doi:10.1016/S0191-8869(00)00228-2.
Sadowski, C. J., & Cogburn, H. E. (1997). Need for cognition in the Big-Five factor structure. Journal of Psychology: Interdisciplinary and Applied, 131(3), 307–312.
Schaefer, P. S., Williams, C. C., Goodie, A. S., & Campbell, W. K. (2004). Overconfidence and the Big Five. Journal of Research in Personality, 38(5), 473–480. doi:10.1016/j.jrp.2003.09.010.
Serra, M. J., & England, B. D. (2012). Magnitude and accuracy differences between judgements of remembering and forgetting. The Quarterly Journal of Experimental Psychology, 65(11), 2231–2257. doi:10.1080/17470218.2012.685081.
Stankov, L. (1999). Mining on the “no man’s land” between intelligence and personality. In P. L. Ackerman, P. C. Kyllonen, & R. D. Roberts (Eds.), Learning and individual differences: Process, trait, and content determinants (pp. 315–337). Washington, DC: American Psychological Association.
Stankov, L., & Crawford, J. D. (1996). Confidence judgments in studies of individual differences. Personality and Individual Differences, 21(6), 971–986. doi:10.1016/S0191-8869(96)00130-4.
Stankov, L., & Kleitman, S. (2008). Processes on the borderline between cognitive abilities and personality: Confidence and its realism. In G. J. Boyle, G. Matthews, & D. Saklofske (Eds.), The SAGE handbook of personality theory and testing (Vol. 1, pp. 541–555). Thousand Oaks: Sage Publications.
Vazire, S., Naumann, L. P., Rentfrow, P. J., & Gosling, S. D. (2008). Portrait of a narcissist: Manifestations of narcissism in physical appearance. Journal of Research in Personality, 42, 1439–1447. doi:10.1016/j.jrp.2008.06.007.
Wang, M. C., Haertel, G. D., & Walberg, H. J. (1990). What influences learning? A content analysis of review literature. The Journal of Educational Research, 84(1), 30–43.
Want, J., & Kleitman, S. (2006). Imposter phenomenon and self-handicapping: Links with parenting styles and self-confidence. Personality and Individual Differences, 40(5), 961–971. doi:10.1016/j.paid.2005.10.005.
Washburn, D. A., Smith, J. D., & Taglialatela, L. A. (2005). Individual differences in Metacognitive responsiveness: Cognitive and personality correlates. The Journal of General Psychology, 132(4), 446–461. doi:10.3200/GENP.132.4.446-461.
Webster, D. M., & Kruglanski, A. W. (1994). Individual differences in need for cognitive closure. Journal of Personality and Social Psychology, 67(6), 1049–1062. doi:10.1037/0022-3514.67.6.1049.
Wolfe, R. N., & Grosch, J. W. (1990). Personality correlates of confidence in one’s decisions. Journal of Personality, 58, 515–534. doi:10.1111/j.1467-6494.1990.tb00241.x.
Yates, J. F. (1994). Subjective probability accuracy analysis. In G. A. Wright & P. Ayton (Eds.), Subjective probability (pp. 381–410). Oxford: John Wiley and Sons.
Acknowledgment
This research was partially supported by a grant given to the second author from the Swedish Research Council (VR). Special thanks to the Australian Endeavour Awards for financially supporting the visit of the first author to the University of Sydney. Special thanks to Simon Jackson for excellent suggestions regarding the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Buratti, S., Allwood, C.M. & Kleitman, S. First- and second-order metacognitive judgments of semantic memory reports: The influence of personality traits and cognitive styles. Metacognition Learning 8, 79–102 (2013). https://doi.org/10.1007/s11409-013-9096-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11409-013-9096-5