Skip to main content
Log in

Peeking into Personality Test Answers: Inter- and Intraindividual Variety in Item Interpretations

  • Regular Article
  • Published:
Integrative Psychological and Behavioral Science Aims and scope Submit manuscript

Abstract

Personality research of today applies basically inventories having neither unambiguously interpretable items nor responses. The substantive process of generating the test answer is rarely investigated and thus the possible field of meanings, out of which the answer is created, remains hidden. In order to investigate the possible array of spontaneous answers to personality test items, a situative open-ended personality inventory was developed to determine individuals’ ways of interpreting personality test items and relevant personality descriptions for individuals. The children’s sample (N = 704 of 10–13 year olds) answered five free-response contextualized personality test questions, each related to one of the Five Factor Model personality dimensions. It was revealed that there is no universal interpretation of an item. First, different children’s answers to same question described different personality dimensions – substantial number of the respondents’ answers did not reflect the personality domain assumed in an item. So there are several ways to interpret test questions; answers may refer to different personality dimensions and not necessarily the one assumed by the researcher. Second, a number of children mentioned more than one personality trait for one item, indicating that even within one person there may be several relevant interpretations of the same item. Considering personality traits as occurring one by one and mutually exclusively during personality test answering may be artificial; in reality trait combinations may reflect actual reaction. In sum, the results suggest there is no single predictable interpretational trajectory in meaning construction process if semiotically mediated constructs, e.g., personality reflection, are assessed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Arro, G. (2010). Children’s self-reflection and personality and their relationships with cognitive ability and academic success. In A. Toomela (Ed.), Systemic person-oriented study of child development in early primary school (pp. 225–245). Switzerland: Peter Lang Verlag.

    Google Scholar 

  • Barbaranelli, C., Caprara, G. V., Rabasca, A., & Pastorelli, C. (2003). A questionnaire for measuring the Big Five in late childhood. Personality and Individual Differences, 34, 645–664.

    Article  Google Scholar 

  • Block, J. (1995). A contrarian view of the Five-Factor approach to personality description. Psychological Bulletin, 117(2), 187–215.

    Article  PubMed  Google Scholar 

  • Blount, C., Evans, C., Birch, S., Warren, F., & Norton, K. (2002). The properties of self-report research measures: beyond psychometrics. Psychology and Psychotherapy: Theory, Research and Practice, 75, 151–164.

    Article  Google Scholar 

  • Bouchard, T. J., Jr., & McGue, M. (1990). Genetic and rearing environmental influences on adult personality: an analysis of adopted twins reared apart. Journal of Personality, 58, 263–292.

    Article  Google Scholar 

  • Bowler, M. C., Bowler, J. L., & Phillips, B. C. (2009). The Big-5 ± 2? The impact of cognitive complexity on the factor structure of the five-factor model. Personality and Individual Differences, 47, 979–984.

    Article  Google Scholar 

  • Butler, R. (2009). Reflections in personal construct theory. New Jersey: Wiley.

    Book  Google Scholar 

  • Claxton, A., O’Rourke, N., Smith, J. Z., & DeLongis, A. (2012). Personality traits and marital satisfaction within enduring relationships: an intra-couple discrepancy approach. Journal of Social and Personal Relationships, 29(3), 375–396.

    Article  Google Scholar 

  • Clegg, J. (2010). Uncertainty as a fundamental scientific value. Integrative Psychological and Behavioral Science, 44, 245–251.

    Article  PubMed  Google Scholar 

  • Craig, G., & Boyle, M. E. (1979). The recognition and spontaneous use of psychological descriptions by young children. The British Journal of Social and Clinical Psychology, 18, 207–208.

    Article  Google Scholar 

  • De Fruyt, F., & Vollarth, M. (2003). Inter-parent agreement on higher and lower level traits in two countries: effects of parent and child gender. Personality and Individual Differences, 35(2), 289–301.

    Article  Google Scholar 

  • De Fruyt, F., Mervielde, I., Hoekstra, H. A., & Rolland, J.-P. (2000). Assessing adolescents’ personality with the NEO PI-R. Assessment, 7(4), 329–345.

    Article  PubMed  Google Scholar 

  • Diener, E. (2000). Subjective well-being. The science of happiness and a proposal for a national index. The American Psychologist, 55(1), 34–43.

    Google Scholar 

  • Diriwächter, R., Valsiner, J., & Sauck, C. (2005). Microgenesis in making sense of oneself: constructive recycling of personality inventory items. Forum: Qualitative Social Research, 6(1).

  • Donahue, E. M. (1994). Do children use the Big Five, too? Content and structural form in personality description. Journal of Personality, 62(1), 45–66.

    Article  PubMed  Google Scholar 

  • Fleeson, W. (2001). Toward a structure- and process-integrated view of personality: traits as density distributions of states. Journal of Personality and Social Psychology, 80(6), 1011–1027.

    Article  PubMed  Google Scholar 

  • Fleeson, W. (2004). Moving personality beyond the person-situation debate. The challenge and the opportunity of within-person variability. Current Directions in Psychological Science, 13(2), 83–87.

    Article  Google Scholar 

  • Freeman, M. (2011). Toward poetic science. Integrative Psychological & Behavioral Science, 45(4), 389–396.

    Google Scholar 

  • Freund, A., & Smith, J. (1999). Methodological comment: temporal stability of older person’s spontaneous self-definition. Experimental Aging Research, 25(1), 95–107.

    Article  PubMed  Google Scholar 

  • Fujita, K., & Han, H. A. (2009). Moving beyond deliberative control of impulses: the effect of construal levels on evaluative associations in self-control conflicts. Psychological Science, 20, 799–804.

    Article  PubMed  Google Scholar 

  • Goldberg, L. R., & Kilkowski, J. M. (1985). The prediction of semantic consistency in self-descriptions: characteristics of persons and of terms that affect the consistency of responses to synonym and antonym pairs. Journal of Personality and Social Psychology, 48(1), 82–98.

    Article  Google Scholar 

  • Harrington, R., & Loffredo, D. A. (2011). Insight, rumination, and self-reflection as predictors of well-being. Journal of Psychology, 145(1), 39–57.

    Article  PubMed  Google Scholar 

  • Hendriks, A. A. J., Kuyper, H., Offringa, G. J., & Van der Werf, M. P. C. (2008). Assessing young adolescents’ personality with the five-factor personality inventory. Assessment, 15, 304.

    Article  Google Scholar 

  • Hodge, D. R., & Gillespie, D. (2003). Phrase completions: an alternative to Likert scales. Social Work Research, 27, 45–56.

    Article  Google Scholar 

  • Hogan, J., & Holland, B. (2003). Using theory to evaluate personality and Job-performance relations: a socioanalytic perspective. Journal of Applied Psychology, 88(1), 100–112.

    Article  PubMed  Google Scholar 

  • International personality item pool: a scientific collaboratory for the development of advanced measures of personality traits and other individual differences (http://ipip.ori.org/). Internet Web Site.

  • John, O. P., Robins, R. W., & Pervin, L. A. (Eds.). (2008). Handbook of personality: theory and research (3rd ed.). New York: Guilford Publications.

    Google Scholar 

  • Jovanović, G. (2010). Historizing epistemology in psychology. Integrative Psychological and Behavioral Science, 44(4), 310–328.

    Article  PubMed  Google Scholar 

  • Kangro, E.-M. (2010). Role of reflection-ability in children’s self-regulation. In Toomela, Aaro (Ed.), Systemic person-oriented study of child development in early primary school (pp. 225–245). Switzerland: Peter Lang Verlag.

  • Kelly, G. A. (1955). The psychology of personal constructs. New York: Norton.

  • Lounsbury, J. W., Sundstrom, E., Loveland, J. L., & Gibson, L. W. (2003). Broad versus narrow personality traits in predicting academic performance of adolescents. Learning and Individual Differences, 14(1), 65–75.

    Article  Google Scholar 

  • Markey, P. M., Markey, C. N., Tinsley, B. J., & Ericsen, A. J. (2002). A preliminary validation of preadolescents’ self-reports using the five-factor model of personality. Journal of Research in Personality, 36, 173–181.

    Article  Google Scholar 

  • Mayer, J. D., & Korogodsky, M. (2011). A really big picture of personality. Social and Personality Psychology Compass, 5(2), 104–117.

    Article  Google Scholar 

  • McCrae, R. R., & Costa, P. T., Jr. (2006). Personality in adulthood. New York: Guilford Press.

    Google Scholar 

  • McCrae, R. R., Costa, P. T., Jr., Terracciano, A., Parker, W. D., Mills, C. J., De Fruyt, F., & Mervielde, I. (2002). Personality trait development from age 12 to age 18: longitudinal, cross-sectional and cross-cultural analyses. Journal of Personality and Social Psychology, 83(6), 1456–1468.

    Article  PubMed  Google Scholar 

  • Measelle, J. R., John, O. P., Ablow, J. C., Cowan, C. P., & Cowan, P. A. (2005). Can children provide coherent, stable, and valid self-reports on the Big Five dimensions? A longitudinal study from ages 5 to 7. Journal of Personality and Social Psychology, 89(1), 90–106.

    Article  PubMed  Google Scholar 

  • Mischel, W., & Shoda, Y. (1995). A cognitive-affective system theory of personality: reconceptualizing situations, dispositions, dynamics, and invariance in personality structure. Psychological Review, 102(2), 246–268.

    Article  PubMed  Google Scholar 

  • Mõttus, R., McNeill, G., Jia, X., Craig, L. C. A., Starr, J. M., Deary, I. J. (2011). The Associations between personality, diet and body mass index in older people. Health Psychology.

  • Omi, Y. (2012). Tension between the theoretical thinking and the empirical method: is it an inevitable fate for psychology? Integrative Psychological & Behavioral Science, 46(1), 118–127.

    Google Scholar 

  • Quartier, V., & Rossier, J. (2008). A study of personality in children aged 8–12 years: comparing self- and parents’ ratings. European Journal of Personality, 22(7), 575–588.

    Article  Google Scholar 

  • Rammstedt, B., Goldberg, L. R., & Borg, I. (2010). The measurement equivalence of Big-Five factor markers for persons with different levels of education. Journal of Research in Personality, 44(1), 53–61.

    Article  PubMed  Google Scholar 

  • Roberts, B. W. (2009). Back to the future: Personality and Assessment and personality development. Journal of Research in Personality, 43(2), 137–145.

    Article  PubMed  Google Scholar 

  • Rosenbaum, P. J., & Valsiner, J. (2011). The un-making of a method: From rating scales to the study of psychological processes. Theory & Psychology, 21(1), 47–65.

    Google Scholar 

  • Sauter, F. M., Heyne, D., Blöte, A. W., van Widenfelt, B. M., & Westenberg, P. M. (2010). Assessing therapy-relevant cognitive capacities in young people: development and psychometric evaluation of the self-reflection and insight scale for youth. Behavioural and Cognitive Psychotherapy, 38, 303–317.

    Article  PubMed  Google Scholar 

  • Schwarz, M. (2009). Is psychology based on a methodological error? Integrative Psychological and Behavioral Science, 43, 185–213.

    Article  PubMed  Google Scholar 

  • Soto, C. J., John, O. P., Gosling, S. D., & Potter, J. (2011). Age differences in personality traits from 10 to 65: big five domains and facets in a large cross-sectional sample. Journal of Personality and Social Psychology, 100(2), 330–348.

    Article  PubMed  Google Scholar 

  • Stam, H. J. (2010). The fault is not in ourselves, but in our methods: comment on Schwarz. Integrative Psychological and Behavioral Science, 44, 281–287.

    Article  Google Scholar 

  • Ten Berge, M., & De Raad, B. (2001). The construction of a joint taxonomy of traits and situations. European Journal of Personality, 15, 253–276.

    Article  Google Scholar 

  • Toomela, A. (2003). Relationships between personality structure, structure of word meaning, and cognitive ability: a study of cultural mechanisms of personality. Journal of Personality and Social Psychology, 85(4), 723–735.

    Article  PubMed  Google Scholar 

  • Toomela, A. (2007). Culture of science: strange history of the methodological thinking in psychology. Integrative Psychological and Behavioral Sciences, 1, 6–20.

    Article  Google Scholar 

  • Toomela, A. (2008a). Noncognitive correlates of education. Learning and Individual Differences, 18(1), 19–28.

    Article  Google Scholar 

  • Toomela, A. (2008b). Variables in psychology: a critique of quantitative psychology. Integrative Psychological and Behavioral Science, 42, 245–265.

    Article  PubMed  Google Scholar 

  • Toomela, A. (2009). Modern mainstream psychology is the best? In Methodological thinking in psychology: 60 years gone astray? Information Age Publishing, 1–26.

  • Toomela, A. (2011). Travel into a fairy land: a critique of modern qualitative and mixed methods psychologies. Integrative Psychological and Behavioral Sciences, 45, 21–47.

    Article  Google Scholar 

  • Trapnell, P. D., & Campbell, J. D. (1999). Private self-consciousness and the Five-Factor Model of personality: distinguishing rumination from reflection. Journal of Personality and Social Psychology, 76(2), 284–304.

    Article  PubMed  Google Scholar 

  • Valsiner, J. (2009). Integrating psychology within the globalizing world: a requiem to the post-modernist experiment with Wissenschaft. IPBS: Integrative Psychological and Behavioral Science, 43(1), 1–21.

    Article  Google Scholar 

  • Vygotskij, L. S. (2002). Denken und Sprechen. Weinheim und Basel: Beltz Verlag. (Original im 1934)

  • Wagoner, B., & Valsiner, J. (2005). Rating tasks in psychology: from static ontology to dialogical synthesis of meaning. In A. GĂĽlerçe, I. Steauble, A. Hofmeister, G. Saunders, & J. Kaye (Eds.), Contemporary theorizing in psychology: global perspectives (pp. 197–213). Toronto: Captus Press.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Grete Arro.

Additional information

This work was supported by the Estonian Ministry of Science and Education Grant 3-2/TA5966; and by the European Social Fund Programme Eduko (via Archimedes Foundation) Grant 30.2-10.2/1247. The author thanks professor Aaro Toomela for his valuable advice during the writing process

Appendix

Appendix

The sketch for assessing extraversion asks the child to imagine he or she is on an isolated island. The child is asked, whether he or she would like to be there alone; with a good friend; or with all his/her classmates. Subsequent to that decision the child is asked to explain why he or she has chosen this option. As the dimension of extraversion is defined by the tendency to enjoy other people’s company we suggested the given situation may reveal the trait of gregariousness.

To assess openness to experience, a situation is described where a classmate of the respondent has read through the following year’s mathematics student book. The respondent is asked to consider why the classmate has done that. As the openness to experience dimension is defined by an interest toward the world and ideas, answers to the given question should reveal the ability to value knowledge or ideas for their own sake.

To assess agreeableness, a child was asked to imagine a situation where a new student comes to his/her class. The new student has to sit in a wheelchair constantly. The child is asked whether he/she would like to become friends with the new student. Subsequently the child is asked why he/she would like to be or not to be friends with the new child. As the dimension of agreeableness is defined by the tendency to help other people and to be altruistic, we assumed the situation where somebody clearly needs some emotional support may well indicate the given personality dimension.

The sketch assessing conscientiousness asks the child to imagine a situation where she or he has got a difficult home task in a subject she or he does not really like; it is stated that “you try to figure out the solution, but no good idea comes to your mind.” The child is asked what he/she would feel in this situation. The dimension of conscientiousness is defined as the disposition to carry on with a task even if it requires effort, so it is assumed that the situation described should demonstrate the achievement striving dimension.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Arro, G. Peeking into Personality Test Answers: Inter- and Intraindividual Variety in Item Interpretations. Integr. psych. behav. 47, 56–76 (2013). https://doi.org/10.1007/s12124-012-9216-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12124-012-9216-9

Keywords

Navigation