Abstract
In this study, third in a series of studies of the relationships between the dominant type of the Word Meaning Structure (WMS) and various psychic processes, response patterns on personality questionnaires with Likert-type response format of individuals with different levels of education (including adult illiterates) in Brazil (N = 102) and in Estonia (N = 520) were assessed with person oriented methods of data analysis. We found that responses to two personality questionnaires (International Personality Item Pool Questionnaire, IPIP-Q60 and Estonian Collectivism Scale, ESTCOL) are inconsistent and do not correspond to theories that underlie construction and interpretation of such assessment tools. Two novel ways to assess inconsistent response patterns were developed. The Consistency Index (CI) characterizes between-item inconsistency and the Determinacy Index (DI) characterizes within-item inconsistency. The dominant type of the WMS and the level of education were related to both CI and DI. Higher level of between-item inconsistency characterizes everyday conceptual thinkers with lower levels of education and higher level of within-item inconsistency was observed among logical conceptual thinkers with higher levels of education. Systematic relationships between WMS and inconsistent patterns of responses indicate that responses on personality questionnaires cannot be interpreted in terms of personality characteristics. The results of our study also provide further support to the idea that dominant type of the WMS is a pervasive characteristic of the psyche and determines qualitatively possibilities and limits of the psychic processes. The results of this study are in agreement with the idea that WMS defines the “Great Divide.”
Similar content being viewed by others
Data Availability
The datasets analysed during the current study are available from the corresponding author on reasonable request.
References
Allik, J., & McCrae, R. R. (2002). A five-factor theory perspective. In R. R. McCrae & J. Allik (Eds.), The five-factor model of personality across cultures (pp. 303–322). Kluwer Academic/ Plenum Publishers.
Allport, G. W. (1937). Personality. A psychological interpretation. Henry Holt and Company.
Allport, G. W. (1961). Pattern and growth in personality. Holt, Rinehart and Winston.
Allport, G. W., & Odbert, H. S. (1936). Trait-names: A psycho-lexical study. Psychological Monographs, 47(211), v–171. https://doi.org/10.1037/h0093360
Arias, V. B., Garrido, L. E., Jenaro, C., Martinez-Molina, A., & Arias, B. (2020). A little garbage in, lots of garbage out: Assessing the impact of careless responding in personality survey data. Behavior Research Methods, 52, 2489–2505. https://doi.org/10.3758/s13428-020-01401-8
Arro, G. (2013). Peeking into personality test answers: Inter- and intraindividual variety in item interpretations. Integrative Psychological and Behavioral Science, 47, 56–76. https://doi.org/10.1007/s12124-012-9216-9
Ashton, M. C., & Lee, K. (2001). A theoretical basis for the major dimensions in personality. European Journal of Personality, 15, 327–353.
Batchelor, J. H., & Miao, C. (2016). Extreme response style: A meta-analysis. Journal of Organizational Psychology, 16(2), 51–62.
Baumeister, R. F., & Tice, D. M. (1988). Metatraits. Journal of Personality, 56(3), 571–598.
Bem, D. J., & Allen, A. (1974). On predicting some of the people some of the time: The search for cross-situational consistencies in behavior. Psychological Review, 81(6), 506–520.
Bergman, L. R., & El-Khouri, B. M. (2002). SLEIPNER: A statistical package for pattern-oriented analyses. Version 2.1. Stockholm University, Department of Psychology.
Block, J. (1995). A contrarian view of the Five-Factor approach to personality description. Psychological Bulletin, 117(2), 187–215.
Britt, T. W. (1993). Metatraits: Evidence relevant to the validity of the construct and its implications. Journal of Personality and Social Psychology, 65(3), 554–562.
Cattell, R. B. (1943a). The description of personality. I. Foundations of trait measurement. Psychological Review, 50(6), 559–594. https://doi.org/10.1037/h0057276
Cattell, R. B. (1943b). The description of personality: Basic traits resolved into clusters. Journal of Abnormal and Social Psychology, 38(4), 476–506. https://doi.org/10.1037/h0054116
Cattell, R. B. (1945). The description of personality: Principles and findings in factor analysis. American Journal of Psychology, 58(1), 69–90. https://doi.org/10.2307/1417576
Cicero, M. T. (1931). De finibus bonorum et malorum. In H. Rackham (Ed.), Cicero. De finibus bonorum et malorum. William Heinemann.
Conijn, J. M., Emons, W. H. M., van Assen, M. A. L. M., Pedersen, S. S., & Sijtsma, K. (2013). Explanatory, multilevel person-fit analysis of response consistency on the Spielberger State-Trait Anxiety Inventory. Multivariate Behavioral Research, 48(5), 692–718. https://doi.org/10.1080/00273171.2013.815580
Costa, P. T., & McCrae, R. R. (1985). The NEO Personality Inventory. Manual. Form S and Form R. Psychological Assessment Resources.
Costa, P. T., & McCrae, R. R. (1992). Revised NEO personality inventory (NEO-PI-R) and NEO five-factor inventory (NEO-FFI). Professional manual. Psychological Assessment Resources.
Diriwachter, R., Valsiner, J., & Sauck, C. (2005). Microgenesis in making sense of oneself: Constructive recycling of personality inventory items. Forum: Qualitative Social Research, 6(1), Art. 11. https://doi.org/10.17169/fqs-6.1.520
Emerson, G. J. (1979). The egalitarian paradox in public education. Canadian Journal of Education, 4(3), 53–59. https://doi.org/10.2307/1494477
Fiske, D. W. (1949). Consistency of the factorial structures of personality ratings from different sources. Journal of Abnormal and Social Psychology, 44(3), 329–344. https://doi.org/10.1037/h0057198
Furnham, A. (1986). Response bias, social desirability and dissimulation. Personality and Individual Differences, 7(3), 385–400.
Galton, F. (1884). Measurement of Character. Fortnightly Review, 42(212), 179–185.
Goldberg, L. R. (1982). From Ace to Zombie: Some explorations in the language of personality. In C. D. Spielberg & J. N. Butcher (Eds.), Advances in personality assessment (Vol. I, pp. 203–234). Lawrence Erlbaum Associates.
Goldberg, L. R. (1990). An alternative “description of personality”: The Big-Five factor structure. Journal of Personality and Social Psychology, 59(6), 1216–1229. https://doi.org/10.1037//0022-3514.59.6.1216
Goldberg, L. R. (1992). The development of markers for the Big-Five factor structure. Psychological Assessment, 4(1), 26–42. https://doi.org/10.1037/1040-3590.4.1.26
Goldberg, L. R. (1999). A broad-bandwidth, public domain, personality inventory measuring the lower-level facets of several Five-Factor models. In I. Mervielde, I. Deary, F. De Fruyt, & F. Ostendorf (Eds.), Personality psychology in Europe (Vol. 7, pp. 7–28). Tillburg University Press.
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006). The international personality item pool and the future of public-domain personality measures. Journal of Research in Personality, 40, 84–96. https://doi.org/10.1016/j.jrp.2005.08.007
Goldin, C. (1999). Egalitarianism and the returns to education during the Great Transformation of American Education. Journal of Political Economy, 107(S6), S65–S94. https://doi.org/10.1086/250104
Goody, J. (1977). The domestication of the savage mind. Cambridge University Press.
Hofstede, G. (2001). Culture’s consequences. Comparing values, behaviors, institutions, and organizations across nations (2nd ed.). Sage.
Holden, R. R., Marjanovic, Z., & Troister, T. (2019). Indiscriminate responding can increase effect sizes for clinical phenomena in nonclinical populations: A cautionary note. Journal of Psychoeducational Assessment, 37(4), 464–472. https://doi.org/10.1177/0734282918758809
Huang, J. L., Liu, M., & Bowling, N. A. (2015). Insufficient effort responding: Examining an insidious confound in survey data. Journal of Applied Psychology, 100(3), 828–845. https://doi.org/10.1037/a0038510
John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big Five trait taxonomy. In O. P. John, R. Robins, W., & L. A. Pervin (Eds.), Handbook of personality. Theory and research. Third edition. (pp. 114–158). Guilford Press.
Kalton, G., & Schuman, H. (1982). The effect of the question on survey responses: A review. Journal of the Royal Statistical Society: Series A, 145(1), 42–73.
Klages, L. (1929). The science of character. George Allen and Unwin Ltd.
Koffka, K. (1935). Principles of Gestalt psychology. Routledge & Kegan Paul.
Lienert, G. A., & Krauth, J. (1975). Configural frequency analysis as a statistical tool for defining types. Educational and Psychological Measurement, 35, 231–238. https://doi.org/10.1177/001316447503500201
Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 22(140), 4–55.
Liu, M., Harbaugh, A. G., Harring, J. R., & Hancock, G. R. (2017). The effect of extreme response and non-extreme response styles on testing measuremement invariance. Frontiers in Psychology, 8(726), 1–15. https://doi.org/10.3389/fpsyg.2017.00726
Lundmann, L., & Villadsen, J. W. (2016). Qualitative variations in personality inventories: Subjective understandings of items in a personality inventory. Qualitative Research in Psychology, 13(2), 166–187. https://doi.org/10.1080/14780887.2015.1134737
Luria, A. R. (1974). Ob istoricheskom razvitii poznavatel'nykh processov. Eksperimental'no-psikhologicheskoje issledovanije. Moscow: Nauka.
Luria, A. R. (1979). Jazyk i soznanije. Moscow: Izdatel'stvo Moskovskogo Universiteta.
Marjanovic, Z., Holden, R., Struthers, W., Cribbie, R., & Greenglass, E. (2015). The inter-item standard deviation (ISD): An index that discriminates between sonscientious and random responders. Personality and Individual Differences, 84, 79–83. https://doi.org/10.1016/j.paid.2014.08.021
Marjanovic, Z., & Holden, R. R. (2019). Differentiating conscientious from indiscriminate responders in existing NEO-Five Factor Inventory-3 data. Journal of Research in Personality, 81, 127–137. https://doi.org/10.1016/j.jrp.2019.05.009
McCrae, R. R., & Costa, P. T. (1984). Personality is transcontextual: A reply to Veroff. Personality and Social Psychology Bulletin, 10(2), 175–179. https://doi.org/10.1177/0146167284102002
McCrae, R. R., & Costa, P. T. (2003). Personality in adulthood. A Five-Factor Theory perspective (2nd ed.). Guilford Press.
McCrae, R. R., & Costa, P. T. (2008). The Five-Factor Theory of personality. In O. P. John, R. Robins, W., & L. A. Pervin (Eds.), Handbook of personality. (3rd ed., pp. 159–181). Guilford Press.
McCrae, R. R., & Costa, P. T. (2021). Understanding persons: From Stern’s personalistics to Five-Factor Theory. Personality and Individual Differences, 169, 109816. https://doi.org/10.1016/j.paid.2020.109816
McCrae, R. R., & Sutin, A. R. (2018). A Five-Factor Theory perspective on causal analysis. European Journal of Personality, 32(3), 151–166. https://doi.org/10.1002/per.2134
Meisenberg, G., & Williams, A. (2008). Are acquiescent and extreme response styles related to low intelligence and education? Personality and Individual Differences, 44, 1539–1550. https://doi.org/10.1016/j.paid.2008.01.010
Mõttus, R., Allik, J., & Realo, A. (2020). Do self-reports and informant-ratings measure the same personality constructs? European Journal of Psychological Assessment, 36(2), 289–295. https://doi.org/10.1027/1015-5759/a000516
Mõttus, R., Kandler, C., Bleidorn, W., Riemann, R., & McCrae, R. R. (2017). Personality traits below facets: The consensual validity, longitudinal stability, heritability, and utility of personality nuances. Journal of Personality and Social Psychology, 112(3), 474–490. https://doi.org/10.1037/pspp0000100
Mõttus, R., McCrae, R. R., Allik, J., & Realo, A. (2014). Cross-rater agreement on common and specific variance of personality scales and items. Journal of Research in Personality, 52, 47–54. https://doi.org/10.1016/j.jrp.2014.07.005
Nuzum, H., Ready, R. E., & Clark, L. A. (2019). Comparability of self- and other-rated personality structure. Psychological Assessment, 31(6), 741–750. https://doi.org/10.1037/pas0000696
Orne, M. T. (1962). On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist, 17(11), 776–783. https://doi.org/10.1037/h0043424
Oyserman, D., Coon, H. M., & Kemmelmeier, M. (2002). Rethinking individualism and collectivism. Evaluation of theoretical assumptions and meta-analyses. Psychological Bulletin, 128, 3–72. https://doi.org/10.1037//0033-2909.128.1.3
Pinsoneault, T. B. (1998). A variable response inconsistency scale and a true response inconsistency scale for Jesness Inventory. Psychological Assessment, 10(1), 21–32.
Podsakoff, P. M., MacKenzie, S. B., Podsakoff, N. P., & Lee, J.-Y. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879
Realo, A., Allik, J., & Vadi, M. (1997). The hierarchical structure of collectivism. Journal of Research in Personality, 31, 93–116.
Realo, A., Koido, K., Ceulemans, E., & Allik, J. (2002). Three components of individualism. European Journal of Personality, 16, 163–184. https://doi.org/10.1002/per.437
Roivainen, E. (2015). The Big Five factor marker adjectives are not especially popular words. Are they superior descriptors? Integrative Psychological and Behavioral Science, 49, 590–599. https://doi.org/10.1007/s12124-015-9311-9
Rosenbaum, P. J., & Valsiner, J. (2011). The un-making of a method: From rating scales to the study of psychological processes. Theory and Psychology, 21(1), 47–65. https://doi.org/10.1177/0959354309352913
Schroeders, U., Schmidt, C., & Gnambs, T. (2021). Detecting careless responding in survey data using stochastic gradient boosting. Educational and Psychological Measurement, 1-28. https://doi.org/10.1177/00131644211004708
Singelis, T. M. (1994). The measurement of independent and interdependent self-construals. Personality and Social Psychology Bulletin, 20(5), 580–591. https://doi.org/10.1177/0146167294205014
Sosnowska, J., Hofmans, J., & Lievens, F. (2021). Assessing personality dynamics in personnel selection. In J. F. Rauthman (Ed.), The handbook of personality dynamics and processes (pp. 1139–1157). Elsevier.
Stevens, S. S. (1946). On the theory of scales of measurement. Science, 103(2684), 677–680. https://doi.org/10.1126/science.103.2684.677
Taras, V., Sarala, R., Muchinsky, P., Kemmelmeyer, M., Singelis, T. M., Avsec, A., ... Sinclair, H. C. (2014). Opposite ends of the same stick? Multi-method test of the dimensionality of individualism and collectivism. Journal of Cross-Cultural Psychology, 45(2), 213-245. https://doi.org/10.1177/0022022113509132
Tellegen, A. (1988). The analysis of consistency in personality assessment. Journal of Personality, 56(3), 621–663.
Thurstone, L. L. (1929). Theory of attitude measurement. Psychological Review, 36(3), 222–241. https://doi.org/10.1037/h0070922
Thurstone, L. L. (1934). The vectors of mind. Psychological Review, 41(1), 1–31. https://doi.org/10.1037/h0075959
Toomela, A. (1996a). How culture transforms mind: A process of internalization. Culture and Psychology, 2(3), 285–305. https://doi.org/10.1177/1354067X9600200305
Toomela, A. (1996b). What characterizes language that can be internalized: A reply to Tomasello. Culture and Psychology, 2(3), 319–322. https://doi.org/10.1177/1354067X9600200307
Toomela, A. (2003). Relationships between personality structure, structure of word meaning, and cognitive ability: A study of cultural mechanisms of personality. Journal of Personality and Social Psychology, 85(4), 723–735. https://doi.org/10.1037/0022-3514.85.4.723
Toomela, A. (2017). Minu Ise areng: inimlapsest Inimeseks. (Development of My Self: From the human child to the Human.). Väike Vanker.
Toomela, A. (2020a). Culture, speech and My Self. Porcos ante Margaritas.
Toomela, A. (2020b). Studies in the mentality of literates: Searching for the cultural Great Divide at the individual level of analysis. Integrative Psychological and Behavioral Science, 54(1), 1–29. https://doi.org/10.1007/s12124-019-09503-5
Toomela, A., Barros-Filho, D., Bastos, A. C., Chaves, A. M., Ristum, M., Chaves, S., & Salomão, S. J. (2020a). Studies in the mentality of literates: 2. Conceptual structure, cognitive inhibition and verbal regulation of behavior. Integrative Psychological and Behavioral Science, 54(4), 880–902. https://doi.org/10.1007/s12124-020-09517-4
Toomela, A., Barros-Filho, D., Bastos, A. C., Chaves, A. M., Ristum, M., Chaves Santos, S., & Salomão, S. J. (2020b). Studies in the mentality of literates: 1. Conceptual structure and aspects of visual perception. Integrative Psychological and Behavioral Science, 54(2), 465–493. https://doi.org/10.1007/s12124-019-09511-5
Uher, J. (2013). Personality psychology: Lexical approaches, assessment methods, and trait concepts reveal only half of the story-why it is time for a paradigm shift. Integrative Psychological and Behavioral Science, 47, 1–55. https://doi.org/10.1007/s12124-013-9230-6
von Eye, A. (1990). Introduction to configural frequency analysis. The search for types and antitypes in cross-classifications. Cambridge University Press.
von Eye, A., Mair, P., & Mun, E.-Y. (2010). Advances in configural frequency analysis. Guilford Press.
Vygotsky, L. S. (1934). Myshlenije i rech. Psikhologicheskije issledovanija. (Thinking and speech. Psychological investigations.). Gosudarstvennoje Social'no-ekonomicheskoje Izdatel'stvo.
Vygotsky, L. S. (1935). Razvitije zhiteiskikh i nauchnyks ponjatii v shkol'nom vozraste. (The development of everyday and scientific concepts in the school age. Originally presented as a lecture in 1933). In L. V. Zankov, Z. I. Shif, & D. B. El'konin (Eds.), L. S. Vygotsky. Umstvennoje razvitije detei v processe obuchenija. (Cognitive development of children in the process of learning in the context of teaching.) (pp. 96–115). Gosudarstvennoje Uchebno-Pedagogicheskoje Izdatel'stvo.
Vygotsky, L. S. (1983). Istorija razvitija vyshikh psikhicheskih funkcii. (Originally written in 1931). In A. M. Matjushkina (Ed.), L. S. Vygotsky. Sobranije sochinenii. Tom 3. Problemy razvitija psikhiki. (pp. 5–328). Pedagogika.
Vygotsky, L. S., & Luria, A. (1994). Tool and symbol in child development. (Originally written in 1930). In R. v. d. Veer & J. Valsiner (Eds.), The Vygotsky reader. (pp. 99–174). Blackwell.
Vygotsky, L. S., & Luria, A. R. (1930). Etjudy po istorii povedenija. Obezjana. Primitiv. Rebjonok. Gosudarstvennoje Izdatel'stvo.
Watson, D. (1992). Correcting for acquiescent response bias in the absence of a balanced scale: An application to class consciousness. Sociological Methods and Research, 21(1), 52–88.
Zhang, Y., & Wang, Y. (2020). Validity of three IRT models for measuring and controlling extreme and midpoint response styles. Frontiers in Psychology, 11(271), 1–10. https://doi.org/10.3389/fpsyg.2020.00271
Acknowledgements
We are grateful to all participants who contributed their time and effort for this study. We thank Cristina Ceciarelli and Boipeba community for help in organizing the study. We thank Grete Arro, Johanna Hark, Tiit Kõnnussaar, Valeri Murnikov, and Valdar Tammik for research assistance.
Funding
Writing of this work was supported by the Tallinn University School of Natural Sciences and Health Grant Study of novel aspects of the state and development of speech function and by the Estonian Research Council Grant No IUT03-03 (Academic and personal development of an individual in the system of formal education) to Aaro Toomela.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical Approval
All procedures performed in this study were in accordance with the ethical standards of the national research committees and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Informed consent was obtained from all individual participants included in the study.
Conflict of Interest
No author of this paper has any conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Toomela, A., Filho, D.B., Bastos, A.C.S. et al. Studies in the Mentality of Literates: 3. Conceptual Structure and Nonsense of Personality Testing. Integr. psych. behav. 57, 117–150 (2023). https://doi.org/10.1007/s12124-022-09706-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12124-022-09706-3