Abstract
We examined the factorial validity and reliability of the Croatian version of the Test of Self-Conscious Affect-3 (TOSCA-3). We then explored gender differences in self-conscious emotions as assessed by the TOSCA-3 and the agreement between TOSCA-3-assessed and subjectively perceived proneness to shame and guilt. A total number of 1214 Croatian students from diverse universities completed online questionnaires. The observed data showed a close fit to the proposed model. Internal consistency was good for all subscales. Shame and guilt domain were moderately correlated. Women reported significantly higher shame-proneness and guilt-proneness than men. Differences in detachment domain were small but statistically significant. No significant gender differences were observed for alpha pride, beta pride, and externalization domain. The agreement between TOSCA-3-assessed and subjectively perceived shame-proneness, as well as guilt-proneness, was poor. Men were more prone to incorporate (TOSCA-3-assessed) shame experiences under the word guilt. Our findings suggest that the Croatian version of the TOSCA-3 is a reliable measure of self-conscious emotions. Gender differences in TOSCA-3-assessed shame and guilt favor women, but the more threatening nature of TOSCA-3 scenarios to women’s identities and conforming to gender stereotypes must be taken into account. Subjectively perceived shame- and guilt-proneness should not be used interchangeably with TOSCA-3-assessed shame- and guilt-proneness, respectively.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Altman, D. G., & Bland, J. M. (1983). Measurement in medicine: The analysis of method comparison studies. The Statistician, 32(3), 307. https://doi.org/10.2307/2987937.
An, S., Ji, L.-J., Marks, M., & Zhang, Z. (2017). Two sides of emotion: Exploring positivity and negativity in six basic emotions across cultures. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00610.
Arigo, D., Pagoto, S., Carter-Harris, L., Lillie, S. E., & Nebeker, C. (2018). Using social media for health research: Methodological and ethical considerations for recruitment and intervention delivery. Digital Health, 4, 205520761877175. https://doi.org/10.1177/2055207618771757.
Averill, P. M., Diefenbach, G. J., Stanley, M. A., Breckenridge, J. K., & Lusby, B. (2002). Assessment of shame and guilt in a psychiatric sample: A comparison of two measures. Personality and Individual Differences, 32(8), 1365–1376. https://doi.org/10.1016/s0191-8869(01)00124-6.
Belyaev, D., & Roca, Z. (2011). Contemporary Croatia: Development challenges in a socio-cultural perspective. Lisboa: Edições Universitárias Lusófonas.
Benetti-Mcquoid, J., & Bursik, K. (2005). Individual differences in experiences of and responses to guilt and shame: Examining the lenses of gender and gender role. Sex Roles, 53(1–2), 133–142. https://doi.org/10.1007/s11199-005-4287-4.
Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606. https://doi.org/10.1037/0033-2909.88.3.588.
Bland, J. M., & Altman, D. (1986). Statistical methods for assessing agreement between two methods of clinical measurement. The Lancet, 327(8476), 307–310. https://doi.org/10.1016/s0140-6736(86)90837-8.
Blatt, S. J. (1990). Interpersonal relatedness and self-definition: Two personality configurations and their implications for psychopathology and psychotherapy. In J. L. Singer (Ed.), Repression and dissociation (pp. 299–335). Chicago: University of Chicago Press.
Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005.
Campos, J. J. (1995). Foreword. In J. P. Tangney & K. W. Fischer (Eds.), Self-conscious emotions: The psychology of shame, guilt, embarrassment, and pride. New York: Guilford Press.
Deng, X., You, Y., & Sai, L. (2019). Subcultural differences in processing social and non-social positive emotions between Han and Uygur Chinese: An ERP study. Frontiers in Psychology, 10. https://doi.org/10.3389/fpsyg.2019.02041.
Elison, J., Garofalo, C., & Velotti, P. (2014). Shame and aggression: Theoretical considerations. Aggression and Violent Behavior, 19(4), 447–453. https://doi.org/10.1016/j.avb.2014.05.002.
Else-Quest, N. M., Higgins, A., Allison, C., & Morton, L. C. (2012). Gender differences in self-conscious emotional experience: A meta-analysis. Psychological Bulletin, 138(5), 947–981. https://doi.org/10.1037/a0027930.
Eterović, M. (2020). Recognizing the role of defensive processes in empirical assessment of shame. Psychoanalytic Psychology. Advance online publication. https://doi.org/10.1037/pap0000306.
Eterović, M., Medved, V., Bilić, V., Kozarić-Kovačić, D., & Žarković, N. (2019). Poor agreement between two commonly used measures of shame- and guilt-proneness. Journal of Personality Assessment, 1–9. https://doi.org/10.1080/00223891.2019.1585361.
Eterović, M., Medved, V., & Bilić, V. (in press). Unresponsiveness to intensified shame-inducing scenarios helps distinguish genuine from defensive low shame. Psychoanalytic Psychology.
Evans, R. G. (1984). Hostility and sex guilt: Perceptions of self and others as a function of gender and sex-role orientation. Sex Roles, 10(3–4), 207–215. https://doi.org/10.1007/BF00287775.
Ferguson, T. J., & Crowley, S. L. (1997). Gender differences in the organization of guilt and shame. Sex Roles: A Journal of Research, 37(1–2), 19–44. https://doi.org/10.1023/A:1025684502616.
Ferguson, T. J., & Eyre, H. L. (2000). Engendering gender differences in shame and guilt: Stereotypes, socialization, and situational pressures. Gender and Emotion, 254–276. https://doi.org/10.1017/cbo9780511628191.013.
Ferguson, T. J., Eyre, H. L., & Ashbaker, M. (2000). Unwanted identities: A key variable in shame–anger links and gender differences in shame. Sex Roles: A Journal of Research, 42(3–4), 133–157. https://doi.org/10.1023/A:1007061505251.
Fontaine, J. R. J., Luyten, P., Boeck, P. D., & Corveleyn, J. (2001). The test of self-conscious affect: Internal structure, differential scales and relationships with long-term affects. European Journal of Personality, 15(6), 449–463. https://doi.org/10.1002/per.428.
Giavarina, D. (2015). Understanding Bland Altman analysis. Biochemia Medica, 25(2), 141–151. https://doi.org/10.11613/bm.2015.015.
Gouva, M., Kaltsouda, A., & Paschou, A. (2012). Psychometric evaluation of the Greek version of TOSCA-3 to measure shame and guilt. Interscientific Health Care, 4(3), 105–113.
Gross, C., & Hansen, N. (2000). Clarifying the experience of shame: The role of attachment style, gender, and investment in relatedness. Personality and Individual Differences, 28(5), 897–907. https://doi.org/10.1016/s0191-8869(99)00148-8.
Hall, J. A., Murphy, N. A., & Mast, M. S. (2006). Recall of nonverbal cues: Exploring a new definition of interpersonal sensitivity. Journal of Nonverbal Behavior, 30, 141–155. https://doi.org/10.1037/e633912013-728.
Harder, D. W. (1995). Shame and guilt assessment, and relationships of shame- and guilt-proneness to psychopathology. In J. P. Tangney & K. W. Fischer (Eds.), Self-conscious emotions: The psychology of shame, guilt, embarrassment, and pride (pp. 368–392). New York: Guilford Press.
Harder, D. W., Cutler, L., & Rockart, L. (1992). Assessment of shame and guilt and their relationships to psychopathology. Journal of Personality Assessment, 59(3), 584–604. https://doi.org/10.1207/s15327752jpa5903_12.
Hasui, C., Kitamura, T., Tamaki, A., Takahashi, M., Masuda, S., & Ozeki, N. (2009). The test of self-conscious Affect-3 in Japanese University students. The Journal of Nervous and Mental Disease, 197(6), 458–460. https://doi.org/10.1097/nmd.0b013e3181a61f52.
Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modelling: Guidelines for determining model fit. Electronic Journal of Business Research Methods, 6(1), 53–60.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118.
Izard, C. E. (1977). Human emotions. New York: Plenum Press.
Kim, S., Thibodeau, R., & Jorgensen, R. S. (2011). Shame, guilt, and depressive symptoms: A meta-analytic review. Psychological Bulletin, 137(1), 68–96. https://doi.org/10.1037/a0021466.
Kocherscheidt, K., Fiedler, P., Kronmüller, K.-T., Backenstraß, M., & Mundt, C. (2002). Zur empirischen Unterscheidung von Scham und Schuld [on differentiating shame and guilt: Description and validation of the German version of the TOSCA]. Zeitschrift Für Differentielle Und Diagnostische Psychologie, 23(2), 217–224. https://doi.org/10.1024//0170-1789.23.2.217.
Konrath, S., Meier, B. P., & Bushman, B. J. (2014). Development and validation of the single item narcissism scale (SINS). PLoS One, 9(8), e103469. https://doi.org/10.1371/journal.pone.0103469.
Las Hayas, C., Guillén, V., Gonzaléz-Pinto, A., Zamega, G., & Guimón, J. (2005). Preliminary validation in Spanish of the test of self-conscious affect (TOSCA). Avances en Salud Mental Relacional, 4(3). Available at: http://www.bibliopsiquis.com/asmr/0403/val0403.pdf
Leith, K. P., & Baumeister, R. F. (1998). Empathy, shame, guilt, and narratives of interpersonal conflicts: Guilt-prone people are better at perspective taking. Journal of Personality, 66, 1–37. https://doi.org/10.1111/1467-6494.00001.
Lewis, H. B. (1971). Shame and guilt in neurosis. New York: International Universities Press.
Lewis, H. (1987). Shame and the narcissistic personality. In D. Nathanson (Ed.), The many faces of shame (pp. 93–132). New York: Guilford Press.
Lewis, M., Sullivan, M. W., Stanger, C., & Weiss, M. (1989). Self development and self-conscious emotions. Child Development, 60(1), 146–156. https://doi.org/10.2307/1131080.
Linden, S. V. D., & Rosenthal, S. A. (2016). Measuring narcissism with a single question? A replication and extension of the single-item narcissism scale (SINS). Personality and Individual Differences, 90, 238–241. https://doi.org/10.1016/j.paid.2015.10.050.
Lutwak, N., & Ferrari, J. R. (1996). Moral affect and cognitive processes: Differentiating shame from guilt among men and women. Personality and Individual Differences, 21(6), 891–896. https://doi.org/10.1016/s0191-8869(96)00135-3.
Luyten, P., Fontaine, J. R., & Corveleyn, J. (2002). Does the test of self-conscious affect (TOSCA) measure maladaptive aspects of guilt and adaptive aspects of shame? An empirical investigation. Personality and Individual Differences, 33(8), 1373–1387. https://doi.org/10.1016/s0191-8869(02)00197-6.
Mcafee, E. (2018). Shame: The emotional basis of library anxiety. College & Research Libraries, 79(2), 237–256. https://doi.org/10.5860/crl.79.2.237.
Moore, D. L., & Tarnai, J. (2002). Evaluating nonresponse error in mail surveys. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 197–211). New York: John Wiley & Sons.
Nathanson, D. L. (1994). Shame and pride: Affect, sex, and the birth of the self. New York: W.W. Norton & Company.
Nyström, M. B. T., Kjellberg, E., Heimdahl, U., & Jonsson, B. (2018). Shame and interpersonal sensitivity: Gender differences and the association between internalized shame coping strategies and interpersonal sensitivity. Bulletin of the Menninger Clinic, 82(2), 137–155. https://doi.org/10.1521/bumc.2018.82.2.137.
Online Randomization Tools. (2019) Retrieved May 11, 2019 from: https://onlinerandomtools.com/generate-random-numbers
Scheff, T. J. (1988). Shame and conformity: The deference-emotion system. American Sociological Review, 53(3), 395–406. https://doi.org/10.2307/2095647.
Schumacker, R. E., & Lomax, R. G. (2004). A beginner's guide to structural equation modeling (2nd ed.). Lawrence Erlbaum Associates Publishers.
Shields, S. A. (2002). Speaking from the heart: Gender and the social meaning of emotion. Cambridge, England: Cambridge University Press.
Streiner, D. L. (2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80(1), 99–103. https://doi.org/10.1207/s15327752jpa8001_18.
Strömsten, L. M. J., Henningsson, M., Holm, U., & Sundbom, E. (2009). Assessment of self-conscious emotions: A Swedish psychometric and structure evaluation of the test of self-conscious affect (TOSCA). Scandinavian Journal of Psychology, 50(1), 71–77. https://doi.org/10.1111/j.1467-9450.2008.00674.x.
Tangney, J. P. (1990). Assessing individual differences in proneness to shame and guilt: Development of the self-conscious affect and attribution inventory. Journal of Personality and Social Psychology, 59(1), 102–111. https://doi.org/10.1037/0022-3514.59.1.102.
Tangney, J. P. (1995). Shame and guilt in interpersonal relationships. In J. P. Tangney & K. W. Fischer (Eds.), Self-conscious emotions: The psychology of shame, guilt, embarrassment, and pride (pp. 114–139). Guilford Press.
Tangney, J. P. (1996). Conceptual and methodological issues in the assessment of shame and guilt. Behaviour Research and Therapy, 34(9), 741–754. https://doi.org/10.1016/0005-7967(96)00034-4.
Tangney, J. P., & Dearing, R. L. (2002). Shame and guilt. New York: The Guilford Press. https://doi.org/10.4135/9781412950664.n388.
Tangney, J. P., Wagner, P. E., Hill-Barlow, D., Marschall, D. E., & Gramzow, R. (1996). Relation of shame and guilt to constructive versus destructive responses to anger across the lifespan. Journal of Personality and Social Psychology, 70(4), 797–809. https://doi.org/10.1037/0022-3514.70.4.797.
Tangney, J. P., Dearing, R., Wagner, P., & Gramzow, R. (2000). The test of self-conscious affect (TOSCA-3). Fairfax (VA): George Mason University. https://doi.org/10.1037/t06464-000.
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbachs alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd.
Tignor, S. M., & Colvin, C. R. (2016). The interpersonal adaptiveness of dispositional guilt and shame: A meta-analytic investigation. Journal of Personality, 85(3), 341–363. https://doi.org/10.1111/jopy.12244.
Tracy, J. L., & Robins, R. W. (2004). Putting the self into self-conscious emotions: A theoretical model. Psychological Inquiry, 15(2), 103–125. https://doi.org/10.1207/s15327965pli1502_01.
Ullman, J. B. (2001). Structural equation modeling. In B. G. Tabachnick & L. S. Fidell (Eds.), Using multivariate statistics (4th ed., pp. 653–771). Needham Heights, MA: Allyn & Bacon.
Ursachi, G., Horodnic, I. A., & Zait, A. (2015). How reliable are measurement scales? External factors with indirect influence on reliability estimators. Procedia Economics and Finance, 20, 679–686. https://doi.org/10.1016/s2212-5671(15)00123-9.
Velotti, P., Garofalo, C., Bottazzi, F., & Caretti, V. (2018). Faces of shame: Implications for self-esteem, emotion regulation, aggression, and well-being. Interpersonal and Social Experiences, 151, 87–100. https://doi.org/10.1080/00223980.2016.1248809.
Wheaton, B., Muthen, B., Alwin, D. F., & Summers, G. F. (1977). Assessing reliability and stability in panel models. Sociological Methodology, 8, 84. https://doi.org/10.2307/270754.
Woien, S. L., Ernst, H. A., Patock-Peckham, J. A., & Nagoshi, C. T. (2003). Validation of the TOSCA to measure shame and guilt. Personality and Individual Differences, 35(2), 313–326. https://doi.org/10.1016/s0191-8869(02)00191-5.
Wong, Y., & Tsai, J. (2007). Cultural models of shame and guilt. In J. L. Tracy, R. W. Robins, & J. P. Tangney (Eds.), The self-conscious emotions: Theory and research (pp. 209–223). Guilford Press.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee (Ethics committee of the Dubrava University Hospital, Zagreb, Croatia) and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Eterović, M., Marinić, L.M., Medved, V. et al. Croatian version of the Test of self-conscious affect-3: Gender differences and agreement with subjectively perceived shame- and guilt-proneness. Curr Psychol 41, 5991–6002 (2022). https://doi.org/10.1007/s12144-020-01084-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12144-020-01084-6