Skip to main content

Advertisement

SpringerLink
Log in

The Effect of Face–Voice Gender Consistency on Impression Evaluation

  • Original Paper
  • Published:
Archives of Sexual Behavior Aims and scope Submit manuscript

Abstract

Face and voice are important information cues of interpersonal interaction. Most previous studies have investigated the cross-modal perception of face and voice from the perspective of cognitive psychology, but few empirical studies have focused on the effect of gender consistency of face and voice on the impression evaluation of the target from the perspective of social cognition. Based on the two-stage model of stereotype activation and the stereotype content model, this research examined the effects of face–voice gender consistency on impression evaluation (gender categorization and warmth competence evaluation) by using a cross-modal priming paradigm (Study 1, 20 males and 23 females, Mage = 21.00, SDage = 2.59), a sequential presentation task (Study 2a, 57 males and 70 females, Mage = 18.54, SDage = 1.54; Study 2b, 52 males and 51 females, Mage = 18.54, SDage = 1.36), and a simultaneous presentation task (Study 3, 51 males and 55 females, Mage = 23.58, SDage = 3.20), respectively. The results showed that: (1) there was a face–voice gender consistency preference in gender categorization, and the response of face–voice consistent condition was faster than that of inconsistent condition; (2) compared with the face–voice gender-inconsistent individuals, the participants showed a higher and more stable evaluation of the warmth and competence of the gender-consistent individuals, indicating the effect of matching preference of the face–voice gender consistency on the impression evaluation; (3) people paid more attention to the gender information of faces in the impression evaluation, and the female face could improve people’s evaluation on the target’s warmth and competence; (4) males were more intolerant of face–voice gender inconsistency when presented sequentially; the “voice needs to match face” effect was stronger for females when presented simultaneously. These findings, on the one hand, enrich and expand previous theories and research on cross-modal processing of face and voice from the perspective of social cognitive impression evaluation; on the other hand, these findings have important practical implications for impression management and decision-making in social interaction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data Availability

As for data, it can be obtained through contacting the corresponding author’s email.

References

  • Abbatecola, C., Beneyton, K., Gerardin, P., Kennedy, H., & Knoblauch, K. (2020). Voice and face gender perception engages multimodal integration viamultiple feedback pathways. biorxiv.org; bioRxiv. https://doi.org/10.1101/2020.01.07.884668

  • Aurélie, D. W., An-Sofie, C., Verolien, C., & Gijs, F. (2018). Spokespersons’ nonverbal behavior in times of crisis: The relative importance of visual and vocal cues. Journal of Nonverbal Behavior, 42(4), 441–460.

    Article  Google Scholar 

  • Azhin, S., Al-Jawad, N., Jassim, S., & Al-Talabani, A. (2013). Human gait gender classification based on fusing spatio-temporal and wavelet statistical features. Computer Science and Electronic Engineering Conference (CEEC), 2013, 5th. IEEE.

  • Belin, P., Boehme, B., & Mcaleer, P. (2017). The sound of trustworthiness: Acoustic-based modulation of perceived voice personality. PLoS ONE, 12(10), e0185651.

    Article  PubMed  PubMed Central  Google Scholar 

  • Blakemore, J. E. O. (2003). Children’s beliefs about violating gender norms: Boys shouldn’t look like girls, and girls shouldn’t act like boys. Sex Roles, 48, 411–419.

    Article  Google Scholar 

  • Bosson, J. K., & Vandello, J. A. (2011). Precarious manhood and its links to action and aggression. Current Directions in Psychological Science, 20(2), 82–86.

    Article  Google Scholar 

  • Burgering, M. A., van Laarhoven, T., Baart, M., & Vroomen, J. (2020). Fluidity in the perception of auditory speech: Cross-modal recalibration of voice gender and vowel identity by a talking face. Quarterly Journal of Experimental Psychology, 73(6), 957–967.

    Article  Google Scholar 

  • Carpinella, C. (2014). The gendered face of partisan politics: Consequences of intersecting gender and partisan stereotypes for politician perception. UCLA. ProQuest ID: Carpinella_ucla_0031D_12733. Merritt ID: ark:/13030/m5zw3tqh. Retrieved from https://escholarship.org/uc/item/1h21z0t6.

  • Chen, L. J., Jiang, J., Ren, Z. H., & Yuan, H. (2017). A meta-analysis of preference for sexual dimorphism of male’s face. Advances in Psychological Science, 25(4), 553–569.

    Article  Google Scholar 

  • Chu, Y. (2014). Individuals’s attention preference for dimorphism faces and affection of facial adaption. Doctoral dissertation, Southwest University.

  • Conroy-Beam, D., & Buss, D. M. (2016). Do mate preferences influence actual mating decisions? Evidence from computer simulations and three studies of mated couples. Journal of Personality and Social Psychology, 111(1), 53–66.

    Article  PubMed  Google Scholar 

  • Cuddy, A. J. C., Fiske, S. T., & Glick, P. (2008). Warmth and competence as universal dimensions of social perception: The stereotype content model and the bias map. Advances in Experimental Social Psychology, 40(07), 61–149.

    Article  Google Scholar 

  • Derous, E., Ryan, A. M., & Serlie, A. W. (2015). Double jeopardy upon resumé screening: When Achmed is less employable than Aïsha. Personnel Psychology, 68(3), 659–696.

    Article  Google Scholar 

  • Dickter, C., & Gyurovski, I. (2012). The effects of expectancy violations on early attention to race in an impression-formation paradigm. Social Neuroscience, 7(3), 240–251.

    Article  PubMed  Google Scholar 

  • Eagly, A. H., & Wood, W. (2012). Social role theory. In P. A. M. Van Lange, A. W. Kruglanski, & E. T. Higgins (Eds.), Handbook of theories of social psychology (pp. 458–476). Sage Publications Inc. https://doi.org/10.4135/9781446249222.n49

    Chapter  Google Scholar 

  • Fassnidge, C., Cecconi Marcotti, C., & Freeman, E. (2017). A deafening flash! visual interference of auditory signal detection. Consciousness and Cognition, 49, 15–24.

    Article  PubMed  Google Scholar 

  • Fischer, R., Plessow, F., Kunde, W., & Kiesel, A. (2010). Trial-to-trial modulations of the simon effect in conditions of attentional limitations: Evidence from dual tasks. Journal of Experimental Psychology Human Perception & Performance, 36(6), 1576–1594.

    Article  Google Scholar 

  • Fiske, S. T., Cuddy, A. J., Glick, P., & Xu, J. (2002). A model of (often mixed) stereotype content: Competence and warmth respectively follow from perceived status and competition. Journal of Personality & Social Psychology, 82(6), 878–902.

    Article  Google Scholar 

  • Freeman, J. B., & Ambady, N. (2011). When two become one: Temporally dynamic integration of the face and voice. Journal of Experimental Social Psychology, 47(1), 259–263.

    Article  Google Scholar 

  • Gao, J. (2020). The influence of face–voice gender stereotype expectancy on impression evaluation. Master’s thesis, Central China Normal University.

  • Garcia-Marques, T., Mackie, D. M., Maitner, A. T., & Claypool, H. M. (2016). Moderation of the familiarity-stereotyping effect: The role of stereotype fit. Social Cognition, 34(2), 81–96.

    Article  Google Scholar 

  • Gong, Y., Huang, Y. X., Wang, Y., & Luo, Y. J. (2011). Revision of the Chinese facial affective picture system. Chinese Mental Health Journal, 25(01), 49–55.

    Google Scholar 

  • Guan, J., & Cheng, J. T. (2011). Dimensionality and measure of stereotype content model and influence of involvement. Chinese Journal of Clinical Psychology, 19(2), 184–188.

    Google Scholar 

  • Hay, J. C., Pick, H. L., & Ikeda, K. (1965). Visual capture produced by prism spectacles. Psychonomic Science, 2, 215–216.

    Article  Google Scholar 

  • Hillairet de Boisferon, A., Dupierrix, E., Quinn, P. C., Lœvenbruck, H., Lewkowicz, D. J., Lee, K., & Pascalis, O. (2015). Perception of multisensory gender coherence in 6- and 9-month-old infants. Infancy, 1(20), 661–674.

    Article  Google Scholar 

  • Hommel, B., Proctor, R., & Vu, K. P. (2004). A feature-integration account of sequential effects in the simon task. Psychological Research Psychologische Forschung, 68(1), 1–17.

    Article  PubMed  Google Scholar 

  • Huang, L. M., Sacchi, D. L. M., & Sherman, J. W. (2016). On the formation of context-based person impressions. Journal of Experimental Social Psychology, 68, 146–156.

    Article  Google Scholar 

  • Huestegge, S. M., & Raettig, T. (2020). Crossing gender borders: Bidirectional dynamic interaction between face-based and voice-based gender categorization. Journal of Voice, 34(3). https://doi.org/10.1016/j.jvoice.2018.09.020

  • Jerónimo, R., Volpert, H. I., & Bartholow, B. D. (2016). Event-related potentials reveal early attention bias for negative, unexpected behavior. Social Neuroscience, 12(2), 232–236.

    Article  PubMed  PubMed Central  Google Scholar 

  • Katharina, V. K., Anne-Lise, G., & Leslie, U. (2006). Implicit multisensory associations influence voice recognition. PLoS Biology, 4(10), e326.

    Article  Google Scholar 

  • Kim, J., & Davis, C. (2012). Perceiving emotion from a talker: How face and voice work together. Visual Cognition, 20(8), 902–921.

    Article  Google Scholar 

  • Knowles, K. (2014). Evolutionary and cognitive approaches to voice perception in humans: Acoustic properties, personality and aesthetics. University of Stirling.

  • Krahé, B., & Papakonstantinou, L. (2020). Speaking like a man: Women’s pitch as a cue for gender stereotyping. Sex Roles, 82, 94–101.

    Article  Google Scholar 

  • Li, O., & Cheng, H. (2010). The retrospect and prospect of facial attractiveness. Advances in Psychological Science, 18(3), 472–479.

    Google Scholar 

  • Liu, X., & Zuo, B. (2006). Psychological mechanism of maintaining gender stereotypes. Advances in Psychological Science, 14(5), 456–461.

    Google Scholar 

  • Martin, C. L., Ruble, D. N., & Szkrybalo, J. (2002). Cognitive theories of early gender development. Psychological Bulletin, 128, 903–933.

    Article  PubMed  Google Scholar 

  • Masuda, S., Tsujii, T., & Watanabe, S. (2005). An interference effect of voice presentation on face gender discrimination task: Evidence from event-related potentials. International Congress, 1278, 156–159.

  • Mileva, M., Tompkinson, J. A., Watt, D., & Burton, A. M. (2017). Audiovisual integration in social evaluation. Journal of Experimental Psychology Human Perception & Performance, 44(1), 128–138.

    Article  Google Scholar 

  • Nabbijohn, A. N., MacMullin, L. N., Kwan, K. M. W., Santarossa, A., Peragine, D. E., Wong, I., & VanderLaan, D. P. (2020). Children’s bias in appraisals of gender-variant peers. Journal of Experimental Child Psychology, 196, 104865.

    Article  PubMed  Google Scholar 

  • Niculescu, A., Dijk, B., Nijholt, A., Li, H., & See, S. L. (2013). Making social robots more attractive: The effects of voice pitch, humor and empathy. International Journal of Social Robotics, 5(2), 171–191.

    Article  Google Scholar 

  • Phil, M. A., Alexander, T., Pascal, B., & Larson, C. R. (2014). How do you say ‘hello’? Personality impressions from brief novel voices. PLoS ONE, 9(3), e90779.

    Article  Google Scholar 

  • Plaks, J. E., Stroessner, S. J., Dweck, C. S., & Sherman, J. W. (2001). Person theories and attention allocation: Preferences for stereotypic versus counterstereotypic information. Journal of Personality and Social Psychology, 80(6), 876–893.

    Article  PubMed  Google Scholar 

  • Poulin-Dubois, D., Serbin, L. A., Kenyon, B., & Derbyshire, A. (1994). Infants’ intermodal knowledge about gender. Developmental Psychology, 30, 436–442.

    Article  Google Scholar 

  • Puts, D. A., Gaulin, S. J. C., & Verdolini, K. (2006). Dominance and the evolution of sexual dimorphism in human voice pitch. Evolution and Human Behavior, 27(4), 283–296.

    Article  Google Scholar 

  • Rennels, J. L., & Verba, S. A. (2019). Gender typicality of faces affects children’s categorization and judgments of women more than of men. Sex Roles, 81(5), 355–369.

    Article  Google Scholar 

  • Rezlescu, C., Penton, T., Walsh, V., Tsujimura, H., Scott, S. K., & Banissy, M. J. (2015). Dominant voices and attractive faces: The contribution of visual and auditory information to integrated person impressions. Journal of Nonverbal Behavior, 39(4), 355–370.

    Article  Google Scholar 

  • Schneider, T. R., Engel, A. K., & Debener, S. (2008). Multisensory identification of natural objects in a two-way crossmodal priming paradigm. Experimental Psychology, 55(2), 121–132.

    Article  PubMed  Google Scholar 

  • Skrinda, I., Krama, T., Kecko, S., Moore, F. R., Kaasik, A., Meija, L., Lietuvietis, V., Rantala, M. J., & Krams, I. (2014). Body height, immunity, facial and vocal attractiveness in young men. Die Naturwissenschaften, 101(12), 1017–1025.

    Article  PubMed  Google Scholar 

  • Smith, H. M. J., Dunn, A. K., Baguley, T., & Stacey, P. C. (2016). Matching novel face and voice identity using static and dynamic facial images. Attention, Perception, & Psychophysics, 78(3), 868–879.

    Article  Google Scholar 

  • Stormer, V. S., & Alvarez, G. A. (2016). Attention alters perceived attractiveness. Psychological Science, 27, 563–571.

    Article  PubMed  Google Scholar 

  • Tal-Or, N., & Gal-Oz, A. (2017). Evaluating the evaluator: The effects of the valence, sequence and target of evaluations on the perception of the evaluator. International Journal of Psychology, 54(2), 80–87.

    PubMed  Google Scholar 

  • Titze, I. R., & Martin, D. W. (1998). Principles of voice production. Journal of the Acoustical Society of America, 104(3), 1148.

    Article  Google Scholar 

  • Todorov, A., Olivola, C. Y., Dotsch, R., & Mende-Siedlecki, P. (2015). Social attributions from faces: Determinants, consequences, accuracy, and functional significance. Annual Review of Psychology, 66(1), 519–545.

    Article  PubMed  Google Scholar 

  • Walker, M., & Wänke, M. (2017). Caring or daring? Exploring the impact of facial masculinity/femininity and gender category information on first impressions. PLoS ONE, 12(10), e0181306.

    Article  PubMed  PubMed Central  Google Scholar 

  • Wang, Y., Qian, M., Nabbijohn, A. N., Wen, F., Fu, G., Zuo, B., & VanderLaan, D. P. (2022). Culture influences the development of children’s gender-related peer preferences: Evidence from China and Thailand. Developmental Science, 25(4), e13221.

    Article  PubMed  Google Scholar 

  • Wen, F., & Zuo, B. (2012). The effects of transformed gender facial features on face preference of college students: Based on the test of computer graphics and eye movement tracks. Acta Psychologica Sinica, 44(1), 14–29.

    Article  Google Scholar 

  • Wen, F. F., Zuo, B., Ma, S., & Xie, Z. (2020a). Own-group bias in face recognition. Advances in Psychological Science, 28(7), 1164–1171.

    Article  Google Scholar 

  • Wen, F., Zuo, B., Wang, Y., Wu, Y., & Ma, S. (2020b). The (continuous) nature of perceived gender counter-stereotype: A threshold model of gender stereotype maintenance. Archives of Sexual Behavior, 49, 2511–2530.

    Article  PubMed  Google Scholar 

  • Wigboldus, D. H. J., Sherman, J. W., Franzese, H. L., & Knippenberg, A. V. (2004). Capacity and comprehension: Spontaneous stereotyping under cognitive load. Social Cognition, 22(3), 292–309.

    Article  Google Scholar 

  • Winter, S., Webster, B., & Cheung, P. K. E. (2008). Measuring Hong Kong undergraduate students’ attitudes towards transpeople. Sex Roles, 59, 670–683.

    Article  Google Scholar 

  • Yovel, G., & Belin, P. (2013). A unified coding strategy for processing faces and voices. Trends in Cognitive Sciences, 17(6), 263–271.

    Article  PubMed  PubMed Central  Google Scholar 

  • Zebrowitz-Mcarthur, L., & Montepare, J. M. (1989). Contributions of a babyface and a childlink voice to impressions of moving and talking faces. Journal of Nonverbal Behavior, 13(3), 189–203.

    Article  Google Scholar 

  • Zhang, J. (2022). Femme/butch/androgyne identity and preferences for femininity across face, voice, and personality traits in Chinese lesbian and bisexual women. Archives of Sexual Behavior, 51, 3485–3495.

    Article  PubMed  Google Scholar 

  • Zhang, X. B., & Zuo, B. (2012). Two-stage model of stereotype activation based on face perception. Acta Psychologica Sinica, 44(9), 57–69.

    Google Scholar 

  • Zosuls, K. M., Ruble, D. N., Tamis-LeMonda, C. S., Shrout, P. E., Bornstein, M. H., & Greulich, F. K. (2009). The acquisition of gender labels in infancy: Implications for gender-typed play. Developmental Psychology, 45, 688–701.

    Article  PubMed  PubMed Central  Google Scholar 

  • Zuckerman, M., & Sinicropi, V. (2011). When physical and vocal attractiveness differ: Effects on favorability of interpersonal impressions. Journal of Nonverbal Behavior, 35(2), 75–86.

    Article  Google Scholar 

  • Zuo, B., Dai, T. T., Wen, F. F., & Suo, Y. X. (2015). The big two model in social cognition. Psychological Research Psychologische Forschung, 38(4), 1019–1023.

    Google Scholar 

Download references

Funding

Funding support came from the General Program of National Natural Science Foundation of China (32271128) and the National Social Science Major Project of China (18ZDA331).

Author information

Author notes

  1. Fangfang Wen and Jia Gao are the co-first authors.

Authors and Affiliations

  1. School of Psychology, Center for Studies of Social Psychology, Central China Normal University, Wuhan, 430079, China

    Fangfang Wen, Jia Gao, Wenlin Ke, Bin Zuo, Yu Dai, Yiyan Ju & Jiahui Long

Authors
  1. Fangfang Wen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jia Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wenlin Ke
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bin Zuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yu Dai
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yiyan Ju
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jiahui Long
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bin Zuo.

Ethics declarations

Conflict of interest

The authors have no financial or proprietary interests in any material discussed in this article.

Ethics Approval

The Center for Studies of Social Psychology of Central China Normal University (ethics approval number: CSSP-2019062) approved our research, and we followed all APA ethical standards in the conduct of the study.

Consent to Participate

Informed consent was obtained from all individual participants included in the study. The participant has consented to the submission of the case report to the journal.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wen, F., Gao, J., Ke, W. et al. The Effect of Face–Voice Gender Consistency on Impression Evaluation. Arch Sex Behav 52, 1123–1139 (2023). https://doi.org/10.1007/s10508-022-02524-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10508-022-02524-z

Keywords

Search

Navigation