Advertisement

Neural time course and brain sources of facial attractiveness vs. trustworthiness judgment

  • Manuel G. Calvo
  • Aida Gutiérrez-García
  • David Beltrán
Research Article
  • 46 Downloads

Abstract

Prior research has shown that the more (or less) attractive a face is judged, the more (or less) trustworthy the person is deemed and that some common neural networks are recruited during facial attractiveness and trustworthiness evaluation. To interpret the relationship between attractiveness and trustworthiness (e.g., whether perception of personal trustworthiness may depend on perception of facial attractiveness), we investigated their relative neural processing time course. An event-related potential (ERP) paradigm was used, with localization of brain sources of the scalp neural activity. Face stimuli with a neutral, angry, happy, or surprised expression were presented in an attractiveness judgment, a trustworthiness judgment, or a control (no explicit social judgment) task. Emotional facial expression processing occurred earlier (N170 and EPN, 150-290 ms post-stimulus onset) than attractiveness and trustworthiness processing (P3b, 400-700 ms). Importantly, right-central ERP (C2, C4, C6) differences reflecting discrimination between “yes” (attractive or trustworthy) and “no” (unattractive or untrustworthy) decisions occurred at least 400 ms earlier for attractiveness than for trustworthiness, in the absence of LRP motor preparation differences. Neural source analysis indicated that facial processing brain networks (e.g., LG, FG, and IPL—extending to pSTS), also right-lateralized, were involved in the discrimination time course differences. This suggests that attractiveness impressions precede and might prime trustworthiness inferences and that the neural time course differences reflect truly facial encoding processes.

Keywords

Trustworthiness Attractiveness Time course Event-related potential Brain sources Facial expression 

Notes

Acknowledgements

The authors thank Patricia Alvarez-Plaza for their help in running the experiment.

Funding

This research was funded by the Spanish Ministerio de Economía y Competitividad, Grant PSI2014-54720-P, awarded to Manuel G. Calvo.

Compliance with ethical standards

Disclosure of interests

The authors declare no conflict of interests.

Supplementary material

13415_2018_634_MOESM1_ESM.xlsx (13 kb)
ESM S1 Supplemental Dataset_Low-level Properties of Faces and Masks.xlsx (Excel format). (XLSX 12 kb)
13415_2018_634_MOESM2_ESM.xlsx (92 kb)
ESM S2 Supplemental Dataset_Attractiveness and Trustworthiness Ratings.xlsx (Excel format). (XLSX 92 kb)
13415_2018_634_MOESM3_ESM.xlsx (26 kb)
ESM S3 Supplemental Dataset_Responses, ERPs, and Sources.xlsx (Excel format). (XLSX 25 kb)
13415_2018_634_MOESM4_ESM.xlsx (87 kb)
ESM S4 Supplemental Dataset_First and Second Exposures.xlsx (Excel format). (XLSX 86 kb)
13415_2018_634_Fig5_ESM.png (199 kb)
ESM 5

(PNG 198 kb)

13415_2018_634_MOESM5_ESM.tif (274 kb)
High resolution image (TIF 274 kb)

References

  1. Beltrán, D., & Calvo, M. G. (2015). Brain signatures of perceiving a smile: Time course and source localization. Human Brain Mapping, 36, 4287-4303.CrossRefPubMedGoogle Scholar
  2. Bieniek, M. M., Frei, L. S., & Rousselet, G. A. (2013). Early ERPs to faces: Aging, luminance, and individual differences. Frontiers in Psychology, 4, 268.  https://doi.org/10.3389/fpsyg.2013.00268
  3. Bonnefon, J. F., Hopfensitz, A., & De Neys, W. (2013). The modular nature of trustworthiness detection. Journal of Experimental Psychology: General, 142, 143-150.CrossRefGoogle Scholar
  4. Bonnefon, J. F., Hopfensitz, A., & De Neys, W. (2017). Can we detect cooperators by looking at their face? Current Directions in Psychological Science, 26, 276-281.CrossRefGoogle Scholar
  5. Brunet, D., Murray, M. M., & Michel, C. M. (2011). Spatiotemporal analysis of multichannel EEG: CARTOOL. Computational Intelligence and Neuroscience, 2011, 1–15. 813870.  https://doi.org/10.1155/2011/813870 CrossRefGoogle Scholar
  6. Bzdok, D., Langner, R., Caspers, S., Kurz, F., Habel, U., Zilles, K., et al. (2011). ALE meta-analysis on facial judgments of trustworthiness and attractiveness. Structure and Function, 215, 209–223.CrossRefGoogle Scholar
  7. Calvo, M. G., & Beltrán, D. (2013). Recognition advantage of happy faces: Tracing the neurocognitive processes. Neuropsychologia, 51, 2051-2060.CrossRefPubMedGoogle Scholar
  8. Calvo, M. G., & Beltrán, D. (2014). Brain lateralization of holistic versus analytic processing of emotional facial expressions. NeuroImage, 92, 237-247.CrossRefPubMedGoogle Scholar
  9. De Neys, W., Hopfensitz, A., & Bonnefon, J. F. (2017). Split-second trustworthiness detection from faces in an economic game. Experimental Psychology, 64, 231-239.CrossRefPubMedGoogle Scholar
  10. De Vega, M., Beltrán, D., García-Marco, E., & Marrero, H. (2015). Neurophysiological traces of the reader′s geographical perspective associated with the deictic verbs of motion to go and to come. Brain Research, 1597, 108–118.CrossRefPubMedGoogle Scholar
  11. Dzhelyova, M., Perrett, D. I., & Jentzsch, I. (2012). Temporal dynamics of trustworthiness perception. Brain Research, 1435, 81–90.CrossRefPubMedGoogle Scholar
  12. Faugeras, F., & Naccache, L. (2016). Dissociating temporal attention from spatial attention and motor response preparation: A high-density EEG study. NeuroImage, 124, 947-957.CrossRefPubMedGoogle Scholar
  13. Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191.CrossRefPubMedGoogle Scholar
  14. Freeman, J. B., Stolier, R. M., Inbretsen, Z. A., & Hehman, E. A. (2014). Amygdala responsivity to high-level social information from unseen faces. Journal of Cognitive Neuroscience, 34, 10573–10581.Google Scholar
  15. Fusar-Poli, P., Placentino, A., Carletti, F., Landi, P., Allen, P., Surguladze, S., et al. (2009). Functional atlas of emotional faces processing: A voxel-based meta-analysis of 105 functional magnetic resonance imaging studies. Journal of Psychiatry and Neuroscience, 34, 418-432.PubMedGoogle Scholar
  16. Grave de Peralta, R., González, S., Lantz, G., Michel, C. M., & Landis, T. (2001). Noninvasive localization of electromagnetic epileptic activity. I. Method descriptions and simulations. Brain Topography, 14, 131–137.CrossRefGoogle Scholar
  17. Gutiérrez-García, A., Beltrán, D., & Calvo, M. G. (2018). Facial attractiveness impressions precede trustworthiness inferences: Lower detection thresholds and faster decision latencies. Cognition and Emotion.  https://doi.org/10.1080/02699931.2018.1444583
  18. Hajcak, G., Weinberg, A., MacNamara, A., & Foti, D. (2012). ERPs and the study of emotion. In S. J. Luck & E. S. Kappenman (eds.), The Oxford handbook of event-related potential components (pp. 441-474). New York: Oxford University Press.Google Scholar
  19. Haxby, J. V., Hoffman, E. A., & Gobbini, M. I. (2000). The distributed human neural system for face perception. Trends in Cognitive Sciences, 4, 223e233.Google Scholar
  20. Hinojosa, J. A., Mercado, F., & Carretié, L. (2015). N170 sensitivity to facial expression: A meta-analysis. Neuroscience and Biobehavioral Reviews, 55, 498-509.CrossRefPubMedGoogle Scholar
  21. Lischke, A., Junge, M., Hamm, A. O., & Weymar, M. (2018). Enhanced processing of untrustworthiness in natural faces with neutral expressions. Emotion, 18, 181-189.CrossRefPubMedGoogle Scholar
  22. Lundqvist, D., Flykt, A., & Öhman, A. 1998. The Karolinska Directed Emotional Faces – KDEF. CD-ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet, Stockholm, Sweden. ISBN 91-630-7164-9.Google Scholar
  23. Ma, Q., & Hu, Y. (2015). Beauty matters: Social preferences in a three-person ultimatum game. PLoS ONE, 10(5): e0125806.  https://doi.org/10.1371/journal.pone.0125806 CrossRefPubMedPubMedCentralGoogle Scholar
  24. Marzi, T., Righi, S., Ottonello, S., Cincotta, S. M., & Viggiano, M. P. (2014). Trust at first sight: Evidence from ERPs. Social Cognitive and Affective Neuroscience, 9, 63-72.CrossRefPubMedGoogle Scholar
  25. Marzi, T., & Viggiano, M. P. (2010). When memory meets beauty: Insights from event-related potentials. Biological Psychology, 84, 192–205.CrossRefPubMedGoogle Scholar
  26. Maurer, D., O'Craven, K. M., Le Grand, R., Mondloch, C. J., Springer, M. V., Lewis, T. L., Grady, C. L. (2007). Neural correlates of processing facial identity based on features versus their spacing. Neuropsychologia, 45, 1438–1451.CrossRefPubMedGoogle Scholar
  27. Mende-Siedlecki, P., Said, C. P., & Todorov, A. (2013). The social evaluation of faces: A meta-analysis of functional neuroimaging studies. Social Cognitive and Affective Neuroscience, 8, 285-299.CrossRefPubMedGoogle Scholar
  28. Michel, C. M., Murray, M. M., Lantz, G., Gonzalez, S., Spinelli, L., & de Peralta, R. G. (2004). EEG source imaging. Clinical Neurophysiology, 115, 2195-2222.CrossRefPubMedGoogle Scholar
  29. Miller, J., Patterson, T., & Ulrich, R. (1998). Jackknife-based method for measuring LRP onset latency differences. Psychophysiology, 35, 99-115.CrossRefPubMedGoogle Scholar
  30. Ohmann, K., Stahl, J., Mussweiler, T., & Kedia, G. (2016). Immediate relativity: EEG reveals early engagement of comparison in social information processing. Journal of Experimental Psychology: General, 145, 1512–1529.CrossRefGoogle Scholar
  31. Oostenveld, R., Fries, P., Maris, E., & Schoffelen, J. M. (2011). Fieldtrip: Open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Computational Intelligence and Neuroscience, 2011, 1-9. 156869.  https://doi.org/10.1155/2011/156869 CrossRefGoogle Scholar
  32. Oosterhof, N. N., & Todorov, A. (2008). The functional basis of face evaluation. Proceedings of the National Academy of Sciences of the USA, 105, 11087-11092.CrossRefPubMedGoogle Scholar
  33. Polich, J. (2012). Neuropsychology of P300. In S. J. Luck & E. S. Kappenman (Eds.), The Oxford handbook of event-related potential components (pp. 159-188). New York: Oxford University Press.Google Scholar
  34. Rellecke, J., Sommer, W., Schacht, A. (2012). Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials. Biological Psychology, 90, 23-32.CrossRefPubMedGoogle Scholar
  35. Renzi, C., Schiavi, S., Carbon, C. C., Vecchi, T., Silvanto, J., & Cattaneo, Z. (2013). Processing of featural and configural aspects of faces is lateralized in dorsolateral prefrontal cortex: A TMS study. NeuroImage, 74, 45-51.CrossRefPubMedGoogle Scholar
  36. Rossion, B., & Jacques, C. (2012). N170: Understanding the time course of face perception in the human brain. In S. J. Luck & E. S. Kappenman (Eds.), The Oxford handbook of event-related potential components (pp. 115-142). New York: Oxford University Press.Google Scholar
  37. Rudoy, J. D., & Paller, K. A. (2009). Who can you trust? Behavioral and neural differences between perceptual and memory-based influences. Frontiers in Human Neuroscience, 3, 16.  https://doi.org/10.3389/neuro.09.016.2009 CrossRefPubMedPubMedCentralGoogle Scholar
  38. Ruz, M., Madrid, E., & Tudela, P. (2013). Interactions between perceived emotions and executive attention in an interpersonal game. Social, Cognitive, and Affective Neuroscience, 8, 838-844.CrossRefGoogle Scholar
  39. Sabatinelli, D., Fortune, E. E., Li, O., Siddiqui, A., Krafft, C., Oliver, W. T., Beck, S., & Jeffries, J. (2011). Emotional perception: Meta-analyses of face and natural scene processing. NeuroImage, 54, 2524–2533.CrossRefPubMedGoogle Scholar
  40. Said, C. P., Haxby, J. V., & Todorov, A. (2011). Brain system for assessing the affective value of faces. Philosophical Transactions of the Royal Society, 366, 1660–1670.CrossRefGoogle Scholar
  41. Schacht, A., Werheid, K., & Sommer, W. (2008). The appraisal of facial beauty is rapid but not mandatory. Cognitive, Affective and Behavioral Neuroscience, 8, 132-142.CrossRefPubMedGoogle Scholar
  42. Schupp, H., Öhman, A., Junghöfer, M., Weike, A. I., Stockburger, J., & Hamm, A. (2004). The facilitated processing of threatening faces: An ERP analysis. Emotion, 4, 189-200.CrossRefPubMedGoogle Scholar
  43. Shore, D. M., Ng, R., Bellugi, U., & Mills, D. L. (2017). Abnormalities in early visual processes are linked to hypersociability and atypical evaluation of facial trustworthiness: An ERP study with Williams syndrome. Cognitive, Affective, and Behavioral Neuroscience, 17, 1002–1017.CrossRefGoogle Scholar
  44. Smulders, F. T. (2010). Simplifying jackknifing of ERPs and getting more out of it: Retrieving estimates of participants' latencies. Psychophysiology, 47, 387-392.CrossRefPubMedGoogle Scholar
  45. Smulders, F. T., & Miller, J. O. (2012). The lateralized readiness potential. In S. J. Luck & E. S. Kappenman (Eds.), The Oxford handbook of event-related potential components (pp. 209–229). New York: Oxford University Press.Google Scholar
  46. Sutherland, C. A. M., Rowley, L., Amoaku, U., Daguzan, E., Kidd-Rossiter, K., Maceviciute, U., & Young, A. W. (2015). Personality judgements from everyday images of faces. Frontiers in Psychology, 6, 1616.CrossRefPubMedPubMedCentralGoogle Scholar
  47. Sutherland, C. A. M., Young, A. W., & Rhodes, G. (2017). Facial first impressions from another angle: How social judgements are influenced by changeable and invariant facial properties. British Journal of Psychology, 108, 397–415.CrossRefPubMedGoogle Scholar
  48. Talairach, J., & Tournoux, P. (1988). Co-planar stereotaxic atlas of the human brain. Thieme: Stuttgart.Google Scholar
  49. Thiruchselvam, R., Harper, J., & Homer, A. L. (2016). Beauty is in the belief of the beholder: Cognitive influences on the neural response to facial attractiveness. Social Cognitive and Affective Neuroscience, 11, 1999-2008.PubMedPubMedCentralGoogle Scholar
  50. Todorov, A. T., Olivola, C. Y., Dotsch, R., & Mende-Siedlecki, P. (2015). Social attributions from faces: Determinants, consequences, accuracy, and functional significance, Annual Review of Psychology, 66, 519–545CrossRefPubMedGoogle Scholar
  51. Trujillo, L. T., Jankowitsch, J. M., Langlois, J. H. (2014). Beauty is in the ease of the beholding: A neurophysiological test of the averageness theory of facial attractiveness. Cognitive, Affective, and Behavioral Neuroscience, 14, 1061–1076.CrossRefGoogle Scholar
  52. Uono, S., Sato, W., Kochiyama, T., Sawada, R., Kubota, Y., Yoshimura, S., et al. (2017). Neural substrates of the ability to recognize facial expressions: A voxel-based morphometry study. Social, Cognitive, and Affective Neuroscience, 12, 487-495.Google Scholar
  53. van Hooff, J. C., Crawford, H., & van Vugt, M. (2011). The wandering mind of men: ERP evidence for gender differences in attention bias towards attractive opposite sex faces. Social, Cognitive, and Affective Neuroscience, 6, 477–485.CrossRefGoogle Scholar
  54. Vytal, K., & Hamann, S. (2010). Neuroimaging support for discrete neural correlates of basic emotions: A voxel-based meta-analysis. Journal of Cognitive Neuroscience, 22, 2864–2885.CrossRefPubMedGoogle Scholar
  55. Wegrzyn, M., Riehle, M., Labudda, K., Woermann, F., Baumgartner, F., Pollmann, S., et al. (2015). Investigating the brain basis of facial expression perception using multi-voxel pattern analysis. Cortex, 69, 131-140.CrossRefPubMedGoogle Scholar
  56. Werheid, K., Schacht, A., & Sommer, W. (2007). Facial attractiveness modulates early and late event-related brain potentials. Biological Psychology, 76, 100–108.CrossRefPubMedGoogle Scholar
  57. Wiese, H., Altmann, C. S., & Schweinberger, S. R. (2014). Effects of attractiveness on face memory separated from distinctiveness: Evidence from event-related brain potentials. Neuropsychologia, 56, 26–36.CrossRefPubMedGoogle Scholar
  58. Xu, F., Wu, D., Toriyama, R., Ma, F., Itakura, S., & Lee, K. (2012). Similarities and differences in Chinese and Caucasian adults’ use of facial cues for trustworthiness judgements. PLoS ONE 7:e34859.  https://doi.org/10.1371/journal.pone.0034859 CrossRefPubMedPubMedCentralGoogle Scholar
  59. Yang, D., Qi, S., Ding, C., Song, Y. (2011). An ERP study on the time course of facial trustworthiness appraisal. Neuroscience Letters, 496, 147–151.CrossRefPubMedGoogle Scholar

Copyright information

© Psychonomic Society, Inc. 2018

Authors and Affiliations

  1. 1.Department of Cognitive Psychology, Campus de GuajaraUniversidad de La LagunaTenerifeSpain
  2. 2.Instituto Universitario de Neurociencia (IUNE)Universidad de La LagunaTenerifeSpain
  3. 3.Aida Gutiérrez-García, Department of Health SciencesUniversidad de BurgosBurgosSpain

Personalised recommendations