Facial and Vocal Cues in Perceptions of Trustworthiness

  • Elena Tsankova
  • Andrew J. Aubrey
  • Eva Krumhuber
  • Guido Möllering
  • Arvid Kappas
  • David Marshall
  • Paul L. Rosin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7729)


The goal of the present research was to study the relative role of facial and acoustic cues in the formation of trustworthiness impressions. Furthermore, we investigated the relationship between perceived trustworthiness and perceivers’ confidence in their judgments. 25 young adults watched a number of short clips in which the video and audio channel were digitally aligned to form five different combinations of actors’ face and voice trustworthiness levels (neutral face + neutral voice, neutral face + trustworthy voice, neutral face + non-trustworthy voice, trustworthy face + neutral voice, and non-trustworthy face + neutral voice). Participants provided subjective ratings of the trustworthiness of the actor in each video, and indicated their level of confidence in each of those ratings. Results revealed a main effect of face-voice channel combination on trustworthiness ratings, and no significant effect of channel combination on confidence ratings. We conclude that there is a clear superiority effect of facial over acoustic cues in the formation of trustworthiness impressions, propose a method for future investigation of the judgmentconfidence link, and outline the practical implications of the experiment.


Nonverbal Behavior Neutral Face Facial Information Audio Channel Channel Combination 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Willis, J., Todorov, A.: First Impressions: Making up Your Mind after 100ms Exposure to a Face. Psychol. Sci., 592–598 (2006)Google Scholar
  2. 2.
    Ballew, C.C., Todorov, A.: Predicting Political Elections from Rapid and Unreflective Face Judgments. Proceedings of the National Academy of Sciences of the United States of America 104, 17948–17953 (2007)CrossRefGoogle Scholar
  3. 3.
    Surawski, M., Ossoff, E.: The Effects of Physical and Vocal Attractiveness on Impression Formation of Politicians. Current Psychology 25, 15–27 (2006)CrossRefGoogle Scholar
  4. 4.
    Giddens, A.: The Consequences of Modernity. Stanford University Press, Stanford (1990)Google Scholar
  5. 5.
    Giddens, A.: Modernity and Self-Identity. Polity Press, Cambridge (1991)Google Scholar
  6. 6.
    Möllering, G.: The Nature of Trust: From Georg Simmel to a Theory of Expectation, Interpretation and Suspension. Sociology 35, 403–420 (2001)Google Scholar
  7. 7.
    Möllering, G.: Trust: Reason, Routine, Reflexivity. Elsevier, Oxford (2006)Google Scholar
  8. 8.
    Luhmann, N.: Trust and Power. Two Works by Niklas Luhmann. Wiley, Chichester (1979)Google Scholar
  9. 9.
    Lewis, J.D., Weigert, A.: Trust as a Social Reality. Social Forces 63, 967–985 (1985)Google Scholar
  10. 10.
    Krumhuber, E., Manstead, A.S.R., Cosker, D., Marshall, D., Rosin, P., Kappas, A.: Facial Dynamics as Indicators of Trustworthiness and Cooperative Behavior. Emotion 7, 730–735 (2007)CrossRefGoogle Scholar
  11. 11.
    Kamachi, M., Hill, H., Lander, K., Vatikiotis-Bateson, E.: ‘Putting the Face to the Voice’: Matching Identity Across Modality. Current Biology 13, 1709–1714 (2003)CrossRefGoogle Scholar
  12. 12.
    Lachs, L., Pisoni, D.: Crossmodal Source Identification in Speech Perception. Ecological Psychology 16, 159–187 (2004)CrossRefGoogle Scholar
  13. 13.
    Oosterhof, N.N., Todorov, A.: The Functional Basis of Face Evaluation. Proceedings of the National Academy of Sciences of the United States of America 105, 11087–11092 (2008)CrossRefGoogle Scholar
  14. 14.
    Hess, U., Kappas, A., Scherer, K.R.: Multichannel Communication of Emotion: Synthetic Signal Production. In: Scherer, K.R. (ed.) Facets of Emotion: Recent Research, pp. 161–182. Erlbaum, Hillsdale (1988)Google Scholar
  15. 15.
    Aubrey, A., Kajic, V., Cingovska, I., Rosin, P., Marshall, D.: Mapping and Manipulating Facial Dynamics. In: Proc. IEEE Conf. Automatic Face and Gesture Recognition, pp. 639–645 (2011)Google Scholar
  16. 16.
    Jarvis, B.: MediaLab (Version 2008.1.33). Empirisoft Corporation, New York (2008)Google Scholar
  17. 17.
    Kappas, A., Hess, U., Scherer, K.R.: Voice and Emotion. In: Feldman, R.S., Rimé, B. (eds.) Fundamentals of Nonverbal Behavior, pp. 200–238. Cambridge University Press, Cambridge (1991)Google Scholar
  18. 18.
    Burns, C., Conchie, S.: Measuring Implicit Trust and Automatic Attitude Activation. In: Lyon, F., Möllering, G., Sanders, M. (eds.) Handbook of Research Methods on Trust, pp. 239–248. Edward Elgar, Cheltenham (2011)Google Scholar
  19. 19.
    Van Mulken, S., André, E., Muller, J.: An Empirical Study on the Trustworthiness of Life-Like Interface Agents. In: Bullinger, H., Ziegler, J. (eds.) Human Computer Interaction, pp. 152–156. Erlbaum, Mahwah (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Elena Tsankova
    • 1
  • Andrew J. Aubrey
    • 2
  • Eva Krumhuber
    • 1
  • Guido Möllering
    • 1
  • Arvid Kappas
    • 1
  • David Marshall
    • 2
  • Paul L. Rosin
    • 2
  1. 1.School of Humanities and Social SciencesJacobs University BremenBremenGermany
  2. 2.School of Computer Science and InformaticsCardiff UniversityCardiffUnited Kingdom

Personalised recommendations