Skip to main content
Log in

The Sound of Trust: Voice as a Measurement of Trust During Interactions with Embodied Conversational Agents

  • Published:
Group Decision and Negotiation Aims and scope Submit manuscript

Abstract

Trust is a critical component in effective collaboration, decision-making and negotiation. The goal of effective team leaders should be to send signals and messages that increase trust. We attempt to determine if signals can vary perceptions of trustworthiness and if nonverbal behaviors, such as the voice, contain indicators of trust. In order to investigate the relationship between trust and vocal dynamics, this article presents a study that explores how the voice, measured unobtrusively, reflects a person’s current level of perceived trust. We used an Embodied Conversational Agent (ECA) to maximize consistency and control in questioning, timing, and interviewer nonverbal behavior, thus eliminating potential confounds that may be introduced due to interaction adaptation. Participants (\(\text{ N}=88\)) completed a face-to-face interview with the ECA and reported their perceptions of the ECA’s trustworthiness. The results of the study revealed that vocal pitch was inversely related to perceived trust, but temporally variant; vocal pitch early in the interview reflected trust. The ECA was perceived as more trustworthy when smiling. While the results of this research suggest a relationship between vocal pitch and perceived levels of trust, more work needs to be done to clarify the causal relationship. Similarly, additional study needs to be done in order to integrate additional behavioral measurements that account for variation across diverse situations, people, and cultures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Bacharach M, Gambetta D (1997) Trust in signs. In: Cook KS (ed) Trust in society. Russell Sage Foundation, New York, pp 148–184

  • Bachorowski JA, Owren MJ (1995) Vocal expression of emotion: acoustic properties of speech are associated with emotional intensity and context. Psychol Sci 6(4):219–224

    Google Scholar 

  • Boersma P (2002) Praat, a system for doing phonetics by computer. Glot Int 5(9/10):341–345

    Google Scholar 

  • Bollen K (1989) Structural equations with latent variables. Wiley-Interscience

  • Burgoon JK, Stern LA, Dillman L (2007) Interpersonal adaptation: dyadic interaction patterns. Cambridge University Press, Cambridge

    Google Scholar 

  • Cappella JN (1997) Behavioral and judged coordination in adult informal social interactions: vocal and kinesic indicators. J Pers Soc Psychol 72(1):119–131. doi:10.1037/0022-3514.72.1.119

    Article  Google Scholar 

  • Dyer NG, Hanges PJ, Hall RJ (2005) Applying multilevel confirmatory factor analysis techniques to the study of leadership. Leadersh Q 16(1):149–167

    Article  Google Scholar 

  • Fogg BJ, Nass C (1997) Silicon sycophants: the effects of computers that flatter. Int J Hum-Comput Stud 46(5):551–561

    Google Scholar 

  • Hall B, Henningsen DD (2008) Social facilitation and human-computer interaction. Comput Hum Behav 24(6):2965–2971. doi:10.1016/j.chb.2008.05.003

    Google Scholar 

  • Hardin R (2002) Trust and trustworthiness. Russell Sage Foundation, New York

  • Hess U, Philippot P, Blairy S (1999) Mimicry: facts and fiction. In: Philippot P, Feldman RS, Coats EJ (eds) The social context of nonverbal behavior, studies in emotion and social interaction. Editions de la Maison des Sciences de l’Homme, Paris, France, pp 13–241

  • Juslin PN, Laukka P (2003) Communication of emotions in vocal expression and music performance: different channels, same code? Psychol Bull 129(5):770–814

    Article  Google Scholar 

  • Juslin PN, Scherer KR (2005) Vocal expression of affect. The new handbook of methods in nonverbal behavior research, pp 65–135

  • Lee E (2008) Flattery may get computers somewhere, sometimes: the moderating role of output modality, computer gender, and user gender. Int J Human-Comput Stud 66(11):789–800

    Google Scholar 

  • Mayer RC, Davis JH, Schoorman FD (1995) An integrative model of organizational trust. Acad Manag Rev 20(3):709–734

    Google Scholar 

  • McAllister DJ (1995) Affect- and cognition-based trust as foundations for interpersonal cooperation in organizations. Acad Manag J 38(1):24–59. doi:10.2307/256727

    Article  Google Scholar 

  • Moon Y, Nass C (1996) How “real” are computer personalities? Commun Res 23(6):651–674

    Google Scholar 

  • Moon Y, Nass C (1998) Are computers scapegoats? attributions of responsibility in human-computer interaction. Int J Hum-Comput Stud 49(1):79–94

    Google Scholar 

  • Muthén BO (1991) Multilevel factor analysis of class and student achievement components. J Educ Meas 28(4):338–354

    Article  Google Scholar 

  • Muthén BO (1994) Multilevel covariance structure analysis. Sociol Methods Res 22(3):376

    Article  Google Scholar 

  • Nass C, Moon Y (2000) Machines and mindlessness: social responses to computers. J Soc Issues 56(1):81–103

    Google Scholar 

  • Nass C, Steuer J (1993) Voices, boxes, and sources of messages. Hum Commun Res 19(4):504–527

    Google Scholar 

  • Nass C, Steuer J, Tauber ER (1994) Computers are social actors. In: Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence. ACM, Boston, MA, pp 72–78

  • Nass C, Moon Y, Fogg BJ, Reeves B, Dryer C (1995) Can computer personalities be human personalities? In: Conference companion on Human factors in computing systems. ACM, Denver, CO, pp 228–229

  • Nass C, Moon Y, Morkes J, Kim E, Fogg BJ (1997) Computers are social actors: a review of current research. In: Human values and the design of computer technology, center for the study of language and information lecture notes. Cambridge University Press, Stanford, CA, pp 137–161

  • Niewiadomski R, Pelachaud C (2010) Affect expression in ECAs: application to politeness displays. Int J Hum-Comput Stud 68(11):851–871

    Google Scholar 

  • Nunamaker Jr JF, Derrick DC, Elkins AC, Burgoon JK, Patton MW (2011) Embodied Conversational Agent (ECA) based kiosk for automated interviewing. J Manag Inf Syst 28(1):17–49

    Google Scholar 

  • Ohanian R (1990) Construction and validation of a scale to measure celebrity Endorsers’ perceived expertise, trustworthiness, and attractiveness. J Advert 19(3):39–52

    Article  Google Scholar 

  • Prentice DA, Carranza E (2002) What women and men should be, shouldn’t be, are allowed to be, and don’t have to be: the contents of prescriptive gender stereotypes. Psychol Women Q 26(4):269–281

    Google Scholar 

  • Qiu L, Benbasat I (2010) A study of demographic embodiments of product recommendation agents in electronic commerce. Int J Hum-Comput Stud 68(10):669–688

    Google Scholar 

  • Rapson RL, Hatfield E, Cacioppo JT (1993) Emotional contagion. Cambridge University Press., Cambridge

    Google Scholar 

  • Reysen S (2005) Construction of new scale: the Reysen likability scale. Soc Behav Pers Int J 33(2):201–208

    Article  Google Scholar 

  • Ridgeway C (2009) Cultural beliefs and the gendering of social relations. In: Framed by gender: how gender inequality persists in the modern world. Oxford University Press, New York, NY, p 248

  • Ridgeway CL (2011) Framed by gender: how gender inequality persists in the modern world. Oxford University Press, New York, NY

  • Riegelsberger J (2005) Trust in mediated interactions (Doctoral dissertation). University College London, London

  • Rummel RJ (1970) Applied factor analysis. Northwestern University Press, Evanston

    Google Scholar 

  • Rusman E (2011) How to inform trustworthiness assessments in virtual project teams (Doctoral dissertation). Open University in the Netherlands (CELSTEC), Heerlen, The Netherlands

  • Six F, Nooteboom B, Hoogendoorn A (2010) Actions that build interpersonal trust: a relational signaling perspective. Rev Soc Econ 68(3):285–315

    Google Scholar 

  • Streeter LA, Krauss RM, Geller V, Olson C, Apple W (1977) Pitch changes during attempted deception. J Pers Soc Psychol 35(5):345–350

    Article  Google Scholar 

  • Thompson JD (1967) Organizations in action: social science bases of administrative theory. Transaction Publishers, New Brunswick

    Google Scholar 

  • Titze IR, Martin DW (1998) Principles of voice production. Acoust Soc Am J 104:1148

    Article  Google Scholar 

  • Tzafrir S, Sanchez R, Tirosh-Unger K (2012) Social motives and trust: implications for joint gains in negotiations. Group Decis Negot 21(6):839–862

    Article  Google Scholar 

  • Van Vugt HCV, Bailenson JN, Hoorn JF, Konijn EA (2008) Effects of facial similarity on user responses to embodied agents. ACM Trans Comput Hum Interact 17(2):1–27

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Aaron C. Elkins.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Elkins, A.C., Derrick, D.C. The Sound of Trust: Voice as a Measurement of Trust During Interactions with Embodied Conversational Agents. Group Decis Negot 22, 897–913 (2013). https://doi.org/10.1007/s10726-012-9339-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10726-012-9339-x

Keywords

Navigation