Embodiment and Interaction Guidelines for Designing Credible, Trustworthy Embodied Conversational Agents

  • Andrew J. Cowell
  • Kay M. Stanney
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2792)


This paper discusses our recent studies on Embodied Conversational Agent (ECA) design strategies to encourage credible and trustworthy dialogue. We approach the problem from two specific directions: the embodiment that the character ‘wears’ during its interchange with the user, and the method of interaction used by the ECA to engage the user. Our results indicate that while users generally prefer to interact with a youthful character matching their ethnicity, no significant preferences were indicated for character gender. For interaction, our results indicated that a character that portrayed trusting nonverbal behaviors was rated as being significantly more credible than a character portraying no nonverbal behavior, or one that portrayed non-trusting behaviors. Other interesting results from this work are also discussed.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ambady, N., Rosenthal, R.: Half a Minute: Predicting Teacher Evaluations From Thin Slices of Nonverbal Behavior and Physical Attractiveness. Journal of Personality & Social Psychology 64(3), 431–441 (1993)CrossRefGoogle Scholar
  2. 2.
    Burgoon, J.K., Saine, T.: The Unspoken Dialogue: An Introduction to Nonverbal Communication. Houghton, Boston (1978)Google Scholar
  3. 3.
    Henley, N.M.: Body Politics: Power, Sex and Nonverbal Communication: A Perceptual Study. In: Ellyson, S.L., Dovidio, J.F. (eds.) Power, Dominance and Nonverbal Behavior, pp. 151–164. Springer, New York (1977)Google Scholar
  4. 4.
    Knapp, M.L.: Nonverbal Communication in Human Interaction, 2nd edn. Holt, New York (1978)Google Scholar
  5. 5.
    Leathers, D.G.: Successful Nonverbal Behavior - Principles & Applications, 3rd edn. Allyn & Bacon, Needham Heights (1997)Google Scholar
  6. 6.
    Ekman, P.: Darwin & Facial Expression: A Century of Research in Review. Academic Press, New York (1973)Google Scholar
  7. 7.
    De Meuse, K.P.: A Review of the Effects of Nonverbal Cues on the Performance Appraisal Process. Journal of Occupational Psychology 60, 207–226 (1987)Google Scholar
  8. 8.
    Cauthen, N.R., Robinson, I.E., Krauss, H.H.: Stereotypes: A Review of the Literature 1926-1968. Journal of Applied Psychology 68, 609–619 (1971)Google Scholar
  9. 9.
    Schwab, D.P., Heneman, H.G.: Age Stereotyping in Performance Appraisal. Journal of Applied Psychology 63, 573–578 (1978)CrossRefGoogle Scholar
  10. 10.
    Rosen, B., Jerdee, T.H.: The Influence of Age Stereotypes on Managerial Decisions. Journal of Applied Psychology 61, 428–432 (1976)CrossRefGoogle Scholar
  11. 11.
    Fiske, S.T., Neuberg, S.L.: A Continuum of Impression Formation, from Category-based to Individuating Proceses: Influences of Information and Motivation on Attention and Interpretation. In: Zanna, M.P. (ed.) Advances in Experimental Social Psychology, vol. 23, pp. 1–74. Academic Press, New York (1990)Google Scholar
  12. 12.
    Smith, E.R., Zarate, M.A.: Exemplar-based Model of Social Judgment. Psychological Review 99, 3–21 (1992)CrossRefGoogle Scholar
  13. 13.
    Gardner, R.C., MacIntyre, P.D., Lalonde, R.N.: The Effects of Multiple Social Categories on Stereotyping. Canadian Journal of Behavioral Science 27(4) (1995)Google Scholar
  14. 14.
    Romer, N., Cherry, D.: Ethnic and Social Class differences in Children’s Sex-role Concepts. Sex Roles 6, 246–263 (1980)CrossRefGoogle Scholar
  15. 15.
    Rosenkrantz, P.S., Vogel, S.R., Bee, H., Broverman, I.K., Broverman, D.M.: Sex-role Stereotypes and Self Concepts in College Students. Journal of Consulting and Clinical Psychology 32, 287–295 (1968)CrossRefGoogle Scholar
  16. 16.
    Robinson, J., McArthur, L.Z.: Impact of Salient Vocal Qualities on Causal Attribution for a Speaker’s Behavior. Journal of Personality & Social Psychology 43, 236–247 (1982)CrossRefGoogle Scholar
  17. 17.
    Heilman, M.E.: High School Students’ Occupational Interest as a Function of Projected Sex Ratios in Male-Dominated Occupations. Journal of Applied Psychology 64, 915–928 (1979)CrossRefGoogle Scholar
  18. 18.
    Deaux, K., Emswiller, T.: Explanations of Successful Performance on Sex-Linked Tasks: What is Skill for the Male is Luck for the Female. Journal of Personality and Social Psychology 29, 80–85 (1974)CrossRefGoogle Scholar
  19. 19.
    Feldman-Summers, S., Kiesler, S.B.: Those Who Are Number Two Try Harder: The Effect of Sex on Attributions of Causality. Journal of Personality & Social Psychology 30, 846–855 (1974)CrossRefGoogle Scholar
  20. 20.
    Costrich, N., Feinstein, J., Kidder, L., Maracek, J., Pascale, L.: When Stereotypes Hurt: Three Studies of Penalties in Sex-role Reversals. Journal of Experimental Social Psychology 11, 520–530 (1975)CrossRefGoogle Scholar
  21. 21.
    Deutsch, C.J., Gilbert, L.A.: Sex-role Stereotypes: Effect on Perceptions of Self and Others and on Personal Adjustment. Journal of Counseling Psychology 23, 373–379 (1976)CrossRefGoogle Scholar
  22. 22.
    Nass, C., Moon, Y., Green, N.: Are Machines Gender Neutral? Gender-Stereotypic Responses to Computers with Voices. Journal of Applied Social Psychology 27(10), 864–876 (1997)CrossRefGoogle Scholar
  23. 23.
    Mack, D., Williams, J.G., Kremer, J.M.D.: Perception of a Simulated Other Player and Behavior in the Reiterated Prisoner’s Dilemma Game. The Psychological Review 29, 43–48 (1979)Google Scholar
  24. 24.
    Gerbner, G., Gross, L., Morgan, M., Signorielli, N.: Violence Profile No. 14: The Annenberg School of Communications, University of Pennsylvania (1986)Google Scholar
  25. 25.
    Fish, S.: Reverse Racism: Or How the Pot got to Call the Kettle Black. Atlantic Monthly (November 1993)Google Scholar
  26. 26.
    Jaroff, L.: Teaching reverse racism: A strange doctrine of black superiority is finding its way into schools and colleges. Time, 74-75 (April 4, 1994)Google Scholar
  27. 27.
    Gross, B.R.: Reverse Discrimination. Prometheus Books, Buffalo (1977)Google Scholar
  28. 28.
    Lynch, F.R.: Invisible Victims: White Males and the Crisis of Affirmative Action. Greenwood Press, New York (1989)Google Scholar
  29. 29.
    Horowitz, D.: Hating Whitey: And Other Progressive Causes. Spence Publishing (1999)Google Scholar
  30. 30.
    Delener, J.L., Barlow, W.: Informational Sources and Media Usage: A Comparison Between Asian and Hispanic Subcultures. Journal of Advertising Research 30, 45–52 (1990)Google Scholar
  31. 31.
    Asian Americans: The Drive To Excel, Newsweek (1984)Google Scholar
  32. 32.
    Yip, A.: Remembering Vincent Chin. Asian Week (June 5-13, 1997)Google Scholar
  33. 33.
    Taylor, C.R., Stern, B.B.: Asian-Americans: Television Advertising and the “Model Minority” Stereotype. Journal of Advertising 26(2), 47–61 (1997)Google Scholar
  34. 34.
    Jackson, L.A.: Stereotypes, Emotions, Behavior and Overall Attitudes Towards Hispanics by Anglos (Research Report #10). Michigan: Julian Samora Research Institute, Michigan State University (1995)Google Scholar
  35. 35.
    Fairchild, H.H., Cozens, J.A.: Chicano, Hispanic or Mexican American - What’s in a Name. Hispanic Journal of Behavioral Sciences 3, 191–198 (1981)Google Scholar
  36. 36.
    Marin, G.: Stereotyping Hispanics: The differential effect of research method, label, and degree of contact. International Journal of Intercultural Relations 8, 17–27 (1984)CrossRefGoogle Scholar
  37. 37.
    Montenegro, M.: Chicanos and Mexican Americans: Ethnic Self-Identification and Attitudinal Differences. R & E Research Associates, San Francisco (1971)Google Scholar
  38. 38.
    Peterson, B., Ramierez, M.: Real, ideal-self disparity in Negro and Mexican-American children. Psychology 8, 22–26 (1971)Google Scholar
  39. 39.
    Rosen, B., Jerdee, T.H.: The Influence of Age Stereotypes on Managerial Decisions. Journal of Applied Psychology 61, 428–432 (1976)CrossRefGoogle Scholar
  40. 40.
    Cleveland, J.N., Landy, F.J.: The Influence of Rater and Ratee Age on Two Performance Judgments. Personnel Psychology 34, 19–29 (1981)CrossRefGoogle Scholar
  41. 41.
    Schwab, D.P., Heneman, H.G.: Age Stereotyping in Performance Appraisal. Journal of Applied Psychology 63, 573–578 (1978)CrossRefGoogle Scholar
  42. 42.
    Johnson, A.G.: The Blackwell Dictionary of Sociology. Blackwell Publishers, Oxford (1995)Google Scholar
  43. 43.
    Benford, R.D.: Social Issues. Macmillan, New York (1998)Google Scholar
  44. 44.
    Knapp, M.L.: Nonverbal Communication in Human Interaction, 2nd edn. Holt, New York (1978)Google Scholar
  45. 45.
    Mehrabian, A.: Orientation behaviors and Nonverbal Attitude Communication. Journal Of Communication 16, 324–332 (1967)CrossRefGoogle Scholar
  46. 46.
    Argyle, A.: Social Interaction. Atherton Press, New York (1969)Google Scholar
  47. 47.
    Ekman, P., Friesen, W.V.: Origin, Usage & Coding: The Basis For Five Categories of Nonverbal Behavior. Paper presented at the Symposium on Communication Theory and Linguistic Models in the Social Sciences, Buenos Aires, Argentina (1967)Google Scholar
  48. 48.
    Leathers, D.G.: Successful Nonverbal Behavior - Principles & Applications, 3rd edn. Allyn & Bacon, Needham Heights (1997)Google Scholar
  49. 49.
    Ekman, P., Friesen, W.V., Tomkins, S.S.: Facial Effect Scoring Technique: A First Validity Study. Semiotica 3, 37–58 (1971)CrossRefGoogle Scholar
  50. 50.
    Bugental, D.W.: Unmasking the ’Polite Smile’: Situational and Personal Determinants of Managed Affect in Adult-Child Interactions. Personality and Social Psychology Bulletin 12, 7–16 (1986)CrossRefGoogle Scholar
  51. 51.
    Frois-Wittmann, J.: The Judgment of Facial Expression. Journal of Experimental Psychology 13, 113–151 (1930)CrossRefGoogle Scholar
  52. 52.
    Massaro, D.W., Cohen, M.C., Beskow, J., Cole, R.: Developing and Evaluating Conversational Agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 287–318. MIT Press, Cambridge (2000)Google Scholar
  53. 53.
    Clayman, S.E.: Answers and Evasions. Language and Society 30, 403–442 (2001)Google Scholar
  54. 54.
    Kendon, A.: Some Functions of Gaze Direction in Social Interaction. Acta Psychologoca, 26(I), I–47 (1968)Google Scholar
  55. 55.
    Argyle, M., Lalljee, M., Cook, M.: The Effects of Visibility on Interaction in a Dyad. Human Relations 21, 3–17 (1968)CrossRefGoogle Scholar
  56. 56.
    Janik, S.W., Wellens, A.R., Goldberg, M.L., DeLosse, L.F.: Eyes as the Center of Focus in the Visual Examination of Faces. Perceptual and Motor Skills 26, 34–35 (1978)Google Scholar
  57. 57.
    Webbink, P.: The Power of the Eyes. Springer Publishing Company, Heidelberg (1986)Google Scholar
  58. 58.
    Kleinke, C.: Interaction Between Gaze and Legitimacy of Request on Compliance in a Field Setting. Journal of Nonverbal Behavior 5, 3–12 (1980)CrossRefGoogle Scholar
  59. 59.
    Scherer, K.R.: Methods of Research on Vocal Communication: Paradigms and Parameters. In: Scherer, K.R. (ed.) Methods in Nonverbal Behavior Research, Cambridge University Press, Cambridge (1982)Google Scholar
  60. 60.
    Mehrabian, A.: Silent Messages, 2nd edn. Wadsworth, Belmont (1981)Google Scholar
  61. 61.
    Fairbanks, G., Pronovost, W.: An Experimental Study of the Pitch Characteristics of the Voice During the Expression of Emotions. Speech Monographs 6, 87–104 (1939)CrossRefGoogle Scholar
  62. 62.
    Cappella, J.N.: The Management of Conversations. In: Knapp, M.L., Miller, G.R. (eds.) Handbook of Interpersonal Communication, pp. 393–435. Sage, Beverly Hills (1985)Google Scholar
  63. 63.
    Zuckerman, M., Hodgins, H., Mityake, K.: The Vocal Attractiveness Stereotype: Replication and Elaboration. Journal of Nonverbal Behavior 14, 97–112 (1990)CrossRefGoogle Scholar
  64. 64.
    Addington, D.W.: The Relationship of Certain Vocal Characteristics with Perceived Speaker Characteristics. Unpublished Doctoral Dissertation, University of Iowa (1963)Google Scholar
  65. 65.
    Hosman, L.A.: The Evaluative Consequences of Hedges, Hesitations and Intensifiers: Power and Powerless Speech Styles. Human Communication Research 15, 383–406 (1989)CrossRefGoogle Scholar
  66. 66.
    Rodman, R.D.: Computer Speech Technology. Artech House, Boston (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Andrew J. Cowell
    • 1
  • Kay M. Stanney
    • 2
  1. 1.Pacific Northwest National LaboratoryData & Knowledge EngineeringRichland
  2. 2.Department of Industrial Engineering & Management SystemsUniversity of Central FloridaOrlando

Personalised recommendations