Skip to main content

Advertisement

SpringerLink
Log in

Effect of Voice Type and Head-Light Color in Social Robots for Different Applications

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

The social robotics field has been growing in prominence. Many developed countries have begun to apply such robots in various fields, such as shopping reception, education, home companion, medical care, and security. However, expectations of social robots have also changed. In addition to performing their specific tasks, social robots are also expected to consider users’ emotional needs. Therefore, scholars have begun to explore robots’ social cues in an effort to enhance their role in society and enable them to provide higher-quality services. This study used the robot's voice type, head-light color, and application field as independent variables to discuss the optimal robot social cues for different applications and to provide a reference for future production and research. Education, shopping reception, and home companion applications were selected as the most common areas employing social robots. According to the vocal fundamental frequencies used in related studies, three voice types were included: male, female, and child. The three values for head-light color, namely warm, neutral, and cold colors, were set according to color temperature theory. The robot social attribute scale, with the addition of an acceptance component, was used to evaluate respondent perceptions. Results revealed that male voices provide users with the highest impression of competence, whereas children's voices have the lowest competence. However, results for the warmth component were completely different: in this aspect, children's voices had the highest evaluations and male voices the lowest. For head-light colors, neutral colors had the highest overall acceptance, the highest competence evaluation, and the lowest discomfort. The neutral color's warmth judgment was the same as that of the warm color, and its competence rating was the same as that of the cold color. For home companion robots, we recommend a child’s voice with neutral colors as the first choice, and a child’s voice with warm color as the second option. Because females rejected male voices, male voices are not recommended in home companion. For education and business, a male voice and neutral colors are the first choice. A female voice is also the second option. In cases with less focus on warmth impression but greater emphasis on competence impression, cold colors could be employed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Savela N, Turja T, Oksanen A (2018) Social acceptance of robots in different occupational fields: a systematic literature review. Int J Soc Robot 10(4):493–502

    Article  Google Scholar 

  2. Looije R, Neerincx MA, Cnossen F (2010) Persuasive robotic assistant for health self-management of older adults: design and evaluation of social behaviors. Int J Hum-Comput Stud 68(6):386–397

    Article  Google Scholar 

  3. Sabelli AM, Kanda T (2016) Robovie as a mascot: a qualitative study for long-term presence of robots in a shopping mall. Int J Soc Robot 8(2):211–221

    Article  Google Scholar 

  4. Chang RC, Lu HP, Yang P (2018) Stereotypes or golden rules? Exploring likable voice traits of social robots as active aging companions for tech-savvy baby boomers in Taiwan. Comput Hum Behav 84:194–210

    Article  Google Scholar 

  5. Benitti FBV, Spolaôr N (2017) How have robots supported STEM teaching? In: Robotics in STEM education. Springer, pp 103–129

  6. Koceski S, Koceska N (2016) Evaluation of an assistive telepresence robot for elderly healthcare. J Med Syst 40(5):121

    Article  Google Scholar 

  7. Saygin AP et al (2012) The thing that should not be: predictive coding and the uncanny valley in perceiving human and humanoid robot actions. Soc Cogn Affect Neurosci 7(4):413–422

    Article  Google Scholar 

  8. Hwang J, Park T, Hwang W (2013) The effects of overall robot shape on the emotions invoked in users and the perceived personalities of robot. Appl Ergon 44(3):459–471

    Article  Google Scholar 

  9. Menne IM, Schwab F (2018) Faces of emotion: investigating emotional facial expressions towards a robot. Int J Soc Robot 10(2):199–209

    Article  Google Scholar 

  10. Stanton CJ, Stevens CJ (2017) Don’t stare at me: the impact of a humanoid robot’s gaze upon trust during a cooperative human–robot visual task. Int J Soc Robot 9(5):745–753

    Article  Google Scholar 

  11. Foley GN, Gentile JPJP (2010) Nonverbal communication in psychotherapy. Psychiatry (Edgmont) 7(6):38

    Google Scholar 

  12. Niculescu A et al (2013) Making social robots more attractive: the effects of voice pitch, humor and empathy. Int J Soc Robot 5(2):171–191

    Article  Google Scholar 

  13. Hancock PA et al (2011) A meta-analysis of factors affecting trust in human-robot interaction. Hum Factors 53(5):517–527

    Article  Google Scholar 

  14. Fong T et al (2003) A survey of socially interactive robots. Robot Auton Syst 42(3–4):143–166

    Article  MATH  Google Scholar 

  15. Takayama L, Ju W, Nass C (2008) Beyond dirty, dangerous and dull: what everyday people think robots should do. In: 2008 3rd ACM/IEEE international conference on human-robot interaction (HRI). IEEE

  16. McGinn C, Sena A, Kelly KJAE (2017) Controlling robots in the home: factors that affect the performance of novice robot operators. Appl Ergon 65:23–32

    Article  Google Scholar 

  17. Kim Y, Kwak SS, Kim MS (2013) Am I acceptable to you? Effect of a robot’s verbal language forms on people’s social distance from robots. Comput Hum Behav 29(3):1091–1101

    Article  Google Scholar 

  18. Usui T et al (2008) A robotic KANSEI communication system based on emotional synchronization. In: 2008 IEEE/RSJ international conference on intelligent robots and systems. IEEE

  19. Mitsunaga N et al (2008) What makes people accept a robot in a social environment-discussion from six-week study in an office. In: 2008 IEEE/RSJ international conference on intelligent robots and systems. IEEE

  20. Kanda T,Ishiguro H, Ishida T (2001) Psychological analysis on human-robot interaction. In: Proceedings 2001 ICRA. IEEE international conference on robotics and automation (Cat. No. 01CH37164). IEEE

  21. Aziz AA et al (2015) Autistic children’s kansei responses towards humanoid-robot as teaching mediator. Proced Comput Sci 76:488–493

    Article  Google Scholar 

  22. Fiske ST, Cuddy AJ, Glick P (2007) Universal dimensions of social cognition: warmth and competence. Trends Cogn Sci 11(2):77–83

    Article  Google Scholar 

  23. Fiske ST et al (2002) A model of (often mixed) stereotype content: competence and warmth respectively follow from perceived status and competition. J Personal Soc Psychol 82(6):878

    Article  Google Scholar 

  24. Dou X et al (2020) Effects of different types of social robot voices on affective evaluations in different application fields. Int J Soc Robot 1–14

  25. Apple W et al (1979) Effects of pitch and speech rate on personal attributions. J Personal Soc Psychol 37(5):715

    Article  Google Scholar 

  26. Berry DS (1992) Vocal types and stereotypes: joint effects of vocal attractiveness and vocal maturity on person perception. J Nonverbal Behav 16(1):41–54

    Article  MathSciNet  Google Scholar 

  27. Mori MJE (2012) The uncanny valley (1970). IEEE Robot Autom Mag 7(4):33–35

    Google Scholar 

  28. Rezlescu C et al (2015) Dominant voices and attractive faces: The contribution of visual and auditory information to integrated person impressions. J Nonverbal Behav 39(4):355–370

    Article  Google Scholar 

  29. Baraka K, Paiva A, Veloso M (2016) Expressive lights for revealing mobile service robot state. In: Robot 2015: 2nd Iberian robotics conference. Springer.

  30. Baraka K, Veloso MM (2018) Mobile service robot state revealing through expressive lights: formalism, design, and evaluation. Int J Soc Robot 10(1):65–92

    Article  Google Scholar 

  31. Collins EC, Prescott TJ, Mitchinson B (2015) Saying it with light: a pilot study of affective communication using the MIRO robot. In: Conference on biomimetic and biohybrid systems. Springer

  32. Song S, Yamada S (2018) Bioluminescence-inspired human-robot interaction: designing expressive lights that affect human's willingness to interact with a robot. In: Proceedings of the 2018 ACM/IEEE international conference on human-robot interaction

  33. Westhoven M,van der Grinten T, Mueller S (2019) Perceptions of a help-requesting robot-effects of eye-expressions, colored lights and politeness of Speech. In: Proceedings of mensch und computer, pp 43–54

  34. Baraka K, Rosenthal S, Veloso M (2016) Enhancing human understanding of a mobile robot's state and actions using expressive lights. In: 2016 25th IEEE international symposium on robot and human interactive communication (RO-MAN). IEEE

  35. Roberson D et al (2004) The development of color categories in two languages: a longitudinal study. J Exp Psychol: Gen 133(4):554

    Article  Google Scholar 

  36. Dou X et al (2020) User expectations of social robots in different applications: an online user study. In: International conference on human-computer interaction. Springer

  37. Aaltonen I et al (2017) Hello Pepper, may I tickle you? Children's and adults' responses to an entertainment robot at a shopping mall. In: Proceedings of the companion of the 2017 ACM/IEEE international conference on human-robot interaction

  38. Broadbent E et al (2018) How could companion robots be useful in rural schools? Int J Soc Robot 10(3):295–307

    Article  Google Scholar 

  39. de Graaf MMA, Allouch SB, Klamer T (2015) Sharing a life with Harvey: exploring the acceptance of and relationship-building with a social robot. Comput Hum Behav 43:1–14

    Article  Google Scholar 

  40. Deutsch I et al (2019) Home robotic devices for older adults: opportunities and concerns. Comput Hum Behav 98:122–133

    Article  Google Scholar 

  41. Koay KL et al (2014) Social roles and baseline proxemic preferences for a domestic service robot. Int J Soc Robot 6(4):469–488

    Article  Google Scholar 

  42. Tay B, Jung Y, Park T (2014) When stereotypes meet robots: the double-edge sword of robot gender and personality in human–robot interaction. Comput Hum Behav 38:75–84

    Article  Google Scholar 

  43. Nass C, Steuer J, Tauber ER (1994) Computers are social actors. In: Proceedings of the SIGCHI conference on human factors in computing systems

  44. Chidambaram V, Chiang Y-H, Mutlu B (2012) Designing persuasive robots: how robots might persuade people using vocal and nonverbal cues. In: Proceedings of the 7th annual ACM/IEEE international conference on human–robot interaction

  45. Hendriks B et al (2011) Robot vacuum cleaner personality and behavior. Int J Soc Robot 3(2):187–195

    Article  Google Scholar 

  46. Hegel F et al (2007) Classes of applications for social robots: a user study. In: RO-MAN 2007—the 16th IEEE international symposium on robot and human interactive communication. IEEE

  47. Fink J (2012) Anthropomorphism and human likeness in the design of robots and human-robot interaction. In: International conference on social robotics. Springer

  48. Seitinger S, Taub DM, Taylor AS (2010) Light bodies: exploring interactions with responsive lights. In: Proceedings of the 4th international conference on Tangible, embedded, and embodied interaction

  49. Mutlu B et al (2006) The use of abstraction and motion in the design of social interfaces. In: Proceedings of the 6th conference on designing Interactive systems

  50. Kobayashi K et al (2012) Impressions made by blinking light used to create artificial subtle expressions and by robot appearance in human-robot speech interaction. In: 2012 IEEE RO-MAN: the 21st IEEE international symposium on robot and human interactive communication. IEEE

  51. Valdez P, Mehrabian A (1994) Effects of color on emotions. J Exp Psychol: Gen 123(4):394

    Article  Google Scholar 

  52. Elliot AJ et al (2007) Color and psychological functioning: the effect of red on performance attainment. J Exp Psychol 136(1):154

    Article  Google Scholar 

  53. Wolfe JM, Horowitz TS (2004) What attributes guide the deployment of visual attention and how do they do it? Nat Rev Neurosci 5(6):495–501

    Article  Google Scholar 

  54. Morningstar M, Dirks MA, Huang S (2017) Vocal cues underlying youth and adult portrayals of socio-emotional expressions. J Nonverbal Behav 41(2):155–183

    Article  Google Scholar 

  55. Lee EJ, Nass C, Brave S (2000) Can computer-generated speech have gender? An experimental test of gender stereotype. In: CHI'00 extended abstracts on human factors in computing systems

  56. Jones BC et al (2010) A domain-specific opposite-sex bias in human preferences for manipulated voice pitch. Anim Behav 79(1):57–62

    Article  Google Scholar 

  57. Pernet CR, Belin P (2012) The role of pitch and timbre in voice gender categorization. Front Psychol 3:23

    Article  Google Scholar 

  58. Keating P, Buhr R (1978) Fundamental frequency in the speech of infants and children. J Acoust Soc Am 63(2):567–571

    Article  Google Scholar 

  59. Kent RD (1976) Research, anatomical and neuromuscular maturation of the speech mechanism: evidence from acoustic studies. J Speech Hear Res 19(3):421–447

    Article  MathSciNet  Google Scholar 

  60. Laver J, John L (1994) Principles of phonetics. Cambridge University Press

    Book  Google Scholar 

  61. Cheng YC (1997) The transformational leadership for school effectiveness and development in the new century, pp 407–727

  62. Taipale S et al (2015) Robot shift from industrial production to social reproduction. In: Social robots from a human perspective. Springer, pp 11–24

  63. Robinson H, MacDonald B, Broadbent E (2014) The role of healthcare robots for older people at home: a review. Int J Soc Robot 6(4):575–591

    Article  Google Scholar 

  64. Rosenberg S et al (1968) A multidimensional approach to the structure of personality impressions. J Personal Soc Psychol 9(4):283

    Article  Google Scholar 

  65. McCroskey JC, McCain TA (1974) The measurement of interpersonal attraction, pp 71–140

  66. Ling Z-H, et al (2007) The USTC and iFlytek speech synthesis systems for Blizzard Challenge 2007. In: Blizzard challenge workshop

  67. Klatt DH (1976) Linguistic uses of segmental duration in English: Acoustic and perceptual evidence. J Acoust Soc Am 59(5):1208–1221

    Article  Google Scholar 

  68. Kobayashi K et al (2011) Blinking light patterns as artificial subtle expressions in human-robot speech interaction. In: 2011 RO-MAN. IEEE

  69. Topp EA et al (2006) Bringing together human and robotic environment representations-a pilot study. In: 2006 IEEE/RSJ international conference on intelligent robots and systems. IEEE

  70. Walters ML et al (2009) Preferences and perceptions of robot appearance and embodiment in human-robot interaction trials. Procs of New Frontiers in Human-Robot Interaction, pp 903–516

  71. Labrecque LI, Milne GR (2012) Exciting red and competent blue: the importance of color in marketing. J Acad Market Sci 40(5):711–727

    Article  Google Scholar 

Download references

Funding

This study was funded by Ministry of Science and Technology, Taiwan (107-2221-E-036-014-MY3). Author Chih-fu Wu has received research grants from Ministry of Science and Technology, Taiwan. Author Jin Niu is a student in the Graduate Institute of Design Science of Tatung University, Taipei. Author Xiao Dou is a graduated student of Tatung University. Author Kuan-Ru Pan is a student in Department of Industrial Design of Tatung University.

Author information

Authors and Affiliations

  1. The College of Fine Arts, Guangdong Ploytechnic Normal University, Guangdong, China

    Xiao Dou

  2. Department of Industrial Design, Tatung University, Taipei, Taiwan

    Chih-Fu Wu & Kuan-Ru Pan

  3. The Graduate Institute of Design Science, Tatung University, Taipei, Taiwan

    Jin Niu

Authors
  1. Xiao Dou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chih-Fu Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jin Niu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kuan-Ru Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jin Niu.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

Table 7 Mean and standard deviation of acceptance
Full size table
Table 8 Mean and standard deviation of discomfort
Full size table
Table 9 Mean and standard deviation of warmth
Full size table
Table 10 Mean and standard deviation of Competence
Full size table

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dou, X., Wu, CF., Niu, J. et al. Effect of Voice Type and Head-Light Color in Social Robots for Different Applications. Int J of Soc Robotics 14, 229–244 (2022). https://doi.org/10.1007/s12369-021-00782-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-021-00782-w

Keywords

Search

Navigation