As the field of social robotics has been dynamically growing and expanding over various areas of research and application, in which robots can be of assistance and companionship for humans, this paper offers a different perspective on a role that social robots can also play, namely the role of informing us about flexibility of human mechanisms of social cognition. The paper focuses on studies in which robots have been used as a new type of “stimuli” in psychological experiments to examine whether similar mechanisms of social cognition would be activated in interaction with a robot, as would be elicited in interaction with another human. Analysing studies in which a direct comparison has been made between a robot and a human agent, the paper examines whether for robot agents, the brain re-uses the same mechanisms that have been developed for interaction with other humans in terms of perception, action representation, attention and higher-order social cognition. Based on this analysis, the paper concludes that the human socio-cognitive mechanisms, in adult brains, are sufficiently flexible to be re-used for robotic agents, at least for those that have some level of resemblance to humans.
The field of social robotics has been growing with increasing momentum. The International Journal of Social Robotics—which has recently celebrated its 10th anniversary—has been covering a broad spectrum of research and application areas of social robots, which are being developed to assist humans not only in mundane daily activities but also in healthcare, elderly- and childcare as well as educational activities. Quick overview of the papers published over the years in the area of social robotics across various journals and conferences illustrates that a large amount of effort in social robotics has been dedicated to healthcare (e.g., [1,2,3,4,5,6] for an overview see [7,8,9]), elderly care [10,11,12,13], therapeutical interventions for children [14,15,16,17,18,19,20,21,22,23], or educational applications [24,25,26,27,28,29].
Therefore, one can conclude, based on this collected body of literature, that social robots serve the purpose of being humans’ assistants and companions for not only in healthcare applications but also in daily lives fostering collaboration in the workplace  or assistance at homes, airports and supermarkets [31,32,33].
This paper, however, provides a different perspective on the role of social robots, as it elucidates that social robots can be scientific tools to examine human social cognition system, and its flexibility in particular. The question of interest is whether similar mechanisms of social cognition are elicited by social robots as those elicited by other humans. This paper focuses on examples of socio-cognitive mechanisms that have been studied with robot and human agent stimuli/interaction partners, and the socio-cognitive mechanisms have been directly compared between the two types of agents. The mechanisms this paper addresses are: the perceptual system, action representation system, attention and higher-order cognition.
Encompassing Robots in the Perceptual Apparatus Developed for Natural Agents
Several authors examined the impact of appearance of agents (often presented as either avatars or virtual agents) on perceptual processes. For example  investigated a spectrum of virtual characters ranging from very artificial-looking to natural human-like, all presented in a running movement. The movement was either based on motion capture data from actual humans performing the movement or was constructed through a “key-framing” technique by an animator. Participants’ task was to judge whether the presented movement is biological or artificial, and the key question was whether appearance of the agent would influence that judgment. The results showed that participants had quite good sensitivity in detecting biological motion, and this sensitivity was modulated by appearance only in case of significantly reduced in content stimuli (dot characters vs. full-body characters). However, there was not much difference in sensitivity to biological motion across robot and human characters. This shows that the perceptual system which is sensitive to biological motion might not respond selectively to human-like appearance.
Similarly  showed that the action perception system is not selective to biological motion or appearance, suggesting its “flexibility”, in the sense that it responds similarly to both the natural and artificial agents. Importantly, however, some regions of the system (bilateral anterior intraparietal sulcus specifically) responded more pronouncedly to the condition in which an agent had a very human-like appearance (an android) but mechanistic behaviour, suggesting that those regions are a neural marker of the uncanny valley phenomenon .
However, as the stimuli in these studies were 2D, presented on the screen, it remains to be examined whether appearance would not affect perception of biological motion when the observed character is actually a physically present embodied agent.
In the context of perceptual system for emotional expressions, Chaminade and colleagues  found that participants rate intensity of expressed emotions higher for human face stimuli, as compared to robot face stimuli, when the emotions are negative (anger and disgust specifically). Interestingly, at the neural level, brain regions related to perceptual processing showed higher activation for robot stimuli, compared to human stimuli, but areas implicated in emotional resonance showed reduced activity for the robots. The authors conclude that robots with highly mechanical features might not induce the same degree of resonance as other human conspecifics. Due to unfamiliarity with robots, the perceptual levels of processing might have required engagement of additional resources in order to for example, recognize a robot “face” as a face. Interestingly, as there was no difference between robot and human stimuli in processing of gestures in the area typically responsible for gesture recognition (right superior temporal gyrus), this shows the flexibility of human perception for reusing the same system for human and artificial agents, in terms of gesture recognition.
Re-using Action Perception System for Representing and Resonating with Robot’s Movements
Researchers addressed the question of whether the neural system underlying action representation when observing other humans is activated also when observing the actions of robots. Specifically, the crucial question to ask is the importance of human-like motion appearance on motor resonance [38, 39]. Some authors showed a diminished effect of motor resonance during observation or imitation of robot actions [40, 41]. Specifically, Kilner et al.  showed that motor interference effect occurring during observation of actions that are incongruent to the concurrently performed actions can be observed when participants perform the action together with another human, but not with a robotic agent. Interestingly, when an industrial robotic arm has been replaced by a more human-like humanoid robot , the interference effect was similar for the humanoid and the human agent conditions, an effect observed also in . Similarly  showed interference effects in an imitation task for both human and robotic hand stimuli. However, the effect observed in their study was more pronounced for human than for robot stimuli. It is plausible, though, that the slightly smaller effect for the robot condition was due to that the robot hand stimuli were presented on a screen, thus lacking natural embodied presence that actual robots offer when placed in front of participants. However, another study , followed up this line of research and demonstrated (with video stimuli presented on a computer screen) that human-like joint configuration is the critical factor for interference effects to occur.
In a different type of paradigm, Wykowska and colleagues  showed that a system for action representation, which influences attentional selection of perceptual features, is similarly activated by robot-like arm stimuli (depicting pointing and grasping actions) as by human-like arms representing the same actions. This speaks in favour of re-using the action-perception system developed for representing actions of other humans for representing also actions of artificial (human-like) agents.
In a study using functional magnetic resonance imaging (fMRI), Gazzola and colleagues  showed that the mirror neuron system responded similarly to robot and human actions, as long as same actions were not repeated over many trials. This certainly shows that the motor resonance system is sufficiently flexible to respond not only to natural but also artificial agents. However,  reported results seemingly at odds with the previous findings. In an experimental design where dynamic stimuli (videos) of human and robot-like agents were presented to participants in a smooth, fluid, human-like dance motion or displaying a rigid robot-like movements, the action observation system was actually more strongly activated for the robot-like movements, compared to the human-like fluid motion, independent of the agent type. Similarly to the findings in , this suggests that the human perceptual and action observations systems are more sensitive to movement characteristics than to the form of the agents itself. Interestingly, the study in  shows—in contrast to previous interpretations of the function of the action observation system —that the system is not necessarily selective to actions that are familiar to the observer, or that are closer to the observers’ motor repertoire. On the contrary, it might show a non-linear response pattern, with highest activation for extremely familiar and non-familiar movements, and lower activation for movements occupying the space in-between the two extremes.
Another question related to flexibility of action representation system is whether humans are capable of understanding robot’s affordances . As reviewed in , some studies showed that humans are capable of perceiving robot’s affordances with respect to moving through an aperture of a certain width . However, as interestingly pointed out in , it remains to be examined whether robots with motor repertoire different from that of humans would still allow for correct attribution of affordances. Human-like shape (implying human-like motor repertoire) might be an important factor for the action perception system, a suggestion in line with the findings in .
In sum, the state-of-the-art evidence collected in studies focusing on motor resonance or action representation in general show that this system is flexible enough to respond not only to natural conspecifics but also to other artificial agents, as long as some resemblance to humans is preserved.
Triggering Attentional Orienting by Robot’s Social Signals
Another large body of research has been dedicated to attentional processes in relation to stimuli depicting natural and artificial agents. Specifically, gaze-induced joint attention has been widely investigated. Joint attention is one of the most fundamental mechanisms of social cognition . In fact, when individuals suffer from deficiencies in the ability to engage with others in joint attention, this affects other, multifaceted and higher-order mechanisms of social cognition . Joint attention is a mechanism that allows two individuals to attend the same object or event in the environment [53, 54]. It is an evolutionarily adaptive mechanism [55,56,57], as attending where others attend can inform us about behaviourally relevant events in the environment, as well as the others’ intentions, action plans and successive action steps [58,59,60,61]. Joint attention is often established by directional gaze [52, 57] or other communicative gestures such as pointing [62,63,64,65]. In the context of this paper, it is important to address the question of whether similar joint attention mechanisms are evoked by robot agents, as in the case of human stimuli.
This question was examined in  with a gaze cueing paradigm [67, 68]. The gaze cueing paradigm is a modified Posner protocol  which is typically used to test attentional orienting in response to a directional cue. In a standard Posner paradigm, participants are asked to detect or discriminate a target presented in one (usually lateral) side of the computer screen. A centrally presented directional cue (for example, an arrow) orients attention to one of the sides (either the same side where the target will later appear, or towards a different location. The typical pattern of results shows that participants are better in detecting targets that are presented at cued, compared to uncued, locations, as their attention has been focused on the cued location prior to target presentation. Similar logic has been used for eye-like stimuli, which can serve as directional cues, orienting attention to a specific location. Gaze-related attention orienting (gaze cueing effects) have been observed for schematic face stimuli  and also for pictures of human faces .
Wiese and colleagues  presented participants with robot and human face stimuli. The results showed larger gaze cueing effects for human faces, relative to robot faces. However, this effect was not so much dependent on the actual appearance (robot vs. human) but rather on the belief that participants held regarding who actually “controls” the eye movements (a human agent or a pre-programmed algorithm). This initial behavioural effect was then paralleled by event-related potentials (ERPs) of the electroencephalogram (EEG) signal related to attentional processing  and fMRI results  indicating that the critical difference in observed in behaviour is mirrored by differential pattern of activation in the bilateral anterior temporo-parietal junction (TPJ), a region typically involved in attentional re-orienting as well as mentalizing [71, 72].
However, it might be that when a robot is more human-like in appearance than the robot used in [70,71,72], the gaze cueing effects would be elicited to the same degree as in the case of human agents. This is suggested by the series of studies of Kompatsiari and colleagues [73, 74]. In those studies, however, there was no direct comparison with the human, and thus it is not clear whether the observed gaze cueing effects elicited by a robot agent were of the same magnitude as they would be for human agents.
Admoni and colleagues  compared the gaze cueing effects across various agent types (pictures of a human face, schematic face drawings, pictures of a Zeno robot (Hanson RoboticsFootnote 1), and pictures of Keepon, a robot developed by Hideki KozimaFootnote 2) in a counter-predictive cueing procedure. The results showed no indication of reflexive orienting to directional cues from robot face stimuli. Interestingly, however, there was also no clear indication of reflexive orienting towards human gaze. This might be due to insufficient statistical power in the experimental design (for a similar argument, see ).
One interesting question that needs to be asked is to what extent human-likeness of appearance and/or behaviour of a robot elicits attentional orienting mechanisms. Abubshait and Wiese  addressed this question in a gaze-cueing paradigm in which both appearance and behaviour were manipulated. The authors presented to participants photographs of human and robot faces which could cue target location with either 50% probability (random condition) or with 80% probability (reliable condition). The results showed that the gaze cueing effects depended on reliability of behaviour, but not on the type of agent. Similarly, Martini and colleagues  examined the impact of appearance, showing an inverted-u shape of magnitude of the gaze cueing effect, in relation to human-like appearance. The authors used a morphing technique to present to participants human and robot faces with different degrees of human-likeness. The results showed that morphs that we were more in the fuzzy area in-between human and robot appearance elicited reflexive attentional-orienting response (the cueing procedure was counter-predictive), while 100% human and 100% robot faces induced reverse gaze cueing effects. Results of both studies show that robot and human faces are capable of evoking similar attentional mechanisms of the human brain. In a similar vein, Chaminade and Okka  showed that there was no difference in the head-cueing effect between a human and robot agent (NAOFootnote 3), suggesting that the attentional orienting system that is used for responding to directional cues provided by other humans is also used for artificial agents, if the cue is salient enough.
However, and interestingly for the purposes of this paper, Okumura and colleagues  examined the developmental factor in gaze-related attentional orienting towards human and robot gaze. The question of interest was whether young children (toddlers) develop joint attention with robots as early as joint attention with humans. The results showed that both 10-month old toddlers and 12-month old children follow the gaze of robots and humans to the same extent. However, only 12-month old children showed anticipatory effects related to an object presented in the cued location, and only for the human faces. The authors argue that this effect is related to expectations and predictions of the upcoming object presentation. An alternative explanation of a sustaining effect of human gaze on attentional focus has been ruled out by the design, which included a fixation point in the middle of the screen reorienting the gaze of children to the center, before presenting anticipatory placeholders in which a target object would later appear, and anticipatory gaze would be measured. The authors interpret this pattern of results in the context of possible difference in communicative content expected in human gaze, but not in robot gaze. This would be in line with the results reported in  and in  where it has been shown that the belief regarding the agency (human vs. pre-programmed robot) underlying the observed behaviour, independent of the actual appearance, modulates the magnitude of gaze cueing effects. This also suggests the impact of assumed communicative content on engagement in joint attention. Okumura and colleagues  discuss two additional potential alternative explanations of their effects: one related to higher degree of experience and exposure to human faces, as compared to robots, and the other being learned associations between human gaze and a subsequent appearance of an interesting event in the environment.
In either case, it seems that the human attention system is flexible enough to respond to directional cues provided not only by conspecifics, but also by artificial robot agents. However, this flexibility needs some time to develop, as shown in . One interesting question remaining for future research is whether similar gaze cueing effects occur for human and robot interaction partners in more naturalistic interactive scenarios. Perez-Osorio and colleagues examined gaze cueing effects with human-agent stimuli on the screen [60, 61] and showed that the effects are modulated by action expectations of the observer. In a follow-up study , the paradigm was implemented in an interactive protocol with the embodied iCub  robot (Fig. 1), and the effect was replicated. However, a direct comparison between an embodied robot and another human co-agent is still missing for drawing definite conclusions.
The Cognitive System for Reasoning About Others’ Motives Underlying Behaviour
A crucial higher-order mechanism of social cognition is mentalizing, namely tracking others’ mental states . This is one of the key mechanisms allowing predicting and explaining other people’s behaviour. In order to involve in a mentalizing process, one needs to adopt the intentional stance , namely one needs to treat the agent they are referring to as an intentional system, capable of having mental states. Several researchers have addressed the question of whether humans activate the mechanisms of mentalising towards robots, as much as they do towards other humans. For example  extended a previous paradigm  and examined adoption of the intentional stance towards a robot, a computer program and a human agent in an fMRI study. The results showed that at the neural level, human partners uniquely activate mentalizing areas, which are not elicited during interaction with an artificial agent. This might suggest that the mechanisms involved in mentalizing processes are special for social interactions with other humans, and do not necessarily extend to interactions with artificial agents such as robots. Similarly, Levin et al.  examined whether participants would attribute human-like mental processes to a robot or a computer in a task with scenarios with open endings. The results showed that intentional ascriptions were significantly more frequent towards human agents than towards a computer or a robot. Also Marchesi and colleagues , with a novel tool, the Intentional Stance Questionnaire, showed that participants were more likely to give mentalistic explanations to observed behaviour of a human agent, relative to a robot for whom the mechanistic descriptions were more frequent. However, even though participants were more likely to use mechanistic terms in describing robot behaviours, the mentalistic explanations for robot behaviour were not uncommon. In contrast, Thellman et al. , as well as de Graaf and Malle , showed that people actually use similar descriptions for robot behavior as they would use for humans, specifically regarding ascription of intentionality.
The fact that humans might (in some cases) ascribe intentionality to robots, and/or explain and predict their behaviour with reference to mental states shows that our cognitive system uses the tools it has developed throughout the history of humankind to accommodate for new types of situations, such as social interactions with artificial agents. This would potentially show flexibility of the cognitive system, whose mechanisms that have been developed for natural interactions with conspecifics and other beings of natural kind seem to be hijacked by other types of agents, those that do not belong to the natural order. However, the existing body of literature related to attribution of mental states to robots provides a mixed picture. It seems that in some cases the mentalizing system is also used for artificial agents, but it is not always the case. It remains to be answered with future research what are the crucial conditions for attribution of mental states to robots. In the literature reviewed here, it might be that the different ways of operationalising intentional stance yielded different results. Indeed, operationalising a high-level philosophical concept, such as intentional stance , is quite challenging. For example, in , the intentional stance was operationalised in form of an interactive game of rock-paper-scissors where the participants were asked to determine whether they thought they were playing against a computer programme or another human. In this case, the dependent variable was differential activation in the social brain areas that could be interpreted as related to adoption of intentional stance, similarly to . On the other hand, in [88, 89], participants observed static pictures and their task was to choose descriptions of the observed behaviours of either human or robot agents. The dependent variable was subjective ratings regarding mentalistic or mechanistic descriptions of behaviours. In  participants read text descriptions of robot or human behaviours and they were asked to provide verbal written explanation of the behaviour. Thus, the discrepancy between results can potentially result from the difference in paradigms (interactive  vs. passive observation or reading written text [88,89,90]; judgment of behaviour of an actually presented agent [88, 89] vs. judgment of agency based on the observed behaviour as in ), difference in the adopted measures (brain activity  vs. subjective judgments [88,89,90] as well as type of presented agents (iCub robot  vs. Pepper ). Finally, the type of body postures depicted in the visual stimuli [88, 89] and context might have also played a role. In order to understand the discrepancy between results and potential factors contributing to the likelihood of adopting the intentional stance towards robots, it would be desirable to develop a common unified way of operationalising certain concepts, and common way of measuring them, and preferably studies performed across various robot platforms to test whether the obtained effects are generalizable across a variety of robot embodiments. This would be an important approach not only in the case of addressing socio-cognitive mechanisms such as mentalising but also a general suggestion for measuring human cognitive mechanisms in the context of social robotics research and human–robot interaction overall.
In this paper, I aimed to show that social robots – apart from playing the role of assistants and companions in various domains of human life—can also inform us about the flexibility of the human socio-cognitive system, which, in many cases, is apparently capable of incorporating artificial agents—at least those that are to some extent similar in appearance to humans—into the social sphere, by reusing the same mechanism as it would use in interactions with other conspecifics. However, this flexibility might need some time to develop, and some socio-cognitive mechanisms, such as application of social norms, or in some cases mentalising, might be uniquely specific for interactions with other humans. Moreover, in order to draw more generalisable conclusions, this field of research would benefit from replicating studies with unified experimental protocols addressing a cognitive mechanism in question across various robot platforms to test whether the observed effects are not due to a particular robot shape. Despite these limitations of the present state-of-the-art, the literature reviewed in this paper shows how wide is the application and scientific contribution of social robotics, extending beyond application areas to more theoretical and fundamental questions related to human social cognition. Therefore, as the social robotics field is largely multidisciplinary and with broad potential contributions to applied and fundamental science, the International Journal of Social Robotics shall continue to blossom with a wide variety of topics related to research and application of robots for society.
Hogan N, Krebs HI (2004) Interactive robots for neuro-rehabilitation. Restor Neurol Neurosci 22(3–5):349–358
Prange GB, Jannink MJA, Groothuis-Oudshoorn CGM, Hermens HJ, Ijzerman MJ (2006) Systematic review of the effect of robot-aided therapy on recovery of the hemiparetic arm after stroke. J Rehabil Res Dev 43(2):171–184
Basteris A, Nijenhuis SM, Stienen AHA, Buurke JH, Prange GB, Amirabdollahian F (2014) Training modalities in robot-mediated upper limb rehabilitation in stroke: A framework for classification based on a systematic review. J Neuroeng Rehabil 11(1):111
Fujita M, Kitano H (1998) Development of an autonomous quadruped robot for robot entertainment. Auton Robots. https://doi.org/10.1023/A:1008856824126
Shibata T, Mitsui T, Wada K, Touda A, Kumasaka T, Tagami K, Tanie K (2001) Mental commit robot and its application to therapy of children. In: IEEE/ASME international conference on advanced intelligent mechatronics, AIM
Yamazaki R, Christensen L, Skov K, Chang CC, Damholdt MF, Sumioka H, Nishio S, Ishiguro H (2016) Intimacy in phone conversations: anxiety reduction for Danish seniors with hugvie. Front Psychol. https://doi.org/10.3389/fpsyg.2016.00537
Matarić MJ, Tapus A (2006) The promises and challenges of socially assistive robotics. In: 50th Anniversary AI Summit, Monte Verita, Switzerland
Tapus A, Mataric M, Scassellati B (2007) Socially assistive robotics: The grand challenges in helping humans through social interaction. IEEE Robot Autom Mag. https://doi.org/10.1109/MRA.2007.339605
Tapus A, Mataric MJ (2006) Towards socially assistive robotics. J Robot Soc Jpn. https://doi.org/10.7210/jrsj.24.576
Birks M, Bodak M, Barlas J, Harwood J, Pether M (2016) Robotic seals as therapeutic tools in an aged care facility: a qualitative study. J Aging Res. https://doi.org/10.1155/2016/8569602
Martin F et al (2013) Robots in therapy for dementia patients. J Phys Agents 7(1):48–55
Wada K, Shibata T (2006) Robot therapy in a care house—its sociopsychological and physiological effects on the residents. In: Proceedings IEEE international conference on robotics and automation
Wada K, Shibatal T, Musha T, Kimura S (2005) Effects of robot therapy for demented patients evaluated by EEG. In: 2005 IEEE/RSJ international conference on intelligent robots and systems, IROS
Dautenhahn K (2003) Roles and functions of robots in human society: Implications from research in autism therapy. Robotica. https://doi.org/10.1017/S0263574703004922
Robins B, Dautenhahn K, Te BR, Billard A (2005) Robotic assistants in therapy and education of children with autism: Can a small humanoid robot help encourage social interaction skills? Univ Access Inf Soc. https://doi.org/10.1007/s10209-005-0116-3
Ricks DJ, Colton MB (2010) Trends and considerations in robot-assisted autism therapy. In: Proceedings of IEEE international conference on robotics and automation
Scassellati B, Admoni H, Matarić M (2012) Robots for use in autism research. Annu Rev Biomed Eng. https://doi.org/10.1146/annurev-bioeng-071811-150036
Tapus A, Peca A, Aly A, Pop C, Jisa L, Pintea S, Rusu AS, David DO (2012) Children with autism social engagement in interaction with Nao, an imitative robot: a series of single case experiments. Interact Stud Stud Soc Behav Commun Biol Artif Syst. https://doi.org/10.1075/is.13.3.01tap
Cabibihan JJ, Javed H, Ang M, Aljunied SM (2013) Why robots? A survey on the roles and benefits of social robots in the therapy of children with autism. Int J Soc Robot 5(4):593–618
Anzalone SM, Tilmont E, Boucenna S, Xavier J, Jouen AL, Bodeau N, Maharatna K, Chetouani M, Cohen D (2014) How children with autism spectrum disorder behave and explore the 4-dimensional (spatial 3D + time) environment during a joint attention induction task with a robot. Res Autism Spectr Disord. https://doi.org/10.1016/j.rasd.2014.03.002
Bekele E, Crittendon JA, Swanson A, Sarkar N, Warren ZE (2014) Pilot clinical application of an adaptive robotic system for young children with autism. Autism. https://doi.org/10.1177/1362361313479454
Warren ZE, Zheng Z, Swanson AR, Bekele E, Zhang L, Crittendon JA, Weitlauf AF, Sarkar N (2015) Can robotic interaction improve joint attention skills? J Autism Dev Disord. https://doi.org/10.1007/s10803-013-1918-4
Kajopoulos J, Wong AHY, Yuen AWC, Dung TA, Kee TY, Wykowska A (2015) Robot-assisted training of joint attention skills in children diagnosed with Autism. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)
Mubin O, Stevens CJ, Shahid S, Al MA, Dong J-J (2013) A review of the applicability of robots in education. Technol Educ Learn. https://doi.org/10.2316/journal.209.2013.1.209-0015
Chang CW, Lee JH, Chao PY, Wang CY, Chen GD (2010) Exploring the possibility of using humanoid robots as instructional tools for teaching a second language in primary school. Educ Technol Soc 13(2):13–24
Castledine AR, Chalmers C (2011) LEGO Robotics: an authentic problem solving tool? Design and Technology Education: an International Journal 16:3. ISSN 1360-1431. https://ojs.lboro.ac.uk/DATE/article/view/1661
Kory J, Breazeal C (2014) Storytelling with robots: learning companions for preschool children’s language development. In: IEEE RO-MAN 2014–23rd IEEE international symposium on robot and human interactive communication: human–robot co-existence: adaptive interfaces and systems for daily life, therapy, assistance and socially engaging interactions
Fernandes E, Fermé E, Oliveira R (2006) Using robots to learn functions in math class. In: Proceedings of ICMI 17 study conference background paper ICMI
Church W, Ford T, Perova N, Rogers C (2010) Physics with robotics using LEGO® MINDSTORMS® in high school education. In: AAAI spring symposium—technical report
Hinds PJ, Roberts TL, Jones H (2004) Whose job is it anyway? A study of human–robot interaction in a collaborative task. J Hum Comput Interact. https://doi.org/10.1207/s15327051hci1901&2_7
Kidd CD, Breazeal C (2008) Robots at home: understanding long-term human–robot interaction. In: 2008 IEEE/RSJ international conference on intelligent robots and systems, IROS
Graf B, Reiser U, Hägele M, Mauz K, Klein P (2009) Robotic home assistant care-O-bot® 3—Product vision and innovation platform. In: Proceedings of IEEE workshop on advanced robotics and its social impacts, ARSO
Triebel R et al. (2016) SPENCER: a socially aware service robot for passenger guidance and help in busy airports. In: Springer tracts in advanced robotics
Chaminade T, Hodgins J, Kawato M (2007) Anthropomorphism influences perception of computer-animated characters’ actions. Soc Cognit Affect Neurosci. https://doi.org/10.1093/scan/nsm017
Saygin AP, Chaminade T, Ishiguro H, Driver J, Frith C (2012) The thing that should not be: predictive coding and the uncanny valley in perceiving human and humanoid robot actions. Soc Cognit Affect Neurosci. https://doi.org/10.1093/scan/nsr025
Mori M (1970) Bukimi No Tani [The Uncanny Valley]. Energy
Chaminade T, Zecca M, Blakemore SJ, Takanishi A, Frith CD, Micera S, Dario P, Rizzolatti G, Gallese V, Umiltà MA (2010) Brain response to a humanoid robot in areas implicated in the perception of human emotional gestures. PLoS One 5(7):e11577
Gallese V, Fadiga L, Fogassi L, Rizzolatti G (1996) Action recognition in the premotor cortex. Brain. https://doi.org/10.1093/brain/119.2.593
Decety J, Grèzes J (1999) Neural mechanisms subserving the perception of human actions. Trends Cognit Sci 3(5):172–178
Kilner JM, Paulignan Y, Blakemore SJ (2003) An interference effect of observed biological movement on action. Curr Biol. https://doi.org/10.1016/S0960-9822(03)00165-9
Press C, Bird G, Flach R, Heyes C (2005) Robotic movement elicits automatic imitation. Cognit Brain Res. https://doi.org/10.1016/j.cogbrainres.2005.08.020
Oztop E, Chaminade T, Franklin DW (2004) Human-humanoid interaction: Is a humanoid robot perceived as a human? In: 2004 4th IEEE-RAS international conference on humanoid robots
Bisio A, Sciutti A, Nori F, Metta G, Fadiga L, Sandini G, Pozzo T (2014) Motor contagion during human–human and human–robot interaction. PLoS ONE 9(8):e106172
Kupferberg A, Huber M, Helfer B, Lenz C, Knoll A, Glasauer S (2012) Moving just like you: motor interference depends on similar motility of agent and observer. PLoS One. https://doi.org/10.1371/journal.pone.0039637
Wykowska A, Chellali R, Al-Amin MM, Müller HJ (2014) Implications of robot actions for human perception. How do we represent actions of the observed robots? Int J Soc Robot. https://doi.org/10.1007/s12369-014-0239-x
Gazzola V, Rizzolatti G, Wicker B, Keysers C (2007) The anthropomorphic brain: the mirror neuron system responds to human and robotic actions. Neuroimage. https://doi.org/10.1016/j.neuroimage.2007.02.003
Cross ES, Liepelt R, Antonia AF, Parkinson J, Ramsey R, Stadler W, Prinz W (2012) Robotic movement preferentially engages the action observation network. Hum Brain Mapp. https://doi.org/10.1002/hbm.21361
Calvo-Merino B, Glaser DE, Grezes J, Passingham RE, Haggard P (2005) Action observation and acquired motor skills: an fMRI study with expert dancers. Cereb Cortex 15:1243–1249
Gibson JJ (1977) The theory of affordances. In: Shaw RE, Bransford J (eds) Perceiving, acting, and knowing: toward an ecological psychology. Lawrence Erlbaum, Hillsdale, pp 67–82
Jones KS, Schmidlin EA (2011) Human–robot interaction: toward usable personal service robots. Rev Hum Factors Ergon 7(1):100–148
Moore KS, Gomer JA, Pagano CC, Moore DD (2009) Perception of robot passability with direct line of sight and teleoperation. Hum Factors 51:557–570
Baron CS (1997) Mindblindness: essay on autism and the theory of mind, learning. In: Development and conceptual change, MIT Press, New York.
Moore C, Dunham PJ (1997) Joint attention: its origins and role in development. Contemp Psychol
Symons LA, Lee K, Cedrone CC, Nishimura M (2004) What are you looking at? Acuity for triadic eye gaze. J Gen Psychol 131(4):451
Shepherd SV (2010) Following gaze: gaze-following behavior as a window into social cognition. Front Integr Neurosci. https://doi.org/10.3389/fnint.2010.00005
Tomasello M, Hare B, Lehmann H, Call J (2007) Reliance on head versus eyes in the gaze following of great apes and human infants: the cooperative eye hypothesis. J Hum Evol. https://doi.org/10.1016/j.jhevol.2006.10.001
Emery NJ (2000) The eyes have it: The neuroethology, function and evolution of social gaze. Neurosci Biobehav Rev 24(6):581–604
Flanagan JR, Johansson RS (2003) Action plans used in action observation. Nature. https://doi.org/10.1038/nature01861
Hayhoe MM, Shrivastava A, Mruczek R, Pelz JB (2003) Visual memory and motor planning in a natural task. J Vis. https://doi.org/10.1167/3.1.6
Perez-Osorio J, Müller HJ, Wiese E, Wykowska A (2015) Gaze following is modulated by expectations regarding others’ action goals. PLoS One. https://doi.org/10.1371/journal.pone.0143614
Perez-Osorio J, Müller HJ, Wykowska A (2017) Expectations regarding action sequences modulate electrophysiological correlates of the gaze-cueing effect. Psychophysiology. https://doi.org/10.1111/psyp.12854
Perrett DI, Hietanen JK, Oram MW, Benson PJ (1992) Organization and functions of cells responsive to faces in the temporal cortex. Philos Trans R Soc Lond B Biol Sci. https://doi.org/10.1098/rstb.1992.0003
Hamilton SJ (2017) The effects of pointing gestures on visual attention. University Honors Program Theses. https://digitalcommons.georgiasouthern.edu/honors-theses/243
Langton SRH, Bruce V (2000) You must see the point: automatic processing of cues to the direction of social attention. J Exp Psychol Hum Percept Perform. https://doi.org/10.1037/0096-1522.214.171.1247
Wykowska A, Kajopoulos J, Obando-Leitón M, Chauhan SS, Cabibihan JJ, Cheng G (2015) Humans are well tuned to detecting agents among non-agents: examining the sensitivity of human perception to behavioral characteristics of intentional systems. Int J Soc Robot. https://doi.org/10.1007/s12369-015-0299-6
Wiese E, Wykowska A, Zwickel J, Müller HJ (2012) I see what you mean: how attentional selection is shaped by ascribing intentions to others. PLoS ONE 7(9):e45391
Friesen CK, Kingstone A (1998) The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychon Bull Rev. https://doi.org/10.3758/BF03208827104
Driver J, Davis G, Ricciardelli P, Kidd P, Maxwell E, Baron-Cohen S (1999) Gaze perception triggers reflexive visuospatial orienting. Vis Cognit. https://doi.org/10.1080/135062899394920
Posner MI (1980) Orienting of attention. Q J Exp Psychol. https://doi.org/10.1080/00335558008248231
Wykowska A, Wiese E, Prosser A, Müller HJ (2014) Beliefs about the minds of others influence how we process sensory information. PLoS One. https://doi.org/10.1371/journal.pone.0094339
Özdem C, Wiese E, Wykowska A, Müller H, Brass M, Van Overwalle F (2017) Believing androids—fMRI activation in the right temporo-parietal junction is modulated by ascribing intentions to non-human agents. Soc Neurosci 12(5):582–593
Krall SC, Rottschy C, Oberwelland E, Bzdok D, Fox PT, Eickhoff SB, Fink GR, Konrad K (2015) The role of the right temporoparietal junction in attention and social interaction as revealed by ALE meta-analysis. Brain Struct Funct 220(2):587–604
Kompatsiari K, Ciardo F, Tikhanoff V, Metta A, Wykowska A (2018) On the role of eye contact in gaze cueing. Sci Rep 8:17842. https://doi.org/10.1038/s41598-018-36136-2
Kompatsiari K, Pérez-Osorio J, De Tommaso D, Metta G, Wykowska A (2018) Neuroscientifically-grounded research for improved human–robot interaction. In: 2018 IEEE/RSJ international conference on intelligent robots and systems (IROS), Madrid, Spain, pp 3403–3408
Admoni H, Bank C, Tan J, Toneva M, Scassellati B (2011) Robot gaze does not reflexively cue human attention. In: Carlson L, Hölscher C, Shipley TF (Eds) Expanding the space of cognitive science: proceedings of the 33rd annual meeting of the cognitive science society. Austin, TX: Cognitive Science Society, pp 1983–1988
Chevalier P, Kompatsiari K, Ciardo F, Wykowska A (2020) Examining joint attention with the use of humanoid robots—a new approach to study fundamental mechanisms of social cognition. Psychon Bull Rev. https://doi.org/10.3758/s13423-019-01689-4
Abubshait A, Wiese E (2017) You look human, but act like a machine: agent appearance and behavior modulate different aspects of human–robot interaction. Front Psychol 8:1393
Martini MC, Gonzalez CA, Wiese E (2016) Seeing minds in others—Can agents with robotic appearance have human-like preferences? PLoS One. https://doi.org/10.1371/journal.pone.0146310
Chaminade T, Okka MM (2013) Comparing the effect of human- oid and human face for the spatial orientation of attention. Front Neurorobotics 7:12
Okumura Y, Kanakogi Y, Kanda T, Ishiguro H, Itakura S (2013) Infants understand the referential nature of human gaze but not robot gaze. J Exp Child Psychol 116:86–95
Pérez-Osorio J, De Tommaso D, Baykara E, Wykowska A (2018) Joint Action with iCub: a successful adaptation of a paradigm of cognitive neuroscience in HRI. In: RO-MAN 2018—27th IEEE international symposium on robot and human interactive communication
Metta G, Natale L, Nori F, Sandini G, Vernon D, Fadiga L, von Hofsten C, Rosander K, Lopes M, Santos-Victor J, Bernardino A, Montesano L (2010) The iCub humanoid robot: an open-systems platform for research in cognitive development. Neural Netw. https://doi.org/10.1016/j.neunet.2010.08.010
Frith CD, Frith U (2012) Mechanisms of social cognition. Ann Rev Psychol 63(1):287–313
Dennett DC (1997) True believers: the intentional strategy and why it works. Mind Des. https://doi.org/10.1007/s13398-014-0173-7.2
Chaminade T, Rosset D, Da Fonseca D, Nazarian B, Lutcher E, Cheng G, Deruelle C (2012) How do we think machines think? An fMRI study of alleged competition with an artificial intelligence. Front Hum Neurosci. https://doi.org/10.3389/fnhum.2012.00103
Gallagher HL, Jack AI, Roepstorff A, Frith CD (2002) Imaging the intentional stance in a competitive game. Neuroimage 16:814–821
Levin DT, Killingsworth SS, Saylor MM (2008) Concepts about the capabilities of computers and robots: a test of the scope of adults’ theory of mind. In: Proceedings of the 3rd ACM/IEEE international conference on human–robot interaction. New York, Association for Computing Machinery, pp 57–64
Marchesi S, Ghiglino D, Ciardo F, Perez-Osorio J, Baykara E, Wykowska A (2019) Do we adopt the intentional stance toward humanoid robots? Front Psychol. https://doi.org/10.3389/fpsyg.2019.00450
Thellman S, Silvervarg A, Ziemke T (2017) Folk-psychological interpretation of human vs. humanoid robot behavior: exploring the intentional stance toward robots. J Front Psychol. https://doi.org/10.3389/fpsyg.2017.01962
De Graaf MMA, Malle BF (2019) People’s explanations of robot behavior subtly reveal mental state inferences. In: ACM/IEEE international conference on human–robot interaction
Open access funding provided by Istituto Italiano di Tecnologia within the CRUI-CARE Agreement. This work has received support from the European Research Council under the European Union’s Horizon 2020 research and innovation programme, ERC Starting grant ERC-2016-StG-715058, awarded to Agnieszka Wykowska. The content of this paper is the sole responsibility of the author. The European Commission or its services cannot be held responsible for any use that may be made of the information it contains.
Conflict of interest
The author declares that she has no conflict of interest.
About this article
Cite this article
Wykowska, A. Social Robots to Test Flexibility of Human Social Cognition. Int J of Soc Robotics 12, 1203–1211 (2020). https://doi.org/10.1007/s12369-020-00674-5
- Human social cognition
- Social robotics
- Experimental psychology
- Cognitive neuroscience
- Human–robot interaction