Abstract
In this study we investigated how perception of the eye expression in a face is influenced by the mouth expression, even when only the eyes are directly looked at. The same eyes appeared in a face with either an incongruent smiling, angry, or sad mouth, a congruent mouth, or no mouth. Attention was directed to the eyes by means of cueing and there were no fixations on the mouth. Participants evaluated whether the eyes were happy (or angry, or sad) or not. Results indicated that the smile biased the evaluation of the eyes towards happiness to a greater extent than an angry or a sad mouth did towards anger or sadness. The smiling mouth was also more visually salient than the angry and the sad mouths. We conclude that the role of the eyes as a “window” to a person’s emotional and motivational state is constrained and distorted by the configural projection of an expressive mouth, and that this effect is enhanced by the high visual saliency of the smile.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Adams, R. B., Jr, Ambady, N., Macrae, C. N., & Kleck, R. E. (2006). Emotional expressions forecast approach-avoidance behavior. Motivation and Emotion, 30, 179–188. doi:10.1007/s11031-006-9020-2.
Adams, R. B., Jr, & Kleck, R. E. (2005). The effects of direct and averted gaze on the perception of facially communicated emotion. Emotion, 5, 3–11. doi:10.1037/1528-3542.5.1.3.
Adolphs, R. (2002). Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews, 1, 21–62. doi:10.1177/1534582302001001003.
Ambadar, Z., Cohn, J. F., & Reed, L. I. (2009). All smiles are not created equal: Morphology and timing of smiles perceived as amused, polite, and embarrassed/nervous. Journal of Nonverbal Behavior, 33, 17–34. doi:10.1007/s10919-008-0059-5.
Calder, A. J., Young, A. W., Keane, J., & Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 527–551. doi:10.1037/0096-1523.26.2.527.
Calvo, M. G., & Lundqvist, D. (2008). Facial expressions of emotion (KDEF): Identification under different display-duration conditions. Behavior Research Methods, 40, 109–115. doi:10.3758/BRM.40.1.109.
Calvo, M. G., & Marrero, H. (2009). Visual search of emotional faces: The role of affective content and featural distinctiveness. Cognition and Emotion, 23, 782–806. doi:10.1080/02699930802151654.
Calvo, M. G., & Nummenmaa, L. (2008). Detection of emotional faces: Salient physical features guide effective visual search. Journal of Experimental Psychology: General, 137, 471–494. doi:10.1037/a0012771.
Calvo, M. G., & Nummenmaa, L. (2011). Time course discrimination between emotional facial expressions: The role of visual saliency. Vision Research, 51, 1751–1759. doi:10.1016/j.visres.2011.06.001.
Calvo, M. G., Nummenmaa, L., & Avero, P. (2010). Recognition advantage of happy faces in extrafoveal vision: Featural and affective processing. Visual Cognition, 18, 1274–1297. doi:10.1080/13506285.2010.481867.
Carroll, J. M., & Russell, J. A. (1997). Facial expressions in Hollywood’s protrayal of emotion. Journal of Personality and Social Psychology, 72, 164–176. doi:10.1037/0022-3514.72.1.164.
Chen, C. C., Kao, K. L. C., & Tyler, C. W. (2007). Face configuration processing in the human brain: The role of symmetry. Cerebral Cortex, 17, 1423–1432. doi:10.1093/cercor/bhl054.
Eisenbarth, H., & Alpers, G. W. (2011). Happy mouth and sad eyes: Scanning emotional facial expressions. Emotion, 11, 860–865. doi:10.1037/a0022758.
Ekman, P. (1994). Strong evidence for universals in facial expressions: A reply to Russell’s mistaken critique. Psychological Bulletin, 115, 268–287. doi:10.1037/0033-2909.115.2.268.
Ekman, P. (2001). Telling lies: Clues to deceit in the marketplace, politics, and marriage. New York: W.W. Norton & Co.
Ekman, P., & Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, CA: Consulting Psychologists Press.
Ekman, P., & Friesen, W. V. (1978). Facial action coding system: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
Fernández-Martín, A., Avero, P., & Gutiérrez-Calvo, M. (2012). Una sonrisa en la boca hace que los ojos parezcan alegres [A smiling mouth makes non-happy eyes look happy]. Escritos de Psicología-Psychological Writings, 5, 25–33. doi:10.5231/psy.writ.2012.02.
Goren, D., & Wilson, H. R. (2006). Quantifying facial expression recognition across viewing conditions. Vision Research, 46, 1253–1262. doi:10.1016/j.visres.2005.10.028.
Graham, R., & LaBar, K. S. (2007). Garner interference reveals dependencies between emotional expression and gaze in face perception. Emotion, 7, 296–313. doi:10.1037/1528-3542.7.2.296.
Henderson, J. M., Williams, C. C., & Falk, R. J. (2005). Eye movements are functional during face learning. Memory & Cognition, 33, 98–106. doi:10.3758/BF03195300.
Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40, 1489–1506. doi:10.1016/S0042-6989(99)00163-7.
Johnston, L., Miles, L., & Macrae, C. (2010). Why are you smiling at me? Social functions of enjoyment and non-enjoyment smiles. British Journal of Social Psychology, 49, 107–127. doi:10.1348/014466609X412476.
Kohler, C. G., Turner, T., Stolar, N. M., Bilker, W. B., Brensinger, C. M., Gur, R. E. (2004). Differences in facial expressions of four universal emotions. Psychiatry Research, 128, 235–244. doi:10.1016/j.psychres.2004.07.003.
Kontsevich, L. L., & Tyler, C. (2004). What makes Mona Lisa smile? Vision Research, 44, 1493–1498. doi:10.1016/j.visres.2003.11.027.
Krumhuber, E. G., & Manstead, A. S. R. (2009). Can Duchenne smiles be feigned? New evidence on felt and false smiles. Emotion, 9, 807–820. doi:10.1037/a0017844.
Krumhuber, E. G., & Scherer, K. R. (2011). Affect bursts: Dynamic patterns of facial expression. Emotion, 11, 825–841. doi:10.1037/a0023856.
Leppänen, J., & Hietanen, J. K. (2007). Is there more in a happy face than just a big smile? Visual Cognition, 15, 468–490. doi:10.1080/13506280600765333.
Loughead, J., Gur, R. C., Elliott, M., & Gur, R. E. (2008). Neural circuitry for accurate identification of facial emotions. Brain Research, 1194, 37–44. doi:10.1016/j.brainres.2007.10.105.
Lundqvist, D., Flykt, A., & Öhman, A. (1998). The Karolinska directed emotional faces—KDEF. CD-ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet, Stockholm, Sweden. ISBN 91-630-7164-9.
Niedenthal, P. M., Mermillod, M., Maringer, M., & Hess, U. (2010). The simulation of smiles (SIMS) model: Embodied simulation and the meaning of facial expression. Behavioral and Brain Sciences, 33, 417–433. doi:10.1017/S0140525X10000865.
Nummenmaa, L., & Calder, A. J. (2009). Neural mechanisms of social attention. Trends in Cognitive Sciences, 13, 135–143. doi:10.1016/j.tics.2008.12.006.
Nusseck, M., Cunningham, D. V., Wallraven, C., & Bülthoff, H. H. (2008). The contribution of different facial regions to the recognition of conversational expressions. Journal of Vision, 8(8), 1–23. doi:10.1167/8.8.1.
Palermo, R., & Coltheart, M. (2004). Photographs of facial expression: Accuracy, response times, and ratings of intensity. Behavior Research Methods, 36, 634–638. doi:10.3758/BF03206544.
Remland, M. S., Jones, T. S., & Brinkman, H. (1995). Interpersonal distance, body orientation, and touch: Effects of culture, gender, and age. The Journal of Social Psychology, 135, 281–297.
Richler, J. J., Mack, M. L., Gauthier, I., & Palmeri, T. J. (2009). Holistic processing of faces happens at a glance. Vision Research, 49, 2856–2861. doi:10.1016/j.visres.2009.08.025.
Scherer, K. R., & Ellgring, H. (2007). Are facial expressions of emotion produced by categorical affect programs or dynamically driven by appraisal? Emotion, 7, 113–130. doi:10.1037/1528-3542.7.1.113.
Schneider, W., Eschman, A., & Zuccolotto, A. (2002). E-Prime user’s guide. Pittsburgh, PA: Psychology Software Tools, Inc.
Singer, T. (2006). The neuronal basis and ontogeny of empathy and mind reading: Review of the literature and implications for future research. Neuroscience and Biobehavioral Reviews, 30, 855–863. doi:10.1016/j.neubiorev.2006.06.011.
Smith, M. L., Cottrell, G., Gosselin, F., & Schyns, P. G. (2005). Transmitting and decoding facial expressions of emotions. Psychological Science, 16, 184–189. doi:10.1111/j.0956-7976.2005.00801.x.
Tanaka, J. W., Kaiser, M., Butler, S., & Le Grand, R. (2012). Mixed emotions: Holistic and analytic perception of facial expressions. Cognition and Emotion. doi:10.1080/02699931.2011.630933.
Torralba, A., Oliva, A., Castelhano, M. S., & Henderson, J. (2006). Contextual guidance of eye movements in real-world scenes: The role of global features in object search. Psychological Review, 113, 766–786. doi:10.1037/0033-295X.113.4.766.
Tottenham, N., Tanaka, J. W., Leon, A. C., McCarry, T., Nurse, M., Hare, T. A., et al. (2009). The NimStim set of facial expressions: Judgments from untrained research participants. Psychiatry Research, 168, 242–249. doi:10.1016/j.psychres.2008.05.006.
Walther, D., & Koch, C. (2006). Modelling attention to salient proto-objects. Neural Networks, 19, 1395–1407. doi:10.1016/j.neunet.2006.10.001.
Wandell, B. A. (1995). Foundations of vision. Sunderland, MA: Sinauer Press.
Acknowledgments
This research was supported by Grant PSI2009-07245 from the Spanish Ministerio de Ciencia e Innovación, the Agencia Canaria de Investigación, Innovación y Sociedad de la Información (Neurocog Project), and the European Regional Development Fund. We are grateful to Lauri Nummenmaa for conducting the visual saliency computations.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Calvo, M.G., Fernández-Martín, A. Can the eyes reveal a person’s emotions? Biasing role of the mouth expression. Motiv Emot 37, 202–211 (2013). https://doi.org/10.1007/s11031-012-9298-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11031-012-9298-1