Skip to main content
SpringerLink
Log in

Emotional expressions with minimal facial muscle actions. Report 2: Recognition of emotions

  • Published:
Current Psychology Aims and scope Submit manuscript

Abstract

We tested the hypothesis that an emotion expressed by a still-face person keeping direct gaze can be adequately recognized. The prospective study involved 800 volunteers as judges (age 16–25). All the judges were presented with three 10-picture sets of still faces expressing angry, sad, and happy emotions by vivid gaze only. The first 10-picture set consisted of full faces, the second set consisted of the middle part of the face pictures, and the third set presented the eyes only. Half of the judges (Group 1, n = 400) were asked to label the pictures as Angry, Sad, or Happy. Another 400 judges (Group 2) were asked to label the same pictures as Angry, Sad, Surprised, Frightened, or Happy to validate the selected sets of pictures. Group 1 judges presented correct recognition of the emotion in 72% for full-face pictures, 73% agreement for middle parts, and 68% agreement for the eyes only, while in Group 2 the agreements were 63%, 68%, and 48.5% respectively. After Bonferroni correction for multiple comparisons, our results show that the gaze was the only emotional cue in all tests and the presented emotions were recognized with relatively equal degree of success. We confirm our initial statement (Report 1) that the expression of an emotion can be adequately achieved with minimal facial muscular involvement when predominantly the gaze expresses emotion. In most of the cases, an “emotional gaze” during a still-face or static face situation is adequately recognized by people but the emotion recognition skill has individual variations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Akakin, H. C., & Sankur, B. (2011). Robust classification of face and head gestures in video. Image and Vision Computing, 29, 470–483.

    Article  Google Scholar 

  • Bradley, M. M., Miccoli, L., Escrig, M. A., & Lang, P. J. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology, 45(4), 602–607. https://doi.org/10.1111/j.1469-8986.2008.00654.x.

    Article  PubMed  PubMed Central  Google Scholar 

  • Bush, L. K., Barr, C. L., McHugo, G. J., & Lanzetta, J. T. (1989). The effects of facial control and facial mimicry on subjective reactions to comedy routines. Motivation and Emotion, 13, 31–52.

    Article  Google Scholar 

  • Castro, V. L., Cooke, A. N., Halberstadt, A. G., & Garrett-Peters, P. (2018). Bidirectional linkages between emotion recognition and problem behaviors in elementary school children. Journal of Nonverbal Behavior, 42(2), 155–178. https://doi.org/10.1007/s10919-017-0269-9.

    Article  PubMed  Google Scholar 

  • Chaby, L., Hupont, I., Avril, M., Luherne-du Boullay, V., & Chetouani, M. (2017). Gaze behavior consistency among older and younger adults when looking at emotional faces. Frontiers of Psychology, 2017 Apr 13; 8, 548. doi: https://doi.org/10.3389/fpsyg.2017.00548. eCollection 2017.

  • Corden, B., Critchley, H. D., Skuse, D., & Dolan, R. J. (2006). Fear recognition ability predicts differences in social cognitive and neural functioning in men. Journal of Cognitive Neuroscience, 18(6), 889–897.

    Article  Google Scholar 

  • Cowan, D. G., Vanman, E. J., & Nielsen, M. (2014). Motivated empathy: The mechanics of the empathic gaze. Cognition & Emotion, 28(8), 1522–1530. https://doi.org/10.1080/02699931.2014.890563.

    Article  Google Scholar 

  • Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., & Taylor, J. (2001). Emotion recognition in human–computer interaction. IEEE Signal Processing Magazine, 18, 32–80.

    Article  Google Scholar 

  • Darwin, C. (1872). The expression of the emotions in man and animals. London: John Murray.

    Book  Google Scholar 

  • Demer, J. L., Poukens, V., Miller, J. M., & Micevych, P. (1997). Innervation of extraocular pulley smooth muscle in monkeys and humans. Investigative Ophthalmology & Visual Science, 38(9), 1774–1785.

    Google Scholar 

  • DiGirolamo, M. A., & Russell, J. A. (2017). The emotion seen in a face can be a methodological artifact: The process of elimination hypothesis. Emotion, 17(3), 538–546.

    Article  Google Scholar 

  • Dijk, C., Fischer, A. H., Morina, N., van Eeuwijk, C., & van Kleef, G. A. (2018). Effects of social anxiety on emotional mimicry and contagion: Feeling negative, but smiling politely. Journal of Nonverbal Behavior, 42(1), 81–99. https://doi.org/10.1007/s10919-017-0266-z.

    Article  PubMed  Google Scholar 

  • Duchenne (de Boulogne), G. B. (1862). Mécanisme de la Physionomie Humaine ou analise électro-physiologique. Paris: Jules Renouard.

    Book  Google Scholar 

  • Ekman, P., Friesen, W. V., & Ellsworth, P. (1972). Emotion in the human face. New York: Pergamon.

    Google Scholar 

  • Ekman, P., & Friesen, W. V. (1975). Unmasking the face. Englewood Cliffs: Prentice-Hall.

    Google Scholar 

  • Ekman, P., Levenson, R. W., & Friesen, W. V. (1983). Autonomic nervous system activity distinguishes among emotions. Science, 221, 1208–1210.

    Article  Google Scholar 

  • Ekman, P. (1994). Strong evidence for universals in facial expression: A reply to Russell's mistaken critique. Psychological Bulletin, 115, 268–287.

    Article  Google Scholar 

  • Ekman, P., Friesen, W. V., & Hager, J. C. (2002). Facial action coding system. The manual. Salt Lake City: Network Information Research Corporation.

    Google Scholar 

  • Figueiredo, G. R., Ripka, W. L., Romaneli, E. F. R., & Ulbricht, L. (2019). Attentional bias for emotional faces in depressed and non-depressed individuals: An eye-tracking study. Conference Proceedings IEEE England Medical Biological Society, 5419-5422. doi: https://doi.org/10.1109/EMBC.2019.8857878.

  • Gosselin, F., & Schyns, P. G. (2001). Bubbles: A technique to reveal the use of information in recognition tasks. Vision Research, 41, 2261–2271.

    Article  Google Scholar 

  • Groves, R. M., Fowler, F. J., Couper, M. P., Lepkowski, J. M., Singer, E., & Tourangeau, R. (2004). Survey methodology. Hoboken: Wiley.

    Google Scholar 

  • Grumet, G. W. (1983). Eye contact: The core of interpersonal relatedness. Psychiatry, 46(2), 172–180.

    Article  Google Scholar 

  • Hall, J. A., Mast, M. S., & West, T. V. (Eds.). (2016). The social psychology of perceiving others accurately. New York: Cambridge University Press.

    Google Scholar 

  • Izci, Y., & Gonul, E. (2006). The microsurgical anatomy of the ciliary ganglion and its clinical importance in orbital traumas: An anatomic study. Minimally Invasive Neurosurgery, 49(3), 156–160.

    Article  Google Scholar 

  • Jiang, M., Francis, S. M., Srishyla, D., Conelea, C., Zhao, Q., & Jacob, S. (2019). Classifying individuals with ASD through facial emotion recognition and eye-tracking. Conference Proceedings IEEE England Medical Biological Society, 6063-6068. doi: https://doi.org/10.1109/EMBC.2019.8857005.

  • Joyal, C. C., Jacob, L., Cigna, M. H., Guay, J. P., & Renaud P. (2014). Virtual faces expressing emotions: An initial concomitant and construct validity study. Frontiers of Human Neuroscience, 2014 Sep 30; 8, 787. doi: https://doi.org/10.3389/fnhum.2014.00787. eCollection 2014.

  • Kappas, A., McHugo, G. J., & Lanzetta, J. T. (1989). Componential control and the modulation of emotional experience. Psychophysiology, 26, S37.

    Google Scholar 

  • Kappas, A., Bherer, F., & Thériault, M. (2000). Inhibiting facial expressions: Limitations to the voluntary control of facial expressions of emotion. Motivation and Emotion, 24(4), 259–270.

    Article  Google Scholar 

  • Kleinke, C. L. (1986). Gaze and eye contact: A research review. Psychological Bulletin, 100(1), 78–100.

    Article  Google Scholar 

  • Kosonogov, V. & Titova, A. (2018). Recognition of all basic emotions varies in accuracy and reaction time: A new verbal method of measurement. International Journal of Psychology, 2018 Jul 16. doi: https://doi.org/10.1002/ijop.12512. [Epub ahead of print].

  • Krämer, K., Bente, G., Luo, S., Pfeiffer, U. J., Han, S., & Vogeley, K. (2013). Influence of ethnic group-membership and gaze direction on the perception of emotions. A cross-cultural study between Germany and China. PLoS One, 2013 Jun 7;8(6):e66335. doi: https://doi.org/10.1371/journal.pone.0066335.Print2013.

  • Kreibig, S. D. (2010). Autonomic nervous system activity in emotion: A review. Biological Psychology, 84(3), 394–421.

    Article  Google Scholar 

  • Kret, M.E. (2015). Emotional expressions beyond facial muscle actions. A call for studying autonomic signals and their impact on social perception. Frontiers of Psychology, 2015 may 27, 6:711. doi: https://doi.org/10.3389/fpsyg.2015.00711. eCollection 2015.

  • Lance, B. J., & Marsella, S. C. (2010). The expressive gaze model: Using gaze to express emotion. IEEE Computer Graphics and Applications, 30(4), 62–73. https://doi.org/10.1109/MCG.2010.43.

    Article  PubMed  Google Scholar 

  • Lau, J. Y., Burt, M., Leibenluft, E., Pine, D. S., Rijsdijk, F., Shiffrin, N., & Eley, T. C. (2009). Individual differences in children's facial expression recognition ability: The role of nature and nurture. Developmental Neuropsychology, 34(1), 37–51. https://doi.org/10.1080/87565640802564424.

    Article  PubMed  PubMed Central  Google Scholar 

  • Le Brun, C. (1702). Méthode pour apprendre à dessiner les passions : proposée dans une conférence sur l'expression générale et particulière. Amsterdam: François van-der Plaats.

    Google Scholar 

  • Mason, M. F., Tatkow, E. P., & Macrae, C. N. (2005). The look of love: Gaze shifts and person perception. Psychological Science, 16(3), 236–239.

    Article  Google Scholar 

  • McDougal, D. H., & Gamlin, P. D. (2015). Autonomic control of the eye. Comprehensive Physiology, 5(1), 439–473.

    PubMed  PubMed Central  Google Scholar 

  • Moukheiber, A., Rautureau, G., Perez-Diaz, F., Jouvent, R., & Pelissolo, A. (2012). Gaze behaviour in social blushers. Psychiatry Research, 200(2–3), 614–619. https://doi.org/10.1016/j.psychres.2012.07.017.

    Article  PubMed  Google Scholar 

  • Mumenthaler, C., & Sander, D. (2012). Social appraisal influences recognition of emotions. Journal of Personality and Social Psychology, 102(6), 1118–1135. https://doi.org/10.1037/a0026885.

    Article  PubMed  Google Scholar 

  • Naruse, S., Hashimoto, T., Mori, K., Tsuda, Y., Takahara, M., & Kagami, S. (2013). Developmental changes in facial expression recognition in Japanese school-age children. Journal of Medical Investigations, 60(1–2), 114–120.

    Article  Google Scholar 

  • Noh, S. R., Lohani, M., & Isaacowitz, D. M. (2011). Deliberate real-time mood regulation in adulthood: The importance of age, fixation and attentional functioning. Cognition & Emotion, 25(6), 998–1013. https://doi.org/10.1080/02699931.2010.541668.

    Article  Google Scholar 

  • Noh, S. R., & Isaacowitz, D. M. (2015). The effects of varying contextual demands on age-related positive gaze preferences. Psychology and Aging, 30(2), 356–368. https://doi.org/10.1037/a0039233.

    Article  PubMed  PubMed Central  Google Scholar 

  • Novello, B., Renner, A., Maurer, G., Musse, S., & Arteche, A. (2018). Development of the youth emotion picture set. Perception, 47(10–11), 1029–1042. https://doi.org/10.1177/0301006618797226.

    Article  PubMed  Google Scholar 

  • Pochedly, J. T., Widen, S. C., & Russell, J. A. (2012). What emotion does the "facial expression of disgust" express? Emotion, 12(6), 1315–1319.

    Article  Google Scholar 

  • Pollux, P. M., Hall, S. & Guo, K. (2014). Facial expression training optimises viewing strategy in children and adults. PLoS One. 2014 Aug 21;9(8):e105418. doi: https://doi.org/10.1371/journal.pone.0105418. eCollection 2014.

  • Priebe, J. A., Messingschlager, M., & Lautenbacher, S. (2015). Gaze behaviour when monitoring pain faces: An eye-tracking study. European Journal of Pain., 19(6), 817–825. https://doi.org/10.1002/ejp.608.

    Article  PubMed  Google Scholar 

  • Ranstam, J. (2016). Multiple P-values and Bonferroni correction. Osteoarthritis and Cartilage, 24(5), 763–764. https://doi.org/10.1016/j.joca.2016.01.008.

    Article  PubMed  Google Scholar 

  • Ranstam, J. (2019). Hypothesis-generating and confirmatory studies, Bonferroni correction, and pre-specification of trial endpoints. Acta Orthopaedica, 90(4), 297. https://doi.org/10.1080/17453674.2019.1612624.

    Article  PubMed  PubMed Central  Google Scholar 

  • Rodger, H., Lao, J., & Caldara, R. (2018). Quantifying facial expression signal and intensity use during development. Journal of Experimental Child Psychology, 174, 41–59. https://doi.org/10.1016/j.jecp.2018.05.005.

    Article  PubMed  Google Scholar 

  • Roitblat, Y., Cohensedgh, S., Frig-Levinson, E., Suman, E., & Shterenshis, M. (2019). Emotional expressions with minimal facial muscle actions. Report 1: Cues and targets. Current Psychology, (Jan 24, 2019), 1–9. https://doi.org/10.1007/s12144-019-0151-5.

  • Ruskell, G. L. (1970). An ocular parasympathetic nerve pathway of facial nerve origin and its influence on intraocular pressure. Experimental Eye Research, 10(2), 319–330.

    Article  Google Scholar 

  • Russell, J. A. (1994). Is there universal recognition of emotion from facial expression? Psychological Bulletin, 115, 102–141.

    Article  Google Scholar 

  • Russell, J. A. (1995). Facial expressions of emotion: What lies beyond minimal universality? Psychological Bulletin, 118, 379–391.

    Article  Google Scholar 

  • Scheller, E., Büchel, C. & Gamer, M. (2012). Diagnostic features of emotional expressions are processed preferentially. PLoS One,7(7):e41792. doi: https://doi.org/10.1371/journal.pone.0041792.

  • Scherer, K. R., Ellgring, H., Dieckmann, A., Unfried, M., Mortillaro, M. (2019). Dynamic facial expression of emotion and observer inference. Frontiers of Psychology, 2019 mar 19, 10, 508. doi: https://doi.org/10.3389/fpsyg.2019.00508.

  • Schurgin, M. W., Nelson, J., Iida, S., Ohira, H., Chiao, J. Y., & Franconeri, S. L. (2014). Eye movements during emotion recognition in faces. Journal of Vision, 14(13), 14. https://doi.org/10.1167/14.13.14.

    Article  PubMed  Google Scholar 

  • Shan, C., Gong, S., & McOwan, P. (2009). Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing, 27, 803–816.

    Article  Google Scholar 

  • Shechner, T., Jarcho, J. M., Wong, S., Leibenluft, E., Pine, D. S., & Nelson, E. E. (2017). Threats, rewards, and attention deployment in anxious youth and adults: An eye tracking study. Biological Psychology, 122, 121–129. https://doi.org/10.1016/j.biopsycho.2015.10.004.

    Article  PubMed  Google Scholar 

  • Stanley, J. T., Zhang, X., Fung, H. H., & Isaacowitz, D. M. (2013). Cultural differences in gaze and emotion recognition: Americans contrast more than Chinese. Emotion, 13(1), 36–46. https://doi.org/10.1037/a0029209.

    Article  PubMed  Google Scholar 

  • Steinhauer, S. R., Siegle, G. J., Condray, R., & Pless, M. (2004). Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. International Journal of Psychophysiology, 52(1), 77–86.

    Article  Google Scholar 

  • Soussignan, R., Chadwick, M., Philip, L., Conty, L., Dezecache, G., & Grèzes, J. (2013). Self-relevance appraisal of gaze direction and dynamic facial expressions: Effects on facial electromyographic and autonomic reactions. Emotion, 13(2), 330–337. https://doi.org/10.1037/a0029892.

    Article  PubMed  Google Scholar 

  • Švegar, D., Horvat, K., & Kardum I. (2018). Facial emotion recognition in violent men. International Journal of Psychololgy, 2018 Aug 13. doi: https://doi.org/10.1002/ijop.12522. [Epub ahead of print].

  • Todorov, A., & Duchaine, B. (2008). Reading trustworthiness in faces without recognizing faces. Cognitive Neuropsychology, 25(3), 395–410. https://doi.org/10.1080/02643290802044996.

    Article  PubMed  Google Scholar 

  • Tu, B., & Yu, F. (2012). Bimodal emotion recognition based on speech signals and facial expression. Foundations of Intelligent Systems, 122, 691–696.

    Article  Google Scholar 

  • Tyrrell, R. A., Thayer, J. F., Friedman, B. H., Leibowitz, H. W., & Francis, E. L. (1995). A behavioral link between the oculomotor and cardiovascular systems. Integrative Physiological and Behavioral Science, 30(1), 46–67.

    Article  Google Scholar 

  • Ulloa, J. L., Marchetti, C., Taffou, M., & George, N. (2015). Only your eyes tell me what you like: Exploring the liking effect induced by other's gaze. Cognition & Emotion, 29(3), 460–470. https://doi.org/10.1080/02699931.2014.919899.

    Article  Google Scholar 

  • Wac, K., & Tsiourti, C. (2014). Ambulatory assessment of affect: Survey of sensor systems for monitoring of autonomic nervous systems activation in emotion. IEEE Transactions of affective computing, 5(3), 251–272.

    Article  Google Scholar 

  • Wells, L. J., Gillespie, S. M., & Rotshtein, P. (2016). Identification of emotional facial expressions: Effects of expression, intensity, and sex on eye gaze. PLoS One, 11(12), e0168307. https://doi.org/10.1371/journal.pone.0168307 eCollection 2016.

    Article  PubMed  PubMed Central  Google Scholar 

  • Widen, S. C., & Russell, J. A. (2013). Children's recognition of disgust in others. Psychology Bulletin, 139(2), 271–299.

    Article  Google Scholar 

  • Widen, S. C., Pochedly, J. T., & Russell, J. A. (2015). The development of emotion concepts: A story superiority effect in older children and adolescents. Journal of Experimental Child Psychology, 131, 186–192. https://doi.org/10.1016/j.jecp.2014.10.009.

    Article  PubMed  Google Scholar 

  • Xiao, R., Li, X., Li, L., & Wang, Y. (2016). Can we distinguish emotions from faces? Investigation of implicit and explicit processes of peak facial expressions. Frontiers of Psychology, 7, 1330. https://doi.org/10.3389/fpsyg.2016.01330 eCollection 2016.

    Article  Google Scholar 

  • Zloteanu, M., Krumhuber, E. G., & Richardson, D. C. (2018). Detecting genuine and deliberate displays of surprise in static and dynamic faces. Frontiers of Psychology, 9, 1184. https://doi.org/10.3389/fpsyg.2018.01184.

    Article  Google Scholar 

Download references

Acknowledgments

The authors thank Mordechai Cohen, Orit Rome, Leor Sinai, and Rachelle Sevitt, for assistance in the research in Israel, and Damon Scoville, Pauline Kim, Taylor Golshan, Elijah Faridnia, and Daniel Weisenberg for assistance in the research in the USA.

Author information

Authors and Affiliations

  1. Department of Psychology, Belkind School for Special Education, Rishon-LeZion, Israel

    Yulia Roitblat

  2. Science Research Department, Milken Community High School, Los Angeles, CA, 90049, USA

    Sabrina Cohensedgh, Eden Frig-Levinson, Mika Cohen, Kayla Dadbin & Candice Shohed

  3. Science Research Department, Alexander Muss High School in Israel (AMHSI) affiliated with Alexander Muss Institute for Israel Education (AMIIE), Aliyat HaNoar 9, 45102, Hod HaSharon, Israel

    Mika Cohen, Kayla Dadbin, Candice Shohed & Michael Shterenshis

  4. Science Research Department, Harrisburg Academy, Warmleysburg, Harrisburg, PA, 17043, USA

    Dalia Shvartsman

Authors
  1. Yulia Roitblat
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sabrina Cohensedgh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Eden Frig-Levinson
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Mika Cohen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Kayla Dadbin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Candice Shohed
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Dalia Shvartsman
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Michael Shterenshis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Michael Shterenshis.

Ethics declarations

Conflict of Interest

Yulia Roitblat, Sabrina Cohensedgh, Eden Frig-Levinson, Mika Cohen, Kayla Dadbin, Candice Shohed, Dalia Shvartsman, and Michael Shterenshis declare no potential conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(XLSX 32 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Roitblat, Y., Cohensedgh, S., Frig-Levinson, E. et al. Emotional expressions with minimal facial muscle actions. Report 2: Recognition of emotions. Curr Psychol 41, 1549–1558 (2022). https://doi.org/10.1007/s12144-020-00691-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12144-020-00691-7

Keywords

Search

Navigation