Skip to main content
SpringerLink
Log in

Computational Study of Duality in Facial Expressions

  • Conference paper
  • First Online:
Proceedings of International Conference on Recent Advancement on Computer and Communication

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 34))

  • 1006 Accesses

Abstract

Automatic detection of human facial expressions grappled the interest of researchers in last decade. The face is the most obvious modality for recognition of human affective states. Facial expressions may be broadly classified as postured or natural. Humans recognize duality of facial expressions equally well and accurately, but the challenge lies in the computational aspect of distinguishing this duality. A comprehensive study of various postured, spontaneous, and posed versus spontaneous facial expression recognition methods has been carried out based on some vital parameters such as the number of subjects, sample size, cue used, discrimination basis, accuracy. Facial features extracted and classification methods used highly affect performance. Some important observations have been drawn from the study. These observations will be useful to the researchers putting efforts in distinguishing the duality of facial expressions with high accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Keltner, D., Ekman, P.: Facial expressions of emotion. In: Lewis, M., Havil-Jones, J.M. (eds.) Handbook of Emotions, pp. 236–249. New York: Guilford Press (2000)

    Google Scholar 

  2. Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: audio, visual, spontaneous expressions. IEEE Trans. Pattern Anal. Mach. Intell. 31(1), 39–58 (2009)

    Article  Google Scholar 

  3. Dibeklioglu, H., Valenti, R., Salah, A.A., Gevers, T.: Eyes do not lie: spontaneous versus posed smiles. In: Proceedings ACM International Conference Multimedia, pp. 703–706 (2010)

    Google Scholar 

  4. Cohn, J., Schmidt, K.: The timing of facial motion in posed spontaneous smiles. J. Wavelets Multiresolut. Inf. Process. 2, 1–12 (2004)

    Google Scholar 

  5. Valstar, M.F., Pantic, M.Z., Ambadar, Cohn, J.F.: Spontaneous vs. posed facial behavior: automatic analysis of brow actions. In: Proceeding Eighth International Conference Multimodal Interfaces (ICMI’06), pp. 162–170 (2006)

    Google Scholar 

  6. Craig, K.D., Hyde, S.A., Patrick, C.J.: Genuine, suppressed, faked facial behavior during exacerbation of chronic low back pain. Pain 46, 161–172 (1991)

    Article  Google Scholar 

  7. Huang, C.L., Huang, Y.M.: Facial expression recognition using model-based feature extraction action parameters classification. J. Visual Comm. Image Represent. 8(3), 278–290 (1997)

    Article  Google Scholar 

  8. Pantic, M., Rothkrantz, L.J.M.: Expert system for automatic analysis of facial expression. Image Vis. Comput. J. 18(11), 881–905 (2000)

    Article  Google Scholar 

  9. Kobayashi, H., Hara, F.: Facial interaction between animated 3D face robot human beings. In: Proceeding International Conference Systems, Man, Cybernetics, pp. 3732–3737 (1997)

    Google Scholar 

  10. Kimura, S., Yachida, M.: Facial expression recognition its degree estimation. In: Proceeding Computer Vision Pattern Recognition, pp. 295–300 (1997)

    Google Scholar 

  11. Viola, P., Jones, M.J.: Robust real-time object detection. Int J. Comput. Vision 57(2), 137–154 (2004)

    Article  Google Scholar 

  12. Tao, H., Huang, T.S.: A piecewise Bezier volume deformation model its applications in facial motion capture. In: Bovik, A.C., Chen, C.W., Goldgof, D.B. (eds.) Advances in Image Processing Understanding: A Festschrift for Thomas S. Huang (2002)

    Google Scholar 

  13. Terzopoulos, D., Waters, K.: Analysis synthesis of facial image sequences using physical anatomical models. IEEE Trans. Pattern Anal. Mach. Intell. 15(6), 569–579 (1993)

    Article  Google Scholar 

  14. Kearney, G.D., McKenzie, S.: Machine interpretation of emotion: design of memory-based expert system for interpreting facial expressions in terms of signaled emotions (JANUS). Cogn. Sci. 17(4), 589–622 (1993)

    Article  Google Scholar 

  15. Pantic, M., Rothkrantz, L.J.M.: Automatic analysis of facial expressions: the state of the art. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1424–1445 (2000)

    Article  Google Scholar 

  16. Pantic, M.: Facial expression recognition. Springer, Berlin, Heidelberg (2009)

    Google Scholar 

  17. Edwards, G.J., Cootes, T.F., Taylor, C.J.: Face recognition using active appearance models. Proc. Eur. Conf. Comput. Vis. 2, 581–695 (1998)

    Google Scholar 

  18. Cohen, L., Sebe, N., Garg, A., Chen, L., Huang, T.: Facial expression recognition from video sequences: temporal static modeling. Comput. Vis. Image Underst. 91(1–2), 160–187 (2003)

    Article  Google Scholar 

  19. Pantic, M., Leon, J., Rothkrantz, M.: Facial action recognition for facial expression analysis from static face images. IEEE Trans. Syst. Man Cybern. 34(3), 1449–1461 (2004)

    Article  Google Scholar 

  20. Yeasin, M., Bullot, B., Sharma, R.: Recognition of facial expressions and measurement of levels of interest from video. IEEE Trans. Multimedia 8(3), 500–508 (2006)

    Article  Google Scholar 

  21. Ghanem, K., Caplier, A.: Occurrence order detection of face features deformations in posed expressions. In: ICIEIS, Part II, CCIS 252, pp. 56–66, Springer, Berlin, Heidelberg (2011)

    Chapter  Google Scholar 

  22. Tong, Y., Liao, W., Ji, Q.: Facial Action unit recognition by exploiting their dynamic semantic relationships. IEEE Trans. Pattern Anal. Mach. Intell. 29(10), 1–17 (2007)

    Article  Google Scholar 

  23. Ashraf, A., Lucey, S., Cohn, J.F., Chen, T., Ambadar, Z., Prkachin, K., Solomon, P., Theobald, B.: The painful face: pain expression recognition using active appearance models. In: Proceeding of the 9th International Conference on Multimodal Interfaces, pp. 9–14. ACM (2007)

    Google Scholar 

  24. Cohn, J.F., Kruez, T., Matthews, I., Yang, Y., Nguyen, M., Padilla, M., Zhou, F., Torre, F.D.: Detecting depression from facial actions vocal prosody. In: Affective Computing Intelligent Interaction Workshops, ACII (2009). 3rd International Conference, pp. 1–7 (2009)

    Google Scholar 

  25. Bartlett, M.S., Littlewort, G., Braathen, P., Sejnowski, T.J., Movellan, J.R.: A prototype for automatic recognition of spontaneous facial actions. Adv. Neural. Inf. Process. Syst. 15, 1271–1278 (2003)

    Google Scholar 

  26. Sebe, N., Lew, M.S., Cohen, I., Sun, Y., Gevers, T., Huang, T.S.: Authentic Facial Expression Analysis. In: Proceeding IEEE International Conference Automatic Face Gesture Recognition (AFGR) (2004)

    Google Scholar 

  27. Ekman, P., Hager, J.C., Friesen, W.V.: The symmetry of emotional deliberate facial actions. Psychophysiology 18, 101–106 (1981)

    Article  Google Scholar 

  28. Ekman, P., Friesen, W.V.: Felt, false, miserable smiles. J. Nonverbal Behav. 6, 238–252 (1982)

    Article  Google Scholar 

  29. Cohn, J.F.: Automated analysis of the configuration timing of facial expression. In: Ekman, P., Rosenberg, E. (eds.) What the face reveals (2nd edn): Basic applied studies of spontaneous expression using the Facial Action Coding System (FACS). Oxford University Press Series in Affective Science, New York: Oxford (20050

    Google Scholar 

  30. Rinn, W.E.: The neuropsychology of facial expression. Psychol. Bull. 52–77 (1984)

    Google Scholar 

  31. Valstar, M.F., Gunes, H., Pantic, M.: How to distinguish posed from spontaneous smiles using geometric features. In: Proceeding Ninth International Conference Multimodal Interfaces (ICMI’07), pp. 38–45 (2007)

    Google Scholar 

  32. Ekman, P., Friesen, W.V., Hager, J.C.: Facial action coding system. A human face. Salt Lake City (2002)

    Google Scholar 

  33. Carr, E.W., Korb, S., Niedenthal, P.M., Winkielman, P.: The two sides of spontaneity: movement onset asymmetries in facial expressions influence social judgments. J. Exp. Soc. Psychol. 31–36 (2014)

    Article  Google Scholar 

  34. Seckington, M.: Using dynamic Bayesian networks for posed versus spontaneous facial expression recognition. Mater Thesis, Department of Computer Science, Delft University of Technology (2011)

    Google Scholar 

  35. Bartlett, M., Littlewort, G., Frank, M.G., Lainscsek, C., Fasel, I.R., Movellan, J.R.: Automatic recognition of facial actions in spontaneous expressions. J. Multimedia 1(6) (2006)

    Google Scholar 

  36. Dibeklioglu, H., Salah, A.A., Gevers, T.: Recognition of genuine smiles. In: IEEE Trans on Multimedia (2014)

    Google Scholar 

  37. Donia, M.M.F., Youssif, A.A.A., Hashad, A.: Spontaneous facial expression recognition based on histogram of oriented gradients descriptor. Comput. Inf. Sci. 7(3) (2014)

    Google Scholar 

  38. Liu, Z., Wang, S.: Posed and spontaneous expression distinguishment from infrared thermal images. International Conference on Pattern Recognition (ICPR), Tsukuba, Japan, pp. 1108–1111, January (2012)

    Google Scholar 

  39. Girard, J.M., Cohn, J.F., Jeni, L.A., Sayette, M.A., Torre, F.D.L.: Spontaneous facial expression in unscripted social interactions can be measured automatically. Behav. Res. Methods 47(4), 1136–1147 (2015)

    Article  Google Scholar 

  40. Zeng, Z., Fu, Y., Roisman, G.I., Wen, Z., Hu, Y., Huang, T.S.: One-class classification for spontaneous facial expression analysis. In: Proceedings of IEEE International Conference Automation Face Gesture Recognition, pp. 281–286 (2006)

    Google Scholar 

  41. Littlewort, G.C., Bartlett, M.S., Lee, K.: Faces of pain: automated measurement of spontaneous facial expressions of genuine posed pain. In: ICMI’07 12–15 November, Nagoya, Aichi, Japan (2007)

    Google Scholar 

  42. Hammal, Z., Kunz, M., Arguin, M., Gosselin, F.: Spontaneous pain expression recognition in video sequences. In: International Academic Conference on Visions of Computer Society. British Computer Society (BCS), pp. 191–210 (2012)

    Google Scholar 

  43. Nicolaou, M., Gunes, H., Pantic, M.: Continuous prediction of spontaneous affect from multiple cues modalities in valence-arousal space. IEEE Trans. Affect. Comput. 2(2), 92–105 (2011)

    Article  Google Scholar 

  44. Pfister, T., Li, X., Zhao, G., Pietikainen, M.: Recognizing spontaneous facial micro-expressions. In: Computer Vision (ICCV) (2011) IEEE International Conference on, IEEE, pp. 1449–1456 (2011)

    Google Scholar 

  45. Zhang, L., Tjondronegoro, D., Chran, V.: Geometry vs. appearance for discriminating between posed spontaneous emotions. In: Proceedings ICONIP, pp. 431–440 (2011)

    Google Scholar 

  46. Bhaskar, H., Al-Mualla, M.: Spontaneous vs. Posed Facial Expression Analysis Using Deformable Feature Models Aggregated Classifiers. In: International Conference on Information Fusion (FUSION), July (2013)

    Google Scholar 

  47. He, M., Wang, S., Liu, Z., Chen, X.: Analyses of the differences between posed spontaneous facial expressions. In: Proceedings ACII, pp. 79–84 (2013)

    Google Scholar 

  48. Ekman P., Eds, E.: What the face reveals: basic applied studies of spontaneous expression using the Facial Action Coding System. Oxford University Press (2005)

    Google Scholar 

  49. Ekman, P.: Darwin, deception facial expression. Ann. N. Y. Acad. Sci. 205–221 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computer Science & Information Technology, DAVV, Indore, Madhya Pradesh, India

    Ritesh Joshi & Maya Ingle

Authors
  1. Ritesh Joshi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Maya Ingle
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ritesh Joshi .

Editor information

Editors and Affiliations

  1. Computer Science and Engineering, Technocrats Institute of Technology, Bhopal, Madhya Pradesh, India

    Basant Tiwari

  2. Computer Science and Engineering, DSPM IIIT, Naya Raipur, Chhattisgarh, India

    Vivek Tiwari

  3. Department of Mathematics, Sungkyunkwan University, Suwon, Korea (Republic of)

    Kinkar Chandra Das

  4. Microsoft Innovation Academy, Computer Science and Engineering, Sri Aurobindo Institute of Technology, Indore, Madhya Pradesh, India

    Durgesh Kumar Mishra

  5. Department of Mathematics, South Asian University, New Delhi, Delhi, India

    Jagdish C. Bansal

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Joshi, R., Ingle, M. (2018). Computational Study of Duality in Facial Expressions. In: Tiwari, B., Tiwari, V., Das, K., Mishra, D., Bansal, J. (eds) Proceedings of International Conference on Recent Advancement on Computer and Communication . Lecture Notes in Networks and Systems, vol 34. Springer, Singapore. https://doi.org/10.1007/978-981-10-8198-9_61

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-8198-9_61

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-8197-2

  • Online ISBN: 978-981-10-8198-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation