Skip to main content
SpringerLink
Log in

Microexpression Analysis: A Review

  • Conference paper
  • First Online:
Proceedings of 3rd International Conference on Computing Informatics and Networks

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 167))

Abstract

Micro expression analysis has been visually perceived as an abundance of advancement in recent years due to availability of frugal acquisition cameras and computational contrivances. Though datasets for micro expression analysis are available but even this advancement has still not reached to that caliber where we can built an automatic micro expression system just like automatic macro expression recognition system. Researchers have put their best efforts to develop the system for automatic facial expression analysis to recognize basic emotion which include jubilant, sad, irate, penitence, fear and surprise. The micro expression analysis task is quite challenging and fascinating due to advacement in automaticity in many fields of life. To address these challenges in a systematic manner, authors have endeavored to present a detailed analysis of the work done till date in micro expression field. The detailed description includes preprocessing and feature extraction. The advantages and disadvantages listed in this paper provide an impetus toward the future work and avail in culling an area of research in this field.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Asthana A, Zafeiriou S, Cheng S, Pantic M (2013) Robust discriminative response map fitting with constrained local models. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3444–3451

    Google Scholar 

  2. Burt P, Adelson E (1983) The laplacian pyramid as a compact image code. IEEE Trans Commun 31(4):532–540

    Article  Google Scholar 

  3. Chao WL, Ding JJ, Liu JZ (2015) Facial expression recognition based on improved local binary pattern and class-regularized locality preserving projection. Sig Process 117:1–10. http://www.sciencedirect.com/science/article/pii/S0165168415001425

  4. Chaudhry R, Ravichandran A, Hager G, Vidal R (2009) Histograms of oriented optical flow and binet-cauchy kernels on nonlinear dynamical systems for the recognition of human actions. In: 2009 IEEE conference on computer vision and pattern recognition, pp 1932–1939. IEEE

    Google Scholar 

  5. Davison A, Merghani W, Yap M (2018) Objective classes for micro-facial expression recognition. J Imaging 4(10):119

    Article  Google Scholar 

  6. Duan X, Dai Q, Wang X, Wang Y, Hua Z (2016) Recognizing spontaneous micro-expression from eye region. Neurocomputing 217:27–36

    Article  Google Scholar 

  7. Ekman P (2002) Microexpression training tool (mett). University of California, San Francisco

    Google Scholar 

  8. Ekman P, Friesen WV (1969) Nonverbal leakage and clues to deception. Psychiatry 32(1):88–106

    Article  Google Scholar 

  9. Gan Y, Liong ST (2018) Bi-directional vectors from apex in cnn for micro-expression recognition. In: 2018 IEEE 3rd international conference on image, vision and computing (ICIVC), pp 168–172. IEEE

    Google Scholar 

  10. Goh KM, Ng CH, Lim LL, Sheikh U (2018) Micro-expression recognition: an updated review of current trends, challenges and solutions. Vis Comput, pp 1–24

    Google Scholar 

  11. Haggard EA, Isaacs KS (1966) Micromomentary facial expressions as indicators of ego mechanisms in psychotherapy. In: Methods of research in psychotherapy, pp 154–165. Springer

    Google Scholar 

  12. Happy S, Routray A (2017) Fuzzy histogram of optical flow orientations for micro-expression recognition. IEEE Trans Affect Comput

    Google Scholar 

  13. He J, Hu JF, Lu X, Zheng WS (2017) Multi-task mid-level feature learning for micro-expression recognition. Pattern Recogn 66:44–52

    Article  Google Scholar 

  14. Huang X, Wang SJ, Zhao G, Piteikainen M (2015) Facial micro-expression recognition using spatiotemporal local binary pattern with integral projection. In: Proceedings of the IEEE international conference on computer vision workshops, pp 1–9

    Google Scholar 

  15. Jain DK, Zhang Z, Huang K (2018) Random walk-based feature learning for micro-expression recognition. Pattern Recogn Lett

    Google Scholar 

  16. Le Ngo AC, See J, Phan RCW (2017) Sparsity in dynamics of spontaneous subtle emotions: analysis and application. IEEE Trans Affect Comput 8(3):396–411

    Article  Google Scholar 

  17. Li X, Hong X, Moilanen A, Huang X, Pfister T, Zhao G, Pietikäinen M (2017) Towards reading hidden emotions: a comparative study of spontaneous micro-expression spotting and recognition methods. IEEE Trans Affect Comput 9(4):563–577

    Article  Google Scholar 

  18. Ling H, Okada K (2006) Diffusion distance for histogram comparison. In: 2006 IEEE computer society conference on computer vision and pattern recognition (CVPR’06), vol  1, pp 246–253. IEEE

    Google Scholar 

  19. Liong ST, See J, Phan RCW, Wong K, Tan SW (2018) Hybrid facial regions extraction for micro-expression recognition system. J Sig Process Syst 90(4):601–617

    Article  Google Scholar 

  20. Liong ST, See J, Wong K, Phan RCW (2018) Less is more: Micro-expression recognition from video using apex frame. Sig Process Image Commun 62:82–92

    Article  Google Scholar 

  21. Liong ST, Wong K (2017) Micro-expression recognition using apex frame with phase information. In: Asia-pacific signal and information processing association annual summit and conference (APSIPA ASC), pp 534–537. IEEE

    Google Scholar 

  22. Liu YJ, Zhang JK, Yan WJ, Wang SJ, Zhao G, Fu X (2015) A main directional mean optical flow feature for spontaneous micro-expression recognition. IEEE Trans Affect Comput 7:1–1

    Google Scholar 

  23. Liu YJ, Zhang JK, Yan WJ, Wang SJ, Zhao G, Fu X (2016) A main directional mean optical flow feature for spontaneous micro-expression recognition. IEEE Trans Affect Comput 7(4):299–310

    Article  Google Scholar 

  24. Oh YH, Le Ngo AC, Phari RCW, See J, Ling HC (2016) Intrinsic two-dimensional local structures for micro-expression recognition. In: 2016 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 1851–1855. IEEE

    Google Scholar 

  25. Ojala T, Pietikäinen M, Mäenpää T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987

    Article  Google Scholar 

  26. Peng M, Wang C, Chen T, Liu G, Fu X (2017) Dual temporal scale convolutional neural network for micro-expression recognition. Front Psychol 8:1745

    Article  Google Scholar 

  27. Pfister T, Li X, Zhao G, Pietikäinen M (2011) Recognising spontaneous facial micro-expressions. In: 2011 international conference on computer vision, pp 1449–1456. IEEE

    Google Scholar 

  28. Polikovsky S, Kameda Y, Ohta Y (2009) Facial micro-expressions recognition using high speed camera and 3d-gradient descriptor. IET Research

    Google Scholar 

  29. Polikovsky S, Kameda Y, Ohta Y (2013) Facial micro-expression detection in hi-speed video based on facial action coding system (facs). IEICE Trans Inf Syst 96(1):81–92

    Article  Google Scholar 

  30. Yan WJ, Wu Q, Liu YJ, Wang SJ, Fu X (2013) Casme database: a dataset of spontaneous micro-expressions collected from neutralized faces. In: 2013 10th IEEE international conference and workshops on automatic face and gesture recognition (FG), pp 1–7

    Google Scholar 

  31. Rubner Y, Tomasi C, Guibas LJ (2000) The earth mover’s distance as a metric for image retrieval. Int J Comput Vis 40(2):99–121

    Article  Google Scholar 

  32. Tran TK, Hong X, Zhao G (2017) Sliding window based micro-expression spotting: a benchmark. In: international conference on advanced concepts for intelligent vision systems, pp 542–553. Springer

    Google Scholar 

  33. Viola P, Jones M et al (2001) Rapid object detection using a boosted cascade of simple features. CVPR 1(1):511–518

    Google Scholar 

  34. Wang L, Zhang D, Wang Y, Chen C, Han X, M’hamed A (2016) Sparse mobile crowdsensing: challenges and opportunities. IEEE Commun Mag 54(7):161–167

    Article  Google Scholar 

  35. Wang SJ, Li BJ, Liu YJ, Yan WJ, Ou X, Huang X, Xu F, Fu X (2018) Micro-expression recognition with small sample size by transferring long-term convolutional neural network. Neurocomputing

    Google Scholar 

  36. Wang Y, See J, Oh YH, Phan RCW, Rahulamathavan Y, Ling HC, Tan SW, Li X (2017) Effective recognition of facial micro-expressions with video motion magnification. Multimedia Tools Appl 76(20):21665–21690

    Article  Google Scholar 

  37. Wang Y, See J, Phan R, Oh YH (2015) Lbp with six intersection points: reducing redundant information in lbp-top for micro-expression recognition

    Google Scholar 

  38. Wu HY, Rubinstein M, Shih E, Guttag J, Durand F, Freeman W (2012) Eulerian video magnification for revealing subtle changes in the world

    Google Scholar 

  39. Xia Z, Feng X, Peng J, Peng X, Zhao G (2016) Spontaneous micro-expression spotting via geometric deformation modeling. Comput Vis Image Underst 147:87–94

    Article  Google Scholar 

  40. Xiaohua H, Wang SJ, Liu X, Zhao G, Feng X, Pietikainen M (2017) Discriminative spatiotemporal local binary pattern with revisited integral projection for spontaneous facial micro-expression recognition. IEEE Trans Affect Comput

    Google Scholar 

  41. Xu F, Zhang J, Wang JZ (2017) Microexpression identification and categorization using a facial dynamics map. IEEE Trans Affect Comput 8(2):254–267

    Article  Google Scholar 

  42. Yan WJ, Chen YH (2018) Measuring dynamic micro-expressions via feature extraction methods. J Comput Sci 25:318–326

    Article  Google Scholar 

  43. Yan WJ, Li X, Wang SJ, Zhao G, Liu YJ, Chen YH, Fu X (2014) Casme ii: An improved spontaneous micro-expression database and the baseline evaluation. PloS one 9(1):e86041

    Article  Google Scholar 

  44. Zhang J, Shan S, Kan M, Chen X (2014) Coarse-to-fine auto-encoder networks (cfan) for real-time face alignment. In: European conference on computer vision, pp 1–16. Springer

    Google Scholar 

  45. Zhao G, Pietikainen M (2007) Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans Pattern Anal Mach Intell 6:915–928

    Article  Google Scholar 

  46. Zhou Z, Zhao G, Pietikäinen M (2011) Towards a practical lipreading system. In: CVPR 2011, pp 137–144. IEEE

    Google Scholar 

  47. Zhu X, Lei Z, Yan J, Yi D, Li SZ (2015) High-fidelity pose and expression normalization for face recognition in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 787–796

    Google Scholar 

  48. Zong Y, Huang X, Zheng W, Cui Z, Zhao G (2018) Learning from hierarchical spatiotemporal descriptors for micro-expression recognition. IEEE Trans Multimedia

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Maharaja Surajmal Institute of Technology (affiliated to Guru Gobind Singh IndraPrastha University), C-4, Janakpuri, New Delhi, India

    Mamta Rani & Neeru Rathee

Authors
  1. Mamta Rani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Neeru Rathee
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mamta Rani .

Editor information

Editors and Affiliations

  1. Scientific Network for Innovation and Research Excellence, Machine Intelligence Research Labs (MIR Labs), Auburn, WA, USA

    Ajith Abraham

  2. Tijuana Institute of Technology, Tijuana, Mexico

    Oscar Castillo

  3. Bhagwan Parshuram Institute of Technology, New Delhi, India

    Deepali Virmani

Rights and permissions

Reprints and permissions

Copyright information

© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rani, M., Rathee, N. (2021). Microexpression Analysis: A Review. In: Abraham, A., Castillo, O., Virmani, D. (eds) Proceedings of 3rd International Conference on Computing Informatics and Networks. Lecture Notes in Networks and Systems, vol 167. Springer, Singapore. https://doi.org/10.1007/978-981-15-9712-1_11

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-9712-1_11

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-9711-4

  • Online ISBN: 978-981-15-9712-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation