Facial paralysis affects both mental and physical health of patients. Evaluation of facial paralysis in clinical practice is normally based on the static facial asymmetry at the maximal movement state and the dynamic change of facial muscle movement. However, most existing research only considers one of these two aspects when evaluating the degree of facial paralysis. This will result in an incomplete utilization of the diagnosis information leading to a low evaluation accuracy, or even misjudgment. In this paper, a novel method is presented for evaluating the degree of facial paralysis considering both static facial asymmetry and dynamic transformation factors. A quantitative approach of static facial asymmetry based on local mirror asymmetry is proposed. The method compares the differences of the corresponding local regions between both sides of the face. This makes it effective analyzing the left and right side asymmetry for abnormal faces. A quantitative evaluation of static facial asymmetry is achieved through three steps: localization of local facial regions, extraction of asymmetry features and quantification of bilateral facial asymmetry. Once the static facial asymmetry is quantified, its dynamic counterparts can be calculated using the speed of changings in different regions caused by facial muscle movement. Then we combine the static and dynamic quantification results to evaluate the degree of facial nerve paralysis. The efficiency and effectiveness of the proposed method have been tested using our facial paralysis database with 62 patients. The experiments show that our method produced encouraging performance compared with ground truth.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Anguraj K, Kandiban R, Jayakumar KS (2012) Facial paralysis diseases level detection using CEM algorithm for clinical applications. Eur J Sci Res 77:543–548
Anguraj K, Padma S (2012) Analysis of facial paralysis disease using image processing technique. Int J Comput Appl 54(11):1–4
Bajaj-Luthra A, Mueller T, Johnson PC (1997) Quantitative analysis of facial motion components: anatomic and nonanatomic motion in normal persons and in patients with complete facial paralysis. Plast Reconstr Surg 99(6):1894–1902
Burres SA (1985) Facial biomechanics: the standards of normal. Laryngoscope 95(6):708–714
Burres SA (1986) Objective grading of facial paralysis. Ann Otol Rhinol Laryngol 95(3):238–241
Cootes TF, Taylor CJ, Cooper DH, Graham J (1995) Active shape models-their training and application. Comput Vis Image Underst 61(1):38–59
Delannoy JR, Ward TE (2010) A preliminary investigation into the use of machine vision techniques for automating facial paralysis rehabilitation therapy. Proceeding of IET Irish Signals and Systems Conference, pp 228–232
Dong J, Lin Y, Liu L (2008) An approach to evaluation of degree of facial paralysis based on image processing and pattern recognition. J Inf Syst 5(2):639–646
Dong J, Ma L, Li Q, Wang S, Liu L, Lin Y, Jian M (2008) An approach for quantitative evaluation of the degree of facial paralysis based on salient point detection. Intelligent Information Technology Application Workshops, pp 483–486
Dulguerov P, Marchal F, Wang D, Gysin C (1999) Review of objective topographic facial nerve evaluation methods. Otol Neurotol 20(5):672–678
Gebhard A, Paulus D (2000) Diagnosis support of patients with facial paresis. Bernd Girod G, and Niemann H. Principles of 3D image analysis and synthesis. Kluwer Academic Publishers, London, pp 1–20
Gunaratne P, Sato Y (2003) Objective evaluation of facial paralysis by asymmetry in expressions. Medical Image Computing and Computer-Assisted Intervention-MICCAI 2003. Springer Berlin Heidelberg, pp 1–8
He S, Soraghan JJ, O’Reilly BF, Xing D (2009) Quantitative analysis of facial paralysis using local binary patterns in biomedical videos. IEEE Trans Biomed Eng 56(7):1864–1870
He S, Soraghan JJ, O’Reilly BF (2007) Biomedical image sequence analysis with application to automatic quantitative assessment of facial paralysis. J Image Video Processg 2007(4):81282-1–81282-11
Hontanilla B, Aubá C (2008) Automatic three-dimensional quantitative analysis for evaluation of facial movement. J Plast Reconstr Aesthet Surg 61(1):18–30
House JW, Brackmann DE (1985) Facial nerve grading system. Otolaryngol Head Neck Surg Off J Am Acad Otolaryngol Head Neck Surg 93(2):146
Isono M, Murata K, Tanaka H, Kawamoto M, Azuma H (1996) An objective evaluation method for facial mimic motion. Otolaryngol Head Neck Surg 114(1):27–31
Isono M, Murata K, Tanaka H, Minoyama M, Azuma H (1994) Computerized analysis of facial motions–objective evaluation of facial palsy. Nihon Jibiinkoka Gakkai Kaiho 97(3):393–400
Johnson PJ, Bajaj-Luthra A, Llull R, Johnson PC (1997) Quantitative facial motion analysis after functional free muscle reanimation procedures. Plast Reconstr Surg 100(7):1710–1719
Johnson PC, Brown H, Kuzon WM, Balliet R, Garrison JL, Campbell J (1994) Simultaneous quantitation of facial movements: the maximal static response assay of facial nerve function. Ann Plast Surg 32(2):171–179
Liu L, Cheng G, Dong J, Wang S, Qu H (2010) Evaluation of facial paralysis degree based on regions. WKDD’10. Third International Conference on Knowledge Discovery and Data Mining, pp 514–517
McGrenary S, O’Reilly BF, Soraghan JJ (2005) Objective grading of facial paralysis using artificial intelligence analysis of video data. Proceedings. 18th IEEE Symposium on Computer-Based Medical Systems, pp 587–592
Meier-Gallati V, Scriba H, Fisch U (1998) Objective scaling of facial nerve function based on area analysis (OSCAR). Otolaryngol Head Neck Surg 118(4):545–550
Murty GE, Diver JP, Kelly PJ, O’Donoghue GM, Bradley PJ (1994) The Nottingham system: objective assessment of facial nerve function in the clinic. Otolaryngol Head Neck Surg 110(2):156–161
Neely JG, Cheung JY, Wood M, Byers J, Rogerson A (1992) Computerized quantitative dynamic analysis of facial motion in the paralyzed and synkinetic face. Otol Neurotol 13(2):97–107
Ojala T, Pietikainen M, Maenpaa T (2002) Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell 24(7):971–987
Peckitt NS, Walker RV, Barker GR (1992) The facial nerve function coefficient: analysis of 100 normal subjects. J Oral Maxillofac Surg 50(4):338–339
Rogers CR, Schmidt KL, VanSwearingen JM, Cohn JF, Wachtman GS, Manders EK, Deleyiannis FWB (2007) Automated facial image analysis: detecting improvement in abnormal facial movement after treatment with botulinum toxin A. Ann Plast Surg 58(1):39–47
Shan C, Gong S, McOwan PW (2009) Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis Comput 27(6):803–816
Wachtman G, Cohn J, Swearingen JV, Manders EK (2001) Automatic tracking of facial features in patients with facial neuromuscular dysfunction. Plast Reconstr Surg 107(5):1124–1133
Wang T, Dong J, Sun X, Zhang S, Wang S (2014) Automatic recognition of facial movement for paralyzed face. Bio-Med Mater Eng 24(6):2751–2760
Wang S, Li H, Qi F, Zhao Y (2004) Objective facial paralysis grading based on Pface and eigenflow. Med Biol Eng Comput 42(5):598–603
Wang T, Qi L, Dong J, Zhang S, Wang S (2014) Facial paralysis grading: are achromatic images sufficient? Perception 43:19
This work is supported by the National Natural Science Foundation of China (No. 61271405), Ph.D. Program Foundation of Ministry of Education of China (20120132110018), China Postdoctoral Science Foundation (No. 2014 M551962) and Fundamental Research Funds for the Central Universities (No. 201413020).
About this article
Cite this article
Wang, T., Zhang, S., Dong, J. et al. Automatic evaluation of the degree of facial nerve paralysis. Multimed Tools Appl 75, 11893–11908 (2016). https://doi.org/10.1007/s11042-015-2696-0
- Facial nerve paralysis
- Facial asymmetry quantification
- Facial movement
- Facial grading system