Skip to main content
Log in

Face recognition using multi-class Logical Analysis of Data

  • Applied Problems
  • Published:
Pattern Recognition and Image Analysis Aims and scope Submit manuscript

Abstract

This paper addresses the applicability of multi-class Logical Analysis of Data (LAD) as a face recognition technique (FRT). This new classification technique has already been applied in the field of biomedical and mechanical engineering as a diagnostic technique; however, it has never been used in the face recognition literature. We explore how Eigenfaces and Fisherfaces merged to multi-class LAD can be leveraged as a proposed FRT, and how it might be useful compared to other approaches. The aim is to build a single multi-class LAD decision model that recognizes images of the face of different persons. We show that our proposed FRT can effectively deal with multiple changes in the pose and facial expression, which constitute critical challenges in the literature. Comparisons are made both from analytical and practical point of views. The proposed model improves the classification of Eigenfaces and Fisherfaces with minimum error rate.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. W. Zhao, R. Chellappa, P. J. Phillips, and A. Rosenfeld, “Face recognition: a literature survey,” Acm Comput. Surv. 35, 399–458 (2003).

    Article  Google Scholar 

  2. I. H. Witten, E. Frank, and M. A. Hall, Data Mining: Practical Machine Learning Tools and Techniques (Morgan Kaufmann, 2011).

    Google Scholar 

  3. P. N. Belhumeur, J. P. Hespanha, and D. J. Kriegman, “Eigenfaces vs. fisherfaces: recognition using class specific linear projection,” IEEE Trans. Pattern Anal. Mach. Intellig. 19, 711–720 (1997).

    Article  Google Scholar 

  4. A. Tolba, A. El-Baz, and A. El-Harby, “Face recognition: a literature review,” Int. J. Signal Processing 2, 88–103 (2005).

    Google Scholar 

  5. A. Mokeev and V. Mokeev, “Pattern recognition by means of linear discriminant analysis and the principal components analysis,” Pattern Recogn. Image Anal. 25, 685–691 (2015).

    Article  Google Scholar 

  6. K. Etemad and R. Chellappa, “Discriminant analysis for recognition of human face images,” J. Opt. Soc. Am. A 14, 1724–1733 (1997).

    Article  Google Scholar 

  7. P. E. Hart and D. G. Stork, Pattern Classification (John Willey and Sons, 2001).

    MATH  Google Scholar 

  8. G. Shakhnarovich and B. Moghaddam, “Face recognition in subspaces,” in Handbook of Face Recognition, Ed. by S. Z. Li and A. K. Jain (Springer, London, 2011), pp. 19–49.

    Chapter  Google Scholar 

  9. M. A. Turk and A. P. Pentland, “Face recognition using eigenfaces,” in Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition CVPR’91 (Lahaina, Maui, June 3–6, 1991), pp. 586–591.

    Google Scholar 

  10. G. Guo, S. Z. Li, and K. L. Chan, “Support vector machines for face recognition,” Image Vision Comput. 19, 631–638 (2001).

    Article  Google Scholar 

  11. L. Ganesan, “Face recognition using neural networks,” Signal Processing: Int. J. 3, 153 (2009).

    Google Scholar 

  12. F. Kornilov, “Comparative analysis of algorithms for detecting structural changes in images,” Pattern Recogn. Image Anal. 25, 593–602 (2015).

    Article  Google Scholar 

  13. Y. Adini, Y. Moses, and S. Ullman, “Face recognition: the problem of compensating for changes in illumination direction,” IEEE Trans. Pattern Anal. Mach. Intellig. 19, 721–732 (1997).

    Article  Google Scholar 

  14. E. Boros, P. Hammer, and T. Ibaraki, “Logical analysis of data,” in Encyclopedia of Data Warehousing and Mining (Idea Group Publ., 2005), pp. 689–692.

    Chapter  Google Scholar 

  15. Y. Crama, P. L. Hammer, and T. Ibaraki, “Causeeffect relationships and partially defined Boolean functions,” Ann. Operat. Res. 16, 299–325 (1988).

    Article  MATH  Google Scholar 

  16. M. A. Mortada, S. Yacout, and A. Lakis, “Diagnosis of rotor bearings using logical analysis of data,” J. Quality Maintenance Eng. 17 (4), 371–397 (2011).

    Article  Google Scholar 

  17. E. Bores, P. L. Hammer, T. Ibaraki, A. Kogan, E. Mayoraz, and I. Muchnik, “An implementation of logical analysis of data,” IEEE Trans. Knowledge Data Eng. 12, 292–306 (2000).

    Article  Google Scholar 

  18. S. Y. D. Salamanca, “Condition based maintenance with logical analysis of data,” in Proc. 7th Congress Int. de genie industriel (Quebec, 2007).

    Google Scholar 

  19. M. A. Mortada, T. Carroll, S. Yacout, and A. Lakis, “Rogue components: their effect and control using logical analysis of data,” J. Intellig. Manuf. 23 (2), 1–14 (2009).

    Google Scholar 

  20. A. Ragab, M.-S. Ouali, S. Yacout, and H. Osman, “Remaining useful life prediction using prognostic methodology based on logical analysis of data and Kaplan–Meier estimation,” J. Intellig. Manuf. 27 (5), 943–958 (2014).

    Article  Google Scholar 

  21. C. Ding and D. Tao, “A comprehensive survey on pose-invariant face recognition,” ACM Trans. Intellig. Syst. Technol. 7, 37 (2016).

    Google Scholar 

  22. B. Heisele, P. Ho, and T. Poggio, “Face recognition with support vector machines: global versus component-based approach,” in Proc. 8th IEEE Int. Conf. on Computer Vision ICCV 2001 (Vancouver, 2001), Vol. 2, pp. 688–694.

    Chapter  Google Scholar 

  23. S. Xie, F. Shen, and X. Qiu, “Face recognition using support vector machines,” Comput. Eng. 35 (16), 186–188 (2003).

    Google Scholar 

  24. L. Wang, Support Vector Machines: Theory and Applications (Springer Verlag, 2005).

    Book  MATH  Google Scholar 

  25. A. T. Sahlol, C. Y. Suen, M. R. Elbasyouni, and A. A. Sallam, “A proposed OCR algorithm for the recognition of handwritten Arabic characters,” J. Pattern Recogn. Intellig. Syst. 2 (1), 8–22 (2014).

    Google Scholar 

  26. C. M. Bishop, Neural Networks for Pattern Recognition (Oxford Univ. Press, 1995).

    MATH  Google Scholar 

  27. N. Jamil, S. Lqbal, and N. Iqbal, “Face recognition using neural networks,” in Proc. IEEE Int. Multi Topic Conf. Technology for the 21st Century INMIC 2001 (Lahore, 2001), pp. 277–281.

    Chapter  Google Scholar 

  28. C. Liu and H. Wechsler, “A unified Bayesian framework for face recognition,” in Proc. Int. Conf. on Image Processing ICIP 98 (Chicago, 1998), Vol. 1, pp. 151–155.

    Google Scholar 

  29. B. Moghaddam, T. Jebara, and A. Pentland, “Bayesian face recognition,” Pattern Recogn. 33, 1771–1782 (2000).

    Article  Google Scholar 

  30. M. J. Lyons, S. Akamatsu, M. Kamachi, J. Gyoba, and J. Budynek, The Japanese female facial expression (JAFFE) database (1998). http://www.kasrl.org/jaffe.html.

    Google Scholar 

  31. Face Database. Image Engineering Laboratory (University of Sheffield). http://www.sheffield.ac.uk/eee/research/iel/research/face.

  32. H. Moon and P. J. Phillips, “Computational and performance aspects of PCA-based face-recognition algorithms,” Perception 30 (3), 303–322 (2001).

    Article  Google Scholar 

  33. W. Zhao, R. Chellappa, and A. Krishnaswamy, “Discriminant analysis of principal components for face recognition,” in Proc. 3rd IEEE Int. Conf. on Automatic Face and Gesture Recognition (Nara, 1998), pp. 336–341.

    Chapter  Google Scholar 

  34. A. Ragab, M.-S. Ouali, S. Yacout, and H. Osman, “Condition-based maintenance prognostics using logical analysis of data,” in Proc. IIE Annu. Conf. (Institute of Industrial Engineers-Publ., 2014), p. 378.

    Google Scholar 

  35. E. Mayoraz and M. Moreira, “On the decomposition of polychotomies into dichotomies,” in Proc. 14th Int. Conf. on machine Learning (Nashville, TN, 1997), pp. 219–226.

    Google Scholar 

  36. L. M. Moreira, The Use of Boolean Concepts in General Classification Contexts (Universidade do Minho, 2000).

    Google Scholar 

  37. M.-A. Mortada, S. Yacout, and A. Lakis, “Fault diagnosis in power transformers using multi-class logical analysis of data,” J. Intellig. Manuf. 25 (6), 1429–1439 (2014).

    Article  Google Scholar 

  38. H. S. Ryoo and I. Y. Jang, “Milp approach to pattern generation in logical analysis of data,” Discrete Appl. Math. 157, 749–761 (2009).

    Article  MathSciNet  MATH  Google Scholar 

  39. S. Alexe, E. Blackstone, P. L. Hammer, H. Ishwaran, M. S. Lauer, and C. E. Pothier Snader, “Coronary risk prediction by logical analysis of data,” Ann. Operat. Res. 119, 15–42 (2003).

    Article  MATH  Google Scholar 

  40. P. L. Hammer, A. Kogan, B. Simeone, and S. Szedmak, “Pareto-optimal patterns in logical analysis of data,” Discrete Appl. Math. 144, 79–102 (2004).

    Article  MathSciNet  MATH  Google Scholar 

  41. P. L. Hammer and T. O. Bonates, “Logical analysis of data–an overview: from combinatorial optimization to medical applications,” Ann. Operat. Res. 148, 203–225 (2006).

    Article  MATH  Google Scholar 

  42. C. Guo and H. S. Ryoo, “Compact MILP models for optimal and Pareto-optimal LAD patterns,” Discrete Appl. Math. 160 (16), 2339–2348 (2012).

    Article  MathSciNet  MATH  Google Scholar 

  43. R. R. Bouckaert, E. Frank, M. A. Hall, G. Holmes, B. Pfahringer, P. Reutemann, and I. H. Witten, “WEKA–experiences with a Java open-source project,” J. Mach. Learn. Res. 11, 2533–2541 (2010).

    MATH  Google Scholar 

  44. S. Yacout, D. Salamanca, and M. A. Mortada, WO Patent WO/2012/009,804 (2012).

    Google Scholar 

  45. M. Berkelaar, K. Eikland, and P. Notebaert, lp solve: open source (mixed-integer) linear programming system, version 5.5 (2005). http://tech.groups.yahoo.com/group/lp_solve.

    Google Scholar 

  46. CPLEX optimizer–high-performance mathematical programming solver for linear programming, mixed integer programming, and quadratic programming. https://www-01.ibm.com/software/commerce/optimization/cplex-optimizer/index.html.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. Ragab.

Additional information

The article is published in the original.

Ahmed Ragab received a B.Sc. in Electronic Engineering and the M.Sc. in Control Engineering from Faculty of Electronic Engineering, Minuf, Egypt in 2003 and 2007, respectively. He received the PhD. degree in Industrial Engineering from École Polytechnique de Montreal, Canada in 2014. His research interests are: Machine Learning and Pattern Recognition, Condition-Based Maintenance, Fault Diagnosis and Prognosis, Discrete Event Systems, Control Systems, Petri Nets, Timed Automata, and Operations Research

Xavier de Carné de Carnavalet received in 2014 a Diplome d’Ingénieur (M.Sc.) from École Supérieure d’Informatique, Électronique et Automatique, Paris, France, and anM.A.Sc. in Information Systems Security from Concordia University, Montreal, QC, Canada. His research interests are: privacy, passwords and authentication, TLS, trusted computing, reverse-engineering, and machine learning applications to information systems security.

Soumaya Yacout is Professor of Industrial Engineering and Operations Research at École Polytechnique de Montréal in Canada since 1999. She received a D.Sc. in Operations Research in 1985, and a M.Sc. in Industrial Engineering in 1979. Her research interests include Condition- Based Maintenance and optimization of decision making for product quality. She is a senior member of the American Society for Quality (ASQ) and the Canadian Operations Research Society (CORS).

Mohamed-Salah Ouali is a Professor of Industrial Engineering at the École Polytechnique de Montréal. His research interests focus on reliability modeling, multiple failure modes diagnosis, and long-term fleet maintenance. He obtained his Doctorate degree from the Institut National Polytechnique de Grenoble, France, in 1996, and worked as assistant professor at Moncton University, New-Brunswich, from 1998 to 2000. He is a member of the Interuniversity Research Centre on Enterprise networks, Logistics and Transport (CIRRELT) and the Ordre des Ingenieurs du Québec, Canada.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ragab, A., de Carné de Carnavalet, X., Yacout, S. et al. Face recognition using multi-class Logical Analysis of Data. Pattern Recognit. Image Anal. 27, 276–288 (2017). https://doi.org/10.1134/S1054661817020092

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S1054661817020092

Keywords

Navigation