Abstract
Eye localization and detection are essential in security applications and human recognition and verification. The multi-pose variations of the pupil are still the major challenge in eye detection algorithms. Furthermore, facial expression recognition related to eye detection is still dropped in the recent security applications. This paper used a speeded-up roust feature (SURF) algorithm to localize facial parts, especially the eye and pupil, quickly and easily. Moreover, we detect the boundary box of face components by initializing the eye position based on Hough circle transform (HCT) and local binary pattern (LBP). Afterward, we classify the individuals who successfully detected their eye images using the confusion matrix of two class labels based on deep belief neural networks (DBNN). Fine-tuning the hyper-parameter values of the DBNN is performed as well as a stochastic gradient descent optimizer to handle the overfitting problem of the proposed method. The proposed algorithm’s accuracy based on the combination of SURF, LBP with the DBNN classifier reached 95.54%, 94.07%, and 96.20% for the applied ORL, BioID, and CASIA-V5, respectively. The comparison of the proposed algorithm with the state-of-the-art is performed to indicate that the proposed algorithms are more reliable and superior.
M. Y. Shams and A. E. Hassanien—Scientific Research Group in Egypt (SRGE).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Refernces
Syeda, U.H., et al.: Visual face scanning and emotion perception analysis between autistic and typically developing children. In: Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers, pp. 844–853 (2017)
Hessels, R.S., Holleman, G.A., Kingstone, A., Hooge, I.T., Kemner, C.: Gaze allocation in face-to-face communication is affected primarily by task structure and social context, not stimulus-driven factors. Cognition 184, 28–43 (2019)
Shams, M.Y., Tolba, A.S., Sarhan, S.H.: Face, iris, and fingerprint multimodal identification system based on local binary pattern with variance histogram and combined learning vector quantization. J. Theor. Appl. Inf. Technol. 89(1), 53 (2016)
Shams, M.Y., Tolba, A.S., Sarhan, S.H.: A vision system for multi-view face recognition. ArXiv Prepr. ArXiv170600510 (2017)
Huang, B., Chen, R., Zhou, Q., Xu, W.: Eye landmarks detection via weakly supervised learning. Pattern Recognit. 98, 107076 (2020)
Wang, Y., Shen, T., Yuan, G., Bian, J., Fu, X.: Appearance-based gaze estimation using deep features and random forest regression. Knowl. Based Syst. 110, 293–301 (2016)
Borza, D., Darabant, A.S., Danescu, R.: Real-time detection and measurement of eye features from color images. Sensors 16(7), 1105 (2016)
Gou, C., Wu, Y., Wang, K., Wang, F.-Y., Ji, Q.: Learning-by-synthesis for accurate eye detection. In: 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 3362–3367 (2016)
Flynn, J., et al.: Deepview: view synthesis with learned gradient descent. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2367–2376 (2019)
Yi, D., Lei, Z., Li, S.Z.: A robust eye localization method for low quality face images. In: 2011 International Joint Conference on Biometrics (IJCB), pp. 1–6 (2011)
Shams, M.Y., Rashad, M.Z., Nomir, O., El-Awady, R.M.: Iris recognition based on LBP and combined LVQ classifier. ArXiv Prepr. ArXiv11111562 (2011)
Ren, Y., Wang, S., Hou, B., Ma, J.: A novel eye localization method with rotation invariance. IEEE Trans. Image Process. 23(1), 226–239 (2013)
Karaaba, M.F., Schomaker, L., Wiering, M.: Machine learning for multi-view eye-pair detection. Eng. Appl. Artif. Intell. 33, 69–79 (2014)
Yang, S., Luo, P., Loy, C.C., Tang, X.: Faceness-net: Face detection through deep facial part responses. IEEE Trans. Pattern Anal. Mach. Intell. 40(8), 1845–1859 (2017)
Xiao, F., Huang, K., Qiu, Y., Shen, H.: Accurate iris center localization method using facial landmark, snakuscule, circle fitting and binary connected component. Multimed. Tools Appl. 77(19), 25333–25353 (2018)
Zhang, S., Shen, L., Zhang, R., Yang, Y., Zhang, Y.: Robust eye detection using deeply-learned gaze shifting path. J. Vis. Commun. Image Represent. 55, 654–659 (2018)
Ahmed, M., Laskar, R.H.: Eye center localization in a facial image based on geometric shapes of iris and eyelid under natural variability. Image Vis. Comput. 88, 52–66 (2019)
Ahmed, N.Y.: Real-time accurate eye center localization for low-resolution grayscale images. J. Real-Time Image Process. 18(1), 193–220 (2021)
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (SURF). Comput. Vis. Image Underst. 110(3), 346–359 (2008)
Du, G., Su, F., Cai, A.: Face recognition using SURF features. In: MIPPR 2009: Pattern Recognition and Computer Vision, vol. 7496, p. 749628 (2009)
Guo, Z., Zhang, L., Zhang, D.: Rotation invariant texture classification using LBP variance (LBPV) with global matching. Pattern Recognit. 43(3), 706–719 (2010)
Masek, L.: Recognition of human iris patterns for biometric identification. Citeseer (2003)
Daugman, J.: How iris recognition works. In: The Essential Guide to Image Processing, pp. 715–739. Elsevier (2009)
Hinton, G.E.: Deep belief networks. Scholarpedia 4(5), 5947 (2009)
Tanaka, M., Okutomi, M.: A novel inference of a restricted boltzmann machine. In: 2014 22nd International Conference on Pattern Recognition, pp. 1526–1531 (2014)
Tran, S.: Representation decomposition for knowledge extraction and sharing using restricted Boltzmann machines. City University London (2016)
ORL face dataset. https://cam-orl.co.uk/facedatabase.html, Accessed 20 May 2021
BioID face dataset. https://ftp.uni-erlangen.de/pub/facedb/readme.html, Accessed 21 May 2021
CASIA-V face dataset. http://biometrics.idealtest.org, Accessed 22 May 2021
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Shams, M.Y., Hassanien, A.E., Tang, M. (2022). Deep Belief Neural Networks for Eye Localization Based Speeded up Robust Features and Local Binary Pattern. In: Shi, X., Bohács, G., Ma, Y., Gong, D., Shang, X. (eds) LISS 2021. Lecture Notes in Operations Research. Springer, Singapore. https://doi.org/10.1007/978-981-16-8656-6_38
Download citation
DOI: https://doi.org/10.1007/978-981-16-8656-6_38
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-8655-9
Online ISBN: 978-981-16-8656-6
eBook Packages: Business and ManagementBusiness and Management (R0)