Abstract
Authentication systems are security measures that are put in place to safeguard data and systems for users to access a system. Personal identification numbers are used to authenticate and secure users. Password verification using PINs necessitates users entering a physical PIN, which might be subject to password cracking or hacking via shoulder surfing or thermal tracking. To develop an application that will authenticate users more safely and protect the user from shoulder surfing and thermal tracking. The proposed system uses a blend of Deep Learning and Computer Vision techniques to protect the user by combining eye blink count-based PIN entry, and face recognition to avoid shoulder surfing and thermal tracking attacks. Face detection is accomplished by the use of the Haar Cascade classifier, which is a cascade function learned from a large number of positive and negative pictures and is used to recognize objects (faces) in other images, and Dlib’s frontal face detector, which employs the HOG and Linear SVM models. The face is recognized by calculating the features of the face and matching it with the available feature set calculated from the dataset. Eyeblink is counted using the Eye aspect ratio which uses the Euclidean distance formula between the eye coordinates. By taking the count of blinks for every digit, the PIN is generated. PIN authentication with hands-off eye blinks, on the other hand, leaves no physical footprints and thus provides a more secure password entry method when combined with face recognition.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Wang Y, Duan X (2021) Research on face recognition algorithm based on deep learning. In: 2021 IEEE 21st international conference on communication technology (ICCT). IEEE, pp 1139–1142. https://doi.org/10.1109/icct52962.2021.9657956
Kumar M, Mann R (2021) Masked face recognition using deep learning model. In: 2021 3rd international conference on advances in computing, communication control and networking (ICAC3N). IEEE, pp 428–432. https://doi.org/10.1109/ICAC3N53548.2021.9725368
Naik N, Mehta MA (2018) Hand-over-face gesture based facial emotion recognition using deep learning. In: 2018 international conference on circuits and systems in digital enterprise technology (ICCSDET). IEEE, pp 1–7. https://doi.org/10.1109/ICCSDET.2018.8821186
Kadambari S et al (2019) Automation of attendance system using facial recognition. In: 2019 international conference on advances in computing, communication and control (ICAC3). IEEE, pp 1–5. https://doi.org/10.1109/ICAC347590.2019.9036819
Xia H, Li C (2019) Face recognition and application of film and television actors based on Dlib. In: 2019 12th international congress on image and signal processing, BioMedical engineering and informatics (CISP-BMEI). IEEE, pp 1–6. https://doi.org/10.1109/CISP-BMEI48845.2019.8965869
Zhang D et al (2020) Implementation of Dlib deep learning face recognition technology. In: 2020 international conference on robots & intelligent system (ICRIS). IEEE, pp 88–91. https://doi.org/10.1109/ICRIS52159.2020.00030
Phuong TT et al (2022) An eye blink detection technique in video surveillance based on eye aspect ratio. In: 2022 24th international conference on advanced communication technology (ICACT). IEEE, pp 534–38. https://doi.org/10.23919/ICACT53585.2022.9728891
Pandey NN, Muppalaneni NB (2021) Real-time drowsiness identification based on eye state analysis. In: 2021 international conference on artificial intelligence and smart systems (ICAIS). IEEE, pp 1182–1187. https://doi.org/10.1109/ICAIS50930.2021.9395975
Dhanush T et al (2018) Determining response credibility by blink count. In: 2018 international conference on recent trends in advance computing (ICRTAC). IEEE, pp 143–148. https://doi.org/10.1109/ICRTAC.2018.8679253
Chandiwala J, Agarwal S (2021) Driver’s real-time drowsiness detection using adaptable eye aspect ratio and smart alarm system. In: 2021 7th international conference on advanced computing and communication systems (ICACCS). IEEE, pp 1350–1355. https://doi.org/10.1109/ICACCS51430.2021.9441756
Labeled Faces in the wild dataset Homepage. http://vis-www.cs.umass.edu/lfw/. Last accessed 2021/12/15
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Rohith, S., Vijayalakshmi, M. (2023). Hands-Free Eye Gesture Authentication Using Deep Learning and Computer Vision Principles. In: Shukla, P.K., Singh, K.P., Tripathi, A.K., Engelbrecht, A. (eds) Computer Vision and Robotics. Algorithms for Intelligent Systems. Springer, Singapore. https://doi.org/10.1007/978-981-19-7892-0_32
Download citation
DOI: https://doi.org/10.1007/978-981-19-7892-0_32
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-7891-3
Online ISBN: 978-981-19-7892-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)