Facial Gesture Recognition Based Real Time Gaming for Physically Impairment

Abstract

Technology has refined online gaming by introducing new engagement modes that are being created at a rapid pace in today’s society. Eye blinking and facial movement is a basic nonverbal interaction that is increasingly evolving in the next generation. This eye-gazing technology and facial feature movement create a communication bridge for individuals with impairments. With the aid of a highly efficient library, OpenCV intended to handle Computer Vision issues and PyAutoGUI, which enables the Python scripts to manage the mouse and keyboard to automate interactions with other programs, developers can automate the game by blinking the eyes and other facial gestures.

This paper is written to illustrate a Python alternative to commercial systems like Tobii and Kinect, so that the code may be used in mobile devices and apps with limited CPU power. Our research focuses on the virtual keyboard, which not only triggers keys through facial gestures but may also give help to those who are physically impaired. To do this, we have used the built-in camera on our computer/laptop, which identifies the face and features of the face. This makes detecting the face far more straightforward than before. A mouse click on the virtual interface can be replaced by an eye blink or lip movement. The ultimate goal is to enable a computer-human connection based solely on the movement of facial features, allowing physically handicapped persons to communicate with the computer and play games easily using a facial based interface.