Implementation of Unified Gesture Library for Multiple-Devices Environments

Abstract

In recent years, several input devices have changed the way users interact with computers. Gestures can be performed in different ways, such as moving a mouse, pointer, touching a screen, or making hand movements in a three-dimensional (3D) space. With the advent of various smart platforms with different gesture-input devices, application providers have developed specific web applications for each new gesture-input device. In previous years, developers would create new applications whenever new input devices appeared. Therefore, a unified gesture library appears necessary to resolve the inconvenience that a developer must face, as he considers the specific input-device characteristics in order to adapt a web application for various smart device platforms. In this paper, we defined common gestures for mouse, touch, and pointer devices, as well as a 3D hand-movement detector, and proposed a unified gesture library that produces a high-level event when a specific gesture occurs. In addition, we implemented the unified gesture library supporting common gestures, a circle gesture, a two finger drag gesture, and 3D hand- gesture recognition functions. Finally, we verified that the unified gesture library supported mouse or pointer gestures, multi-touch gestures, and hand gestures in 3D space by sample applications.