Research on the Structure and Key Algorithms of Smart Gloves Oriented to Middle School Experimental Scene Perception

Abstract

The existing virtual experiment platform mainly uses virtual reality technology or animation technology to assist students in experimental teaching, but it lacks the standardized supervision of users’ experimental behaviors. To address the above problems, this paper designs a prototype smart glove application for middle school experimental scenarios and proposes a scene perception algorithm based on the smart glove, so as to obtain the user’s experimental behavior more accurately. Based on the perception of the experimental scene, this paper also proposes a multimodal fusion of intelligent navigation interaction paradigm to obtain the user’s experimental intention, thus allowing students to conduct exploratory experiments on a virtual experimental platform with targeted guidance and monitoring of user behavior. Experiments show that the smart glove designed in this paper can sense the relative relationship between experimental equipment and objects in the scene in real time. Based on the user’s experimental behavior, the smart glove can also infer the operator’s experimental intent and provide timely feedback and guidance on the user’s experimental behavior.