Hand Gesture Recognition Based Omnidirectional Wheelchair Control Using IMU and EMG Sensors
- 54 Downloads
This paper presents a hand gesture based control of an omnidirectional wheelchair using inertial measurement unit (IMU) and myoelectric units as wearable sensors. Seven common gestures are recognized and classified using shape based feature extraction and Dendogram Support Vector Machine (DSVM) classifier. The dynamic gestures are mapped to the omnidirectional motion commands to navigate the wheelchair. A single IMU is used to measure the wrist tilt angle and acceleration in three axis. EMG signals are extracted from two forearm muscles namely Extensor Carpi Radialis and Flexor Carpi Radialis and processed to provide Root Mean Square (RMS) signal. Initiation and termination of dynamic activities are based on autonomous identification of static to dynamic or dynamic to static transition by setting static thresholds on processed IMU and myoelectric sensor data. Classification involves recognizing the activity pattern based on periodic shape of trajectories of the triaxial wrist tilt angle and EMG-RMS from the two selected muscles. Second order Polynomial coefficients extracted from the sensor trajectory templates during specific dynamic activity cycles are used as features to classify dynamic activities. Classification algorithm and real time navigation of the wheelchair using the proposed algorithm has been tested by five healthy subjects. Classification accuracy of 94% was achieved by DSVM classifier on ‘k’ fold cross validation data of 5 users. Classification accuracy while operating the wheelchair was 90.5%.
KeywordsDendogram support vector machine Myoelectric Inertial measurement unit Omni wheel Holonomic control
Unable to display preview. Download preview PDF.
- 7.Simpson, R.C., LoPresti, E.F., Hayashi, S., Guo, S., Ding, D., Cooper, R.A.: Smart power assistance module for manual wheelchairs. technology and disability: research, design, practice and policy. In: 26th International Annual Conference on Assistive Technology for People with Disabilities (RESNA), 2003 Jun 19–23; Atlanta, GA. RESNA Press, Arlington (2003)Google Scholar
- 9.Fehr, L., Langbein, W.E., Skaar, S.B.: Adequacy of power wheelchair control interfaces for persons with severe disabilities: a clinical survey. J. Rehabil. Res. Dev. 37(3), 353–60 (2000)Google Scholar
- 11.Nakanishi, S., Kuno, Y., Shimada, N., Shirai, Y.: Robotic wheelchair based on observations of both user and environment. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Kyongju, Korea, pp. 912–7 (1999)Google Scholar
- 17.Khezri, M., Jahed, M.: A novel approach to recognize hand movements via semg patterns. In: 29th Annual International Conference of the IEEE EMBS, pp. 4907–4910 (2007)Google Scholar
- 18.Shuman, G.: Using forearm electromyograms to classify hand gestures. In: IEEE International Conference on Bioinformatics and Biomedicine, pp. 261–264 (2009)Google Scholar
- 19.Saponas, T.S., Tan, D.S., Morris, D., Balakrishnan, R.: Demonstrating the feasibility of using forearm electromyography for muscle–computer interfaces. In: Proceedings of 26th SIGCHI Conference Human Factors Computing System, Florence, Italy, pp. 515–524 (2008)Google Scholar
- 21.Sherrill, D.M., Bonato, P., De Luca, C.J.: A neural network approach to monitor motor activities. In: Proceedings of 2nd Joint EMBS/BMES Conference, Houston, TX, vol. 1, pp. 52–53 (2002)Google Scholar
- 23.Lajnefa, T., Chaibia, S., Rubyb, P., Aguerab, P.-E., Eichenlaubc, J.-B., Sameta, M., Kachouria, A., Jerbib, K.: Learning machines and sleeping brains: automatic sleep stage classification using decision-tree multi-class support vector machines. J. Neurosci. Methods 30(250), 94–105 (2015)CrossRefGoogle Scholar
- 27.Olguin, D.O., Pentland, A.: Human activity recognition: accuracy across common locations for wearable sensors. In: 10th International Symposium of Wearable Computer (Student Colloquium), Montreux, Switzerland (2006)Google Scholar
- 29.Conceic ao, A.S., Moreira, A.P., Costa, P.J.: Model identification of a four wheeled omni-directional mobile robot. In: Controlo 2006, 7th Portuguese Conference on Automatic Control, Instituto Superior Tecnico, Lisboa, Portugal (2006)Google Scholar
- 30.Lajnef, T.: Multiclass SVM classifier. http://www.mathworks.com/matlabcentral/fileexchange/48632-multiclass-svm-classifier. Accessed 12th August, 2016