On the Use of Brain Decoded Signals for Online User Adaptive Gesture Recognition Systems
Activity and context recognition in pervasive and wearable computing ought to continuously adapt to changes typical of open-ended scenarios, such as changing users, sensor characteristics, user expectations, or user motor patterns due to learning or aging. System performance inherently relates to the user’s perception of the system behavior. Thus, the user should be guiding the adaptation process. This should be automatic, transparent, and unconscious.
We capitalize on advances in electroencephalography (EEG) signal processing that allow for error related potentials (ErrP) recognition. ErrP are emitted when a human observes an unexpected behavior in a system. We propose and evaluate a hand gesture recognition system from wearable motion sensors that adapts online by taking advantage of ErrP. Thus the gesture recognition system becomes self-aware of its performance, and can self-improve through re-occurring detection of ErrP signals.
Results show that our adaptation technique can improve the accuracy of a user independent gesture recognition system by 13.9% when ErrP recognition is perfect. When ErrP recognition errors are factored in, recognition accuracy increases by 4.9%. We characterize the boundary conditions of ErrP recognition guaranteeing beneficial adaptation. The adaptive algorithms are applicable to other forms of activity recognition, and can also use explicit user feedback rather than ErrP.
Unable to display preview. Download preview PDF.
- 1.Ward, J.A.: Activity Monitoring: Continuous Recognition and Performance Evaluation. PhD thesis, ETH Zurich, Nr. 16520 (2006)Google Scholar
- 3.Ravi, N., Dandekar, N., Mysore, P., Littman, M.L.: Activity recognition from accelerometer data. American Association for Artificial Intelligence (2005)Google Scholar
- 5.Bao, L., Intille, S.S.: Activity recognition from user-annotated acceleration data. In: Pervasive Computing: Proc. of the 2nd Int Conference, pp. 1–17 (2004)Google Scholar
- 10.Santosh, K.C., Nattee, C.: A comprehensive survey on on-line handwriting recognition technology and its real application to the nepalese natural handwriting (2009)Google Scholar
- 13.Ohmura, R., Hashida, N., Imai, M.: Preliminary evaluation of personal adaptation techniques in accelerometer-based activity recognition. In: Proc. 13th IEEE Int. Symposium on Wearable Computers: Late Breaking Results (2009)Google Scholar
- 15.Kunze, K., Lukowicz, P.: Using acceleration signatures from everyday activities for on-body device location. In: 2007 11th IEEE International Symposium on Wearable Computers, September 2007, pp. 115–116 (2007)Google Scholar
- 16.Förster, K., Roggen, D., Tröster, G.: Unsupervised classifier self-calibration through repeated context occurences: Is there robustness against sensor displacement to gain? In: Proc. 13th IEEE Int. Symposium on Wearable Computers (ISWC), pp. 77–84 (2009)Google Scholar
- 23.Chavarriaga, R., Ferrez, P.W., Millán, J.: To Err Is Human: Learning from error potentials in brain-computer interfaces. In: International Conference on Cognitive Neurodynamics (2007)Google Scholar
- 24.Bollon, J.M., Chavarriaga, R., Millán, J., Bessière, P.: EEG error-related potentials detection with a Bayesian filter. In: 4th International IEEE EMBS Conference on Neural Engineering, Antalya Turkey (2009)Google Scholar
- 27.Liu, H., Setiono, R.: A probabilistic approach to feature selection - a filter solution, pp. 319–327. Morgan Kaufmann, San FranciscoGoogle Scholar
- 29.John, G., Langley, P.: Estimating continuous distributions in Bayesian classifiers. In: Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, pp. 338–345. Morgan Kaufmann, San Francisco (1995)Google Scholar
- 30.Castillo, E., Gutiérrez, J.M., Hadi, A.S.: Expert Systems and Probabilistic Network Models, Erste edn. Springer, New York (1996)Google Scholar
- 31.Aha, D.W., Kibler, D.: Instance-based learning algorithms. In: Machine Learning, pp. 37–66 (1991)Google Scholar
- 32.Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques with Java Implementations, 1st edn. The Morgan Kaufmann Series in Data Management Systems. Morgan Kaufmann, San Francisco (1999)Google Scholar
- 33.Tsymbal, A.: The problem of concept drift: Definitions and related work. Technical report, Department of Computer Science, Trinity College (2004)Google Scholar
- 34.Casson, A., Smith, S., Duncan, J., Rodriguez-Villegas, E.: Wearable EEG: what is it, why is it needed and what does it entail? In: Proc. IEEE Eng. Med. Biol. Soc., pp. 5867–5870 (2008)Google Scholar
- 35.Garipelli, G., Galán, F., Chavarriaga, R., Ferrez, P.W., Lew, E., Millán, J.: The use of Brain-Computer Interfacing for Ambient Intelligence. In: Intl. Workshop on Human Aspects in Ambient Intelligence (2007)Google Scholar