Identifying Urban Mobility Challenges for the Visually Impaired with Mobile Monitoring of Multimodal Biosignals
In this study, we aim to better the user experience of the visually impaired when navigating in unfamiliar outdoor environments assisted by mobility technologies. We propose a framework for assessing their cognitive-emotional experience based on ambulatory monitoring and multimodal fusion of electroencephalography, electrodermal activity, and blood volume pulse signals. The proposed model is based on a random forest classifier which successfully infers in an automatic way the correct urban environment among eight predefined categories (AUROC 93 %). Geolocating the most predictive multimodal features that relate to cognitive load and stress, we provide further insights into the relationship of specific biomarkers with the environmental/situational factors that evoked them.
KeywordsVisual impairment Multimodal Data fusion EEG EDA BVP Classification Stress Cognitive load Urban mobility
The research leading to these results has received funding from the European Union’s Horizon 2020 Research and Innovation programme under grant agreement No 643636 “Sound of Vision.” The authors wish to thank the administration and O&M instructors at the National Institute for the Blind, Visually Impaired, and Deafblind in Iceland for their valuable input and generous assistance.
- 1.Badcock, N.A., Mousikou, P., Mahajan, Y., de Lissa, P., Thie, J., McArthur, G.: Validation of the emotiv EPOC EEG gaming system for measuring research quality auditory ERPs. PeerJ 1:e38 (2013)Google Scholar
- 12.Garbarino, M., Lai, M., Bender, D., Picard, R.W., Tognetti, S.: Empatica E3 - a wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. In: EAI 4th International Conference Wireless Mobile Communication Healthcare (Mobihealth), pp. 39–42 (2014)Google Scholar
- 13.Geruschat, D.R., Smith, A.J.: Low vision for orientation and mobility. In: Wiener, W.R., Welsh, R.L., Blasch, B.B. (eds.) Foundations of Orientation and Mobility. History and Theory, vol. I, 3rd edn. AFB Press, New York (2010)Google Scholar
- 15.Hosseini, S.A., Naghibi-Sistani, M.B.: Classification of emotional stress using brain activity. In: Gargiulo, G.D., McEwan, A. (eds.) Applied Biomedical Engineering, pp. 313–336. InTech, Rijeka (2011)Google Scholar
- 16.Jena, S.K.: Examination stress and its effect on EEG. Int. J. Med. Sci. Public Health 11(4), 1493–1497 (2015)Google Scholar
- 17.Marston, J.R., Golledge, R.G.: The hidden demand for participation in activities and travel by persons who are visually impaired. J. Vis. Impairment Blindness 97(8), 475–488 (2003)Google Scholar
- 19.Mavros, P., Skroumpelou, K., Smith, A.H.: Understanding the urban experience of people with visual impairments. In: Proceedings of GIS Research UK 2015, pp. 401–406. Leeds, 15–17 April 2015Google Scholar
- 22.Peper, E., Harvey, R., Lin, I.M., Tylova, H., Moss, D.: Is there more to blood volume pulse than heart rate variability, respiratory sinus arrhythmia, and cardiorespiratory synchrony? Biofeedback 35(2), 54–61 (2007)Google Scholar
- 24.Quiñones, P.A., Greece, T.C., Yang, R., Newman, M.W.: Supporting visually impaired navigation: a needs-finding study. In: ACM CHI Conference Human Factors Computing Systems, pp. 1645–1650. Vancouver, BC, 7–12 May 2011Google Scholar
- 27.Welsh, R.L.: Improving psychosocial functioning for orientation and mobility. In: Wiener, W.R., Welsh, R.L., Blasch, B.B. (eds.) Foundations of Orientation and Mobility. Instructional Strategies and Practical Applications, vol. 2, 3rd edn. AFB Press, New York (2010)Google Scholar