Abstract
Peer-to-peer communication has increasingly gained prevalence in people’s daily lives, with its widespread adoption being catalysed by technological advances. Although there have been strides for the inclusion of disabled individuals to ease communication between peers, people who suffer hand/arm impairments have scarce support in regular mainstream applications to efficiently communicate privately with other individuals. Additionally, as centralized systems have come into scrutiny regarding privacy and security, development of alternative, decentralized solutions has increased, a movement pioneered by Bitcoin that culminated on the blockchain technology and its variants.
Within the inclusivity paradigm, this paper aims to showcase an alternative on human-computer interaction with support for the aforementioned individuals, through the use of an electroencephalography headset and electromyography surface electrodes, for application navigation and text input purposes respectively. Users of the application are inserted in a decentralized system that is designed for secure communication and exchange of data between peers that are both resilient to tampering attacks and central points of failure, with no long-term restrictions regarding scalability prospects. Therefore, being composed of a silent speech and brain-computer interface, users can communicate with other peers, regardless of disability status, with no physical contact with the device. Users utilize a specific user interface design that supports such interaction, doing so securely on a decentralized network that is based on a distributed hash table for better lookup, insert and deletion of data performance. This project is still in early stages of development, having successfully been developed a functional prototype on a closed, testing environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Birbaumer, N., et al.: A spelling device for the paralysed. Nature 398, 297–298 (1999). https://doi.org/10.1038/18581
Bouhnik, D., Deshen, M., Gan, R.: Whatsapp goes to school: mobile instant messaging between teachers and students. J. Inf. Technol. Educ. Res. 13(1), 217–231 (2014)
Brooke, J., et al.: SUS-a quick and dirty usability scale. In: Usability Evaluation in Industry, vol. 189, no. 194, pp. 4–7 (1996)
Evgenov, P., et al.: White paper: Adamant messaging application. Technical report (2017). https://adamant.im/whitepaper/adamant-whitepaper-en.pdf
Fabiani, G.E., McFarland, D.J., Wolpaw, J.R., Pfurtscheller, G.: Conversion of EEG activity into cursor movement by a brain-computer interface (BCI). IEEE Trans. Neural Syst. Rehabil. Eng. 12(3), 331–338 (2004). https://doi.org/10.1109/TNSRE.2004.834627
Khan, M.J., Hong, M.J., Hong, K.S.: Decoding of four movement directions using hybrid NIRS-EEG brain-computer interface. Front. Hum. Neurosci. 8, 244 (2014). https://doi.org/10.3389/fnhum.2014.00244. https://www.frontiersin.org/article/10.3389/fnhum.2014.00244
Leavy, T.M., Ryan, G.: Decentralized authoritative messaging, 27 November 2018. US Patent 10,142,300
Nakamoto, S., et al.: Bitcoin: a peer-to-peer electronic cash system (2008). https://bitcoin.org/bitcoin.pdf
Rosello, P., Toman, P., Agarwala, N.: End-to-end neural networks for subvocal speech recognition. Stanford University (2017). http://www.pamelatoman.net/wp/wp-content/uploads/2018/06/subvocalspeechrecognitionpaper.pdf
Wan, Z., Guan, Z., Zhuo, F., Xian, H.: BKI: towards accountable and decentralized public-key infrastructure with blockchain. In: Lin, X., Ghorbani, A., Ren, K., Zhu, S., Zhang, A. (eds.) SecureComm 2017. LNICST, vol. 238, pp. 644–658. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-78813-5_33
Wand, M., Janke, M., Schultz, T.: The EMG-UKA corpus for electromyography speech processing. In: INTERSPEECH-2014, pp. 1593–1597 (2014)
Williamson, J., Murray-Smith, R., Blankertz, B., Krauledat, M., Müller, K.R.: Designing for uncertain, asymmetric control: interaction design for brain-computer interfaces. Int. J. Hum. Comput. Stud. 67, 827–841 (2009). https://doi.org/10.1016/j.ijhcs.2009.05.009
Wood, G., et al.: Ethereum: a secure decentralised generalised transaction ledger. Ethereum Project Yellow Paper 151(2014), 1–32 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Arteiro, L., Lourenço, F., Escudeiro, P., Ferreira, C. (2020). Brain-Computer Interaction and Silent Speech Recognition on Decentralized Messaging Applications. In: Stephanidis, C., Antona, M. (eds) HCI International 2020 - Posters. HCII 2020. Communications in Computer and Information Science, vol 1226. Springer, Cham. https://doi.org/10.1007/978-3-030-50732-9_1
Download citation
DOI: https://doi.org/10.1007/978-3-030-50732-9_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50731-2
Online ISBN: 978-3-030-50732-9
eBook Packages: Computer ScienceComputer Science (R0)