Abstract
This paper presents an information technology based on modern IT devices (netbooks, tablets, phones, etc) and supporting an alternative communication for persons with (temporary or permanent) verbal communication disorders. It is proposed to implement this communication through the intellectualization of the process of entering text data with applying a limited number of relevant controls specified by a person’s hand. A human skeleton model is investigated with a view to determining a limited number of hand configurations and motions reliably identified by recognition tools of IT devices.
Similar content being viewed by others
References
Augmentative and Alternative Communication (AAC), http://www.asha.org/public/speech/disorders/AAC/.
Iu. G. Kryvonos, Iu. V. Krak, O. V. Barmak, and D. V. Shkilniuk, “Construction and identification of elements of sign communication,” Cybernetics and Systems Analysis, 49, No. 2, 163–172 (2013).
Iu. V. Krak, Iu. G. Kryvonos, and A. I. Kulias, “Applied aspects of the synthesis and analysis of voice information,” Cybernetics and Systems Analysis, 49, No. 4, 589–596 (2013).
Iu. G. Kryvonos and Iu. V. Krak, “Modeling human hand movements, facial expressions, and articulation to synthesize and visualize gesture information,” Cybernetics and Systems Analysis, 49, No. 4, 501–505 (2011).
D. L. Grover, M. T. King, and C. A. Kuschler, “Reduced keyboard disambiguating computer,” Patent No. US5818437, Tegic Communications, Inc., Seattle, WA (1998).
M. Silfverberg, I. S. MacKenzie, and P. Korhonen, “Predicting text entry speed on mobile phones,” in: Proc. ACM Conf. on Human Factors in Computing Systems, ACM, New York (2000), pp. 9–16.
Iu. G. Kryvonos, Iu. V. Krak, Yu. V. Barchukova, and B. A. Trotsenko, “Human hand motion parametrization for dactilemes modeling,” Journal of Automation and Information Sciences, 43, No. 12, 1–11 (2011).
R. Y. Wang and J. Popovic, “Real-time hand-tracking with a color glove,” ACM Transaction on Graphics (TOG), 28, No. 3, 1–8 (2009).
H-D. Yang, “Sign language recognition with the kinect sensor based on conditional random fields,” Sensors, 15, 135–147 (2015).
Leap Motion | Mac & PC Motion Controller for Games, Design, & More, https://www.leapmotion.com/.
Enable Viacam: Free webcam based mouse emulator, http://eviacam.sourceforge.net/.
“Eye tracking, or gaze tracking, is a technology that consists in calculating the eye gaze point of a user as he or she looks around,” https://theeyetribe.com/.
Analysis Services, https://msdn.microsoft.com/ru-ru/library/bb522607(v=sql.120).aspx.
Author information
Authors and Affiliations
Corresponding author
Additional information
Translated from Kibernetika i Sistemnyi Analiz, No. 5, September–October, 2016, pp. 3–13.
Rights and permissions
About this article
Cite this article
Kryvonos, I.G., Krak, I.V., Barmak, O.V. et al. New Tools of Alternative Communication for Persons with Verbal Communication Disorders. Cybern Syst Anal 52, 665–673 (2016). https://doi.org/10.1007/s10559-016-9869-3
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10559-016-9869-3