Analysis and Design of Three Multimodal Interactive Systems to Support the Everyday Needs of Children with Cognitive Impairments
The autonomy and independence of users with cognitive impairments can be fostered through cognitive technologies. The use of traditional computer interfaces has however proved to be difficult for these users. This paper proposes three innovative systems to train children with cognitive impairments in three fundamental everyday life activities: (a) familiarizing with the home environments, its objects and activities; (b) learning about money and practicing shopping skills; and (c) learning how to prepare and cook simple meals. All three systems feature multimodal interaction and support multimedia output.
KeywordsMultimodal interactive systems Children with cognitive impairments Card-based interaction Touch Cooking Monetary transactions Learning the home environment
The authors would like to thank the Rehabilitation Centre for Children with Disabilities in Heraklion, Crete, for the valuable contribution during the requirements elicitation and the evaluation of the produced mockups and interactive prototypes. The graphics design for the “learning to cook” system was carried out by Elias Giannopoulos. The custom IR pointing device has been constructed by Elias Giannopoulos and Thanasis Toutountzis. Finally, the Content Editor and the Student Profiler have been implemented by Nikolaos Louloudakis, Evangelos Poutouris, Parthena Basina and Evropi Stephanidi.
- 1.Braddock, D., Rizzolo, M.C., Thompson, M., Bell, R.: Emerging technologies and cognitive disability. J. Spec. Educ. Technol. 19(4), 49–56 (2004)Google Scholar
- 2.Scherer, M.J.: Assistive Technologies and Other Supports for People with Brain Impairment, pp. 175–176. Springer Publishing Company, Heidelberg (2011)Google Scholar
- 3.Mechling, L.C.: Assistive technology as a self-management tool for prompting students with intellectual disabilities to initiate and complete daily tasks: A literature review. Education and Training in Developmental Disabilities, 252–269 (2007)Google Scholar
- 8.Giroux, S., Bauchet, J., Pigot, H., Lussier-Desrochers, D., Lachappelle, Y.: Pervasive behavior tracking for cognitive assistance. In: Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments, p. 86. ACM, July 2008Google Scholar
- 9.Langone, J., Clees, T.J., Rieber, L., Matzko, M.: The future of computer-based interactive technology for teaching individuals with moderate to severe disabilities: Issues relating to research and practice. J. Spec. Educ. Technol. 18(1), 5–16 (2003)Google Scholar
- 10.Ayres, K.M., Langone, J., Boon, R.T., Norman, A.: Computer-based instruction for purchasing skills. Educ. Training Dev. Disabil. 41(3), 253–263 (2006)Google Scholar
- 11.Hansen, D.L., Morgan, R.L.: Teaching grocery store purchasing skills to students with intellectual disabilities using a computer-based instruction program. Educ. Training Dev. Disabil. 43(4), 431–442 (2008)Google Scholar
- 12.Lanyi, C.S., Brown, D.J.: Design of serious games for students with intellectual disability. IHCI 10, 44–54 (2010)Google Scholar
- 13.Korozi, M., Leonidis, A., Margetis, G., Koutlemanis, P., Zabulis, X., Antona, M., Stephanidis, C.: Ambient educational mini-games. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 802–803. ACM, May 2012Google Scholar
- 14.Margetis, G., Zabulis, X., Ntoa, S., Koutlemanis, P., Papadaki, E., Antona, M., Stephanidis, C.: Enhancing education through natural interaction with physical paper. Universal Access in the Information Society, 1–21Google Scholar
- 16.Norman, D.A.: The design of Everyday Things, pp. 13–28. Basic books, New York (2002)Google Scholar