Modeling the Interaction and Control of Smart Universal Interface for Persons with Disabilities

  • Shady Aly
  • Ghassan Kbar
  • Mohammed Abdullah
  • Ibraheem Al-Sharawy
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9194)

Abstract

A little if not rare work has been considered empowering the PWD with smart universal assistive technologies at the workplace. Most researches focus on specific or single impairment condition such as smart solutions for blind or low vision persons, physically disabled persons (PDP), deaf or mute persons, and mostly with home or building places. This paper present the models of interaction and control of a universal interface solution for PWD, called SMARTUNIVERS. The SMARTUNIVERS is currently being developed within the of SMARTDISABLE’s research project activities implemented at the Riyadh Techno Valley, King Saud University, Riyadh, KSA. IT includes two smart interface modules: Smart Help (SMARTHELP) and Smart editor (SMARTEDIT). The SMARTHELP module provides personalized smart help and communication services for the PWD at workplace. The SMARTEDIT module is a multimodal editor interface that provides the capability for wide spectra of PWD groups (11 groups with various combination of disabilities) to edit documents using multi-model ways of interactions and commanding through use of speech recognition engine, text-to-speech, Mic, virtual mouse/keyboard and Braille keyboard. We shall present in this paper the high level design of the SMARTUNIVERS and the two smart component modules, together with the interaction models and scenarios for some typically covered PWD groups. The SMARTUNIVERS provides a flexible dynamic interface that adjusts itself according to the impairment conditions associated with the eleven supported groups of PWD.

Keywords

Ambient Assisted Living (AAL) Smart workplace Persons With Disability (PWD) Human Computer Interaction (HCI) 

Notes

Acknowledgment

This work was supported by NSTIP strategic technologies program number (12-ELE3220-02) in the kingdom of Saudi Arabia.

References

  1. 1.
    Rashidi, P., Mihailidis, A.: A survey on ambient-assisted living tools for older adults. IEEE J. Biomed. Health Inf. 17(3), 579–590 (2013)CrossRefGoogle Scholar
  2. 2.
    Chang, Y.J., Wang, T.Y., Chen, Y.R.: A location-based prompting system to transition autonomously through vocational tasks for individuals with cognitive impairments. Res. Dev. Disabil. 32, 2669–2673 (2011)CrossRefGoogle Scholar
  3. 3.
    Hakobyan, L., Lumsden, J., O’Sullivan, D., Bartlett, H.: Mobile assistive technologies for the visually impaired. Surv. Ophthalmol. 58, 513–528 (2013)CrossRefGoogle Scholar
  4. 4.
    Kbar, G., Aly, S.: SMART Workplace for Persons with Disabilities (SMARTDISABLE). In: 4th International Conference on Multimedia Computing and Systems (ICMCS 2014), pp. 996–100. IEEE Explore, April 2014Google Scholar
  5. 5.
    Chang, Y.J., Kang, Y.S., Liu, F.L.: A computer-based interactive game to train persons with cognitive impairments to perform recycling tasks independently. Res. Dev. Disabil. 35, 3672–3677 (2014)CrossRefGoogle Scholar
  6. 6.
    Angkananon, K., Wald, M., Gilbert, L.: Applying technology enhanced interaction framework to accessible mobile learning. Procedia Comput. Sci. 27, 261–270 (2014)CrossRefGoogle Scholar
  7. 7.
    Lancioni, G.E., O’Reilly, M.F., Singh, N.N., Sigafoos, J., Oliva, D., Alberti, G., Lang, R.: Two adults with multiple disabilities use a computer-aided telephone system to make phone calls independently. Res. Dev. Disabil. 32, 2330–2335 (2011)CrossRefGoogle Scholar
  8. 8.
    Halawani, S.M., Zaitun, A.B.: An avatar based translation system from arabic speech to arabic sign language for deaf people. Int. J. Inf. Sci. Edu. 2(1), 13–20 (2012)Google Scholar
  9. 9.
    Peixoto, N., Nik, H.G., Charkhkar, H.: Voice controlled wheelchairs: fine control by humming. Comput. Methods Programs Biomed. 112, 156–165 (2013)CrossRefGoogle Scholar
  10. 10.
    Yang, S., Lin, C., Lin, S., Lee, C.: Design of virtual keyboard using blink control method for the severely disabled. Comput. Methods Programs Biomed. 111(2), 410–418 (2013)CrossRefGoogle Scholar
  11. 11.
    Hawley, M.S., Cunningham, S.P., Green, P.D., Enderby, P., Palmer, R., Sehgal, S., O’Neill, P.: A Voice-Input Voice-Output Communication Aid for people with severe speech impairment. IEEE Trans. Neural Syst. Rehabil. Eng. 21(1) (2013)Google Scholar
  12. 12.
    Jain D.: Path-guided indoor navigation for the visually impaired using minimal building retrofitting. In: Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility, pp. 225–232 (2014)Google Scholar
  13. 13.
    Padmanabhan V., Sornalatha, M.: Hand Gesture recognition and voice conversion system for dumb people. Int. J. Sci. Eng. Res. 5(5), May 2014Google Scholar
  14. 14.
    Mohamad Jamil, M.H., Al-Haddad, S.A.R., Kyun Ng, C.: A flexible speech recognition system for cerebral palsy disabled. In: Abd Manaf, A., Zeki, A., Zamani, M., Chuprat, S., El-Qawasmeh, E. (eds.) ICIEIS 2011, Part I. CCIS, vol. 251, pp. 42–55. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  15. 15.
    Hossain, M.A., Shirehjini, A.A.N., Alghamdi, A.S., El Saddik, A.: Adaptive interaction support in ambient-aware environments based on quality of context information. Multimedia Tools Appl. 67(2), 409–432 (2013)CrossRefGoogle Scholar
  16. 16.
    Karime, A., Hossain, M.A., Rahman, A.M., Gueaieb, W., Alja’am, J.M., El Saddik, A.: RFID-based interactive multimedia system for the children. Multimedia Tools Appl. 59(3), 749–774 (2012)CrossRefGoogle Scholar
  17. 17.
    Kbar, G., Aly, S., Alsharawy, I., Bhatia, A., Alhasan, N., Enriquez, R.: Smart help at the workplace for persons with disabilities (SHW-PWD). Int. J. Comput. Inf. Syst. Control Eng. 9, 1586–1592 (2015)Google Scholar
  18. 18.
    JISC Guide, “Graphical User Interface Design: Developing Usable and Accessible Collections”. http://www.jiscdigitalmedia.ac.uk/guide/graphical-user-interface-design-developing-usable-and-accessible-collection. Accessed 25 Jan 2015

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Shady Aly
    • 1
  • Ghassan Kbar
    • 2
  • Mohammed Abdullah
    • 3
  • Ibraheem Al-Sharawy
    • 1
  1. 1.Industrial Engineering Department, College of EngineeringKing Saud University RiyadhRiyadhKingdom of Saudi Arabia
  2. 2.Riyadh Techno-ValleyKing Saud University RiyadhRiyadhKingdom of Saudi Arabia
  3. 3.RiyadhKingdom of Saudi Arabia

Personalised recommendations