Skip to main content
SpringerLink
Log in

Designing assistive technology for getting more independence for blind people when performing everyday tasks: an auditory-based tool as a case study

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Everyday activities and tasks should in theory be easily carried by everyone, including the blind. Information and Communication Technology (ICT) has been widely used for supporting solutions. However, the solutions can be problematic for the visually impaired since familiarity with digital devices is often required. Or, indeed the procedure can be perceived as fiddly or impractical particularly for repetitive tasks due to the number/type of steps required to complete the task. This paper introduces a simple audio-based tool aimed at supporting visually-impaired people in the seemingly simple activity of checking whether the light in a room is on or off. It is an example of potential low tech devices that can be designed without the need for specific skills or knowledge by the user, and that functions in a practical way. In this context, we discuss the main issues and considerations for totally blind users in identifying whether a light is switched on. The proposed prototype is based on a simple circuit and a form of auditory feedback which informs the user whether they are switching on or off the light. Two prototypes have been designed and built for two different kinds of installation. For the subsequent second prototype, three different versions are proposed to provide a blind person with further support in easily identifying the light status at home. The new design includes enhanced auditory feedback and modifications to the dimensions. The evaluation conducted by involving various groups of end-users revealed the usefulness of the proposed tool. In addition, a survey conducted with 100 visually-impaired people reported the limitations and difficulties encountered by the blind in using existing devices. Moreover, the study revealed the interest from 94% of the participants for a potential (new) basic tool integrable with the existing lighting system. This study gives a contribution in the ambient intelligence field by (1) showing how an auditory-based tool can be used to support totally blind people to check the lights in an autonomous and relatively simple way; (2) proposing an idea that can be exploited in other application cases that use light feedback; and (3) proposing seven potential recommendations for designing assistive technology tools and common everyday devices, based on information gathered from the online survey.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Alemdar H, Ersoy C (2017) Multi-resident activity tracking and recognition in smart environments. J Ambient Intell Humaniz Comput 8(4):513–529

    Article  Google Scholar 

  • Amiribesheli M, Benmansour A, Bouchachia A (2015) A review of smart homes in healthcare. J Ambient Intell Humaniz Comput 6(4):495–517

    Article  Google Scholar 

  • Android Accessibility Help (2020) Use TalkBack gestures. https://support.google.com/accessibility/android/answer/6151827?hl=en. Accessed 16 Mar 2020.

  • Apple (2020) VoiceOver standard gestures. https://help.apple.com/voiceover/info/guide/10.11/en.lproj/vo27992.html. Accessed 16 Mar 2020.

  • Azimi I, Rahmani AM, Liljeberg P, Tenhunen H (2017) Internet of things for remote elderly monitoring: a study from user-centered perspective. J Ambient Int Humaniz Comput 8(2):273–289

    Article  Google Scholar 

  • Buchmayr M, Kurschl W (2011) A survey on situation-aware ambient intelligence systems. J Ambient Intell Humaniz Comput 2(3):175–183

    Article  Google Scholar 

  • Buzzi MC, Buzzi M, Leporini B, Trujillo A (2015) Design of web-based tools to study blind people’s touch-based interaction with smartphones. In: International conference on human-computer interaction, Springer, Cham, pp 7–12

  • Buzzi M, Leporini B, Meattini C (2019) Design guidelines for web interfaces of home automation systems accessible via screen reader. J Web Eng 18(4):477–512

    Article  Google Scholar 

  • Carvalho MCN, Dias FS, Reis AGS, Freire AP (2018) Accessibility and usability problems encountered on websites and applications in mobile devices by blind and normal-vision users. In: Proceedings of the 33rd Annual ACM symposium on applied computing, pp 2022–2029.

  • Chen SC, Wu CM, Chen YJ, Chin JT, Chen YY (2017) Smart home control for the people with severe disabilities. In: Applied system innovation (ICASI), 2017 International Conference on IEEE, pp 503–506.

  • Cook AM, Polgar JM (2014) Assistive technologies-e-book: principles and practice. Elsevier Health Sciences, Amsterdam

    Google Scholar 

  • Costa LC, Almeida NS, Correa AG, Lopes RD, Zuffo MK (2013) Accessible display design to control home area networks. IEEE Trans Consum Electron 59(2):422–427

    Article  Google Scholar 

  • Damaceno RJP, Braga JC, Mena-Chalco JP (2018) Mobile device accessibility for the visually impaired: problems mapping and recommendations. Univ Access Inf Soc 17(2):421–435

    Article  Google Scholar 

  • Debes C, Merentitis A, Sukhanov S, Niessen M, Frangiadakis N, Bauer A (2016) Monitoring activities of daily living in smart homes: understanding human behavior. IEEE Signal Process Mag 33(2):81–94

    Article  Google Scholar 

  • El-Basioni BMM, El-Kader SMA, Eissa HS (2014) Independent living for persons with disabilities and elderly people using smart home technology. Int J Appl Innov Eng Manag 3(4):11–28

    Google Scholar 

  • Freeman E, Wilson G, Brewster S (2016) Automatically adapting home lighting to assist visually impaired children. In: Proceedings of the 9th Nordic conference on human-computer interaction ACM, p 107.

  • Hersh M, Johnson MA (eds) (2010) Assistive technology for visually impaired and blind people. Springer, Berlin

    Google Scholar 

  • Jeet V, Dhillon HS, Bhatia S (2015) Radio frequency home appliance control based on head tracking and voice control for disabled person. In: Communication systems and network technologies (CSNT), 2015 Fifth International Conference on IEEE, pp 559–563.

  • Jones N, Bartlett HE, Cooke R (2019) An analysis of the impact of visual impairment on activities of daily living and vision-related quality of life in a visually impaired adult population. Br J Vis Impair 37(1):50–63

    Article  Google Scholar 

  • Leporini B, Buzzi M (2018) Home automation for an independent living: investigating the needs of visually impaired people. In: Proceedings of the 15th international cross-disciplinary conference on web accessibility, W4A2018, Lyon, France, April 23–25, 2018, ACM.

  • Leporini B, Rosellini M, Forgione N (2019) Is the light on or off?: a simple auditory-based tool to help visually-impaired people check the light device status. In: Proceedings of the 12th ACM international conference on pervasive technologies related to assistive environments, ACM, pp 152–155.

  • Living made easy (2020) Light probes or detectors. https://www.livingmadeeasy.org.uk/communication/light-probes-or-detectors-1381-p/. Accessed 16 Mar 2020.

  • Lotfi A, Langensiepen C, Mahmoud SM, Akhlaghinia MJ (2012) Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour. J Ambient Intell Humaniz Comput 3(3):205–218

    Article  Google Scholar 

  • Mekuria DN, Sernani P, Falcionelli N et al (2019) Smart home reasoning systems: a systematic literature review. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-019-01572-z.

    Article  Google Scholar 

  • Mennicken S, Hwang A, Yang R, Hoey J, Mihailidis A, Huang EM (2015) Smart for life: designing smart home technologies that evolve with users. In: Proceedings of the 33rd annual ACM conference extended abstracts on human factors in computing systems, ACM, pp 2377–2380.

  • Microsoft (2020) Seeing AI. https://www.microsoft.com/en-us/seeing-ai. Accessed 16 Mar 2020.

  • Mtshali P, Khubisa F (2019) A smart home appliance control system for physically disabled people. In: 2019 Conference on information communications technology and society (ICTAS) IEEE, pp 1–5.

  • Plantevin V, Bouzouane A, Bouchard B, Gaboury S (2019) Towards a more reliable and scalable architecture for smart home environments. J Ambient Intell Humaniz Comput 10(7):2645–2656

    Article  Google Scholar 

  • Poncela A, Coslado F, García B, Fernández M, Ariza J, Peinado G, Sandoval F (2019) Smart care home system: a platform for eAssistance. J Ambient Intell Humaniz Comput 10(10):3997–4021

    Article  Google Scholar 

  • Power C, Freire A, Petrie H, Swallow D (2012) Guidelines are only half of the story: accessibility problems encountered by blind users on the web. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, pp 433–442.

  • RNIB (2020 Colorino talking colour identifier and light detector, https://shop.rnib.org.uk/colorino-talking-colour-detector.html. Accessed 16 Mar 2020.

  • Rodrigues A, Montague K, Nicolau H, Guerreiro T (2015) Getting smartphones to TalkBack: understanding the smartphone adoption process of blind users. In: Proceedings of the 17th International ACM SIGACCESS Conference on computers and accessibility, ACM, pp 23–32.

  • Sierra JS, Togores J (2012) Designing mobile apps for visually impaired and blind users. In: The Fifth international conference on advances in computer-human interactions, 2012, pp 47–52.

  • Tahir SF, Fahad LG, Kifayat K (2019) Key feature identification for recognition of activities performed by a smart-home resident. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-019-01236-y

    Article  Google Scholar 

  • EveryWare Technologies (2020) Light detector. https://www.everywaretechnologies.com/apps/lightdetector. Accessed 16 Sep 2019.

  • Transition Technologies S.A. (2020) Seeing assistant light source detector. https://seeingassistant.tt.com.pl/light/. Accessed 16 Mar 2020.

  • Wahl HW, Oswald F, Zimprich D (1999) Everyday competence in visually impaired older adults: a case for person-environment perspectives. Gerontologist 39(2):140–149

    Article  Google Scholar 

  • Wang S, Yu J (2017) Everyday information behaviour of the visually impaired in China. Inf Res Int Electron J 22(1):n1

    Google Scholar 

  • Xin T, Guo B, Wang Z, Wang P, Yu Z (2018) FreeSense: human-behavior understanding using Wi-Fi signals. J Ambient Intell Humaniz Comput 9(5):1611–1622

    Article  Google Scholar 

  • Yuan CW, Hanrahan BV, Lee S, Rosson MB, Carroll JM (2019) Constructing a holistic view of shopping with people with visualimpairment: a participatory design approach. Universal Access in the Information Society 18(1):127–140. https://doi.org/10.1007/s10209-017-0577-1

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ISTI-CNR, via Moruzzi 1, 56124, Pisa, Italy

    Barbara Leporini

  2. DICI-University of Pisa, L.go L. Lazzarino 2, Pisa, Italy

    Michele Rosellini & Nicola Forgione

Authors
  1. Barbara Leporini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michele Rosellini
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nicola Forgione
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Barbara Leporini.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leporini, B., Rosellini, M. & Forgione, N. Designing assistive technology for getting more independence for blind people when performing everyday tasks: an auditory-based tool as a case study. J Ambient Intell Human Comput 11, 6107–6123 (2020). https://doi.org/10.1007/s12652-020-01944-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-020-01944-w

Keywords

Search

Navigation