Skip to main content
SpringerLink
Log in

A Novel Integrated System of Visual Communication and Touch Technology for People with Disabilities

  • Conference paper
  • First Online:
Computational Science and Its Applications – ICCSA 2016 (ICCSA 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9787))

Included in the following conference series:

Abstract

Due to the current popularity of the internet of things (IoT), the research topic for communicating, connecting, and supporting people remotely through the internet is very popular in computational science in recent years. This paper presents a new integrated application to assist people with disabilities based on enhanced technologies of visual and touch communications in exploiting information and communication technology (ICT) innovative technologies. Our research aim is to help hearing impaired people to communicate both visually and affectingly to their loved one who may live distantly in different part of the world. By integrating an augmented reality application for visual communication and a wearable jacket for touch communication, it is able to support hard of hearing people via the human-computer interaction experience. A Google cardboard is also built for allowing people with hearing loss and deafness to have an immersive experience visually using augmented reality for geometric visualization. A hugging communication wearable tool, called T.Jacket, using sensor technology is then extended and applied to assist disabled people for hugging their loved one remotely by reproducing an artificial hug sense between two people affectingly. Experimental results have also been included to show the robustness of the proposed integrated application.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Nguyen, V., Lu, J., Zhao, S., Vu, D., Yang, H., Jones, D., Do, M.N.: ITEM: immersive telepresence for entertainment and meetings – a practical approach. IEEE J. Sel. Topics Signal Process. (J-STSP) 9(3), 546–561 (2015). Special Issue on Interactive Media Processing for Immersive Communication

    Article  Google Scholar 

  2. Kerdvibulvech, C: A methodology for hand and fingers motion analysis using adaptive probabilistic models. EURASIP J. Embed. Syst. (JES) (18), 9 (2014). Springer Publisher

    Google Scholar 

  3. Novotnya, M., Lacko, J., Samuelcika, M.: Applications of multi-touch augmented reality system in education and presentation of virtual heritage. Procedia Comput. Sci. 25, 231–235 (2013). Elsevier Publishing, Science Direct

    Article  Google Scholar 

  4. Huisman, G., Kolkmeier, J., Heylen, D.: Simulated social touch in a collaborative game. In: Auvray, M., Duriez, C. (eds.) EuroHaptics 2014, Part I. LNCS, vol. 8618, pp. 248–256. Springer, Heidelberg (2014)

    Google Scholar 

  5. Kerdvibulvech, C.: Vision and virtual-based human computer interaction applications for a new digital media visualization. In: The Proceeding of the 23rd International Conference on Computer Graphics, Visualization and Computer Vision (WSCG), Eurographics Association & ACM SIGGRAPH, Plzen, pp. 247–254, 8–12 June 2015

    Google Scholar 

  6. Mone, G.: Robots with a human touch. Commun. ACM 58(5), 18–19 (2015). CACM Homepage archive

    Article  Google Scholar 

  7. Chen, Y., Kosmas, P., Anwar, P.S., Huang, L.: A touch-communication framework for drug delivery based on a transient microbot system. IEEE Trans. Nanobiosci. 14(4), 397–408 (2015). IEEE Computational Intelligence Society

    Article  Google Scholar 

  8. Wu, Y., Babu, S.V., Armstrong, R., Bertrand, J.W., Luo, J., Roy, T., Daily, S.B., Cairco Dukes, L., Hodges, L.F., Fasolino, T.: Effects of virtual human animation on emotion contagion in simulated inter-personal experiences. IEEE Trans. Visual Comput. Graphics 20(4), 626–635 (2014)

    Article  Google Scholar 

  9. Hornero, G., Conde, D., Quilez, M., Domingo, S., Pena Rodriguez, M., Romero, B., Casas, O.: A wireless augmentative and alternative communication system for people with speech disabilities. IEEE Access 3, 1288–1297 (2015). IEEE Publishing

    Article  Google Scholar 

  10. Saad, S., Dandashi, A., Alja’am, J.M., Saleh, M.: The multimedia-based learning system improved cognitive skills and motivation of disabled children with a very high rate. Educ. Technol. Soc. 18(2), 366–379 (2015)

    Google Scholar 

  11. Kbar, G., Aly, S.: SMART workplace for persons with DISABiLitiEs (SMARTDISABLE). In: 2014 IEEE International Conference on Multimedia Computing and Systems (ICMCS), pp. 996–1001. IEEE Publishing, 14–16 April 2014

    Google Scholar 

  12. Neto, R., Fonseca, N.: Camera reading for blind people. Procedia Technol. 16, 1200–1209 (2014). Elsevier Publishing

    Article  Google Scholar 

  13. Magnenat, S., Ngo, D.T., Zund, F., Ryffel, M., Noris, G., Röthlin, G., Marra, A., Nitti, M., Fua, P., Gross, M., Sumner, B.: Live texturing of augmented reality characters from colored drawings. In: The Proceeding of the IEEE International Symposium on Mixed and Augmented Reality (IEEE ISMAR 2015), Fukuoka, 10 p., 29 September 2015

    Google Scholar 

  14. Hornero, G., Conde, D., Quilez, M., Domingo, S., Pena Rodriguez, M., Romero, B., Casas, O.: A wireless augmentative and alternative communication system for people with speech disabilities. IEEE Access 3, 1288–1297 (2015). IEEE Publishing

    Article  Google Scholar 

  15. Saad, S., Dandashi, A., Alja’am, J.M., Saleh, M.: The multimedia-based learning system improved cognitive skills and motivation of disabled children with a very high rate. Educ. Technol. Soc. 18(2), 366–379 (2015)

    Google Scholar 

  16. Cheok, A.D., Pradana, G.A.: Virtual touch. Scholarpedia 10(4), 32679 (2015)

    Article  Google Scholar 

  17. Yoo, S., Parker, C.: Controller-less interaction methods for Google cardboard. In: The Proceeding of the ACM Symposium on Spatial User Interaction (SUI), p. 127. ACM, New York (2015)

    Google Scholar 

  18. Perdikakis, A., Araya, A., Kiritsis, D.: Introducing augmented reality in next generation industrial learning tools: a case study on electric and hybrid vehicles. In: The Proceeding of the Procedia Engineering, the Manufacturing Engineering Society International Conference (MESIC), vol. 132, pp. 251–258. Elsevier Publishing, ScienceDirect (2015)

    Google Scholar 

  19. Matsukura, H., Yoneda, T., Ishida, H.: Smelling screen: presenting a virtual odor source on a LCD screen. In: The Proceeding of the IEEE Virtual Reality (VR), IEEE Computer Society, Lake Buena Vista, pp. 167–168, 18–20 March 2013

    Google Scholar 

  20. Obrist, M., Comber, R., Subramanian, S., Piqueras-Fiszman, B., Velasco, C., Spence, C.: Temporal, affective, and embodied characteristics of taste experiences: a framework for design. In: The Proceeding of the ACM CHI Conference on Human Factors in Computing Systems (CHI), Toronto, pp. 2853–2862, 26 April–1 May 2014

    Google Scholar 

Download references

Acknowledgments

This research presented herein was partially supported by a research grant from the Research Center, NIDA (National Institute of Development Administration).

Author information

Authors and Affiliations

  1. Graduate School of Communication Arts and Management Innovation, National Institute of Development Administration, 118 SeriThai Rd., Klong-chan, Bangkok, 10240, Bangkapi, Thailand

    Chutisant Kerdvibulvech

Authors
  1. Chutisant Kerdvibulvech
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chutisant Kerdvibulvech .

Editor information

Editors and Affiliations

  1. University of Perugia , Perugia, Italy

    Osvaldo Gervasi

  2. University of Basilicata , Potenza, Italy

    Beniamino Murgante

  3. Covenant University , Ota, Nigeria

    Sanjay Misra

  4. University of Minho , Braga, Portugal

    Ana Maria A.C. Rocha

  5. Polytechnic University , Bari, Italy

    Carmelo M. Torre

  6. Monash University , Clayton, Victoria, Australia

    David Taniar

  7. Kyushu Sangyo University , Fukuoka, Japan

    Bernady O. Apduhan

  8. Saint Petersburg State University , Saint Petersburg, Russia

    Elena Stankova

  9. Beijing University of Posts & Telecommunication , Beijing, China

    Shangguang Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Kerdvibulvech, C. (2016). A Novel Integrated System of Visual Communication and Touch Technology for People with Disabilities. In: Gervasi, O., et al. Computational Science and Its Applications – ICCSA 2016. ICCSA 2016. Lecture Notes in Computer Science(), vol 9787. Springer, Cham. https://doi.org/10.1007/978-3-319-42108-7_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-42108-7_39

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-42107-0

  • Online ISBN: 978-3-319-42108-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation