Potentials of the Tangible User Interface (TUI) in Enhancing Inclusion of People with Special Needs in the ICT-Assisted Learning and e-Accessibility

  • Matej Zajc
  • Andreja Istenic Starcic
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7327)


In the modern society, inclusion of persons with disabilities in the mainstream education is increasingly enhanced. The presented example focuses on inclusion of individuals for whom their learning environment is created and adapted according to their special needs and capabilities. In establishing the learning environment, the role of multimedia and ICT is important. Persons with disabilities are often disadvantaged in ICT and in participating in the classroom collaborative activities. The paper presents a novel interactive application utilizing tangible user interface (TUI) as an alternative input device for computer-supported collaborative learning and game based-learning. In the final part of our paper, we summarize the main findings and results of evaluation of our interactive game for the ICT-assisted learning of people with special needs often having them tested in a real educational environment. The findings indicate high usability of TUI for people with physical impairment and severe to mild learning difficulties for whom it enables inclusive ICT and e-accessibility.


tangible user interface TUI assisted learning ICT multimedia e-accessibility inclusion 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Apitz, G., Guimbretière, F., Zhai, S.: Foundations for designing and evaluating user interfaces based on the crossing paradigm. ACM Transactions on Computer-Human Interaction 17(2), 1–42 (2010)CrossRefGoogle Scholar
  2. 2.
  3. 3.
    Costanza, E., Shelley, S.B., Robinson, J.: Introducing audio d-touch: A tangible user interface for music composition and performance. In: Davies, M. (ed.) Proceedings of the 2003 International Conference DAFx 2003 (2003)Google Scholar
  4. 4.
    ENABLE: ICT supported learning for people with special needs,
  5. 5.
    Feltham, F.G.: Do the blocks rock: A tangible interface for play and exploration. In: Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat, pp. 188–194. ACM, New York (2008)CrossRefGoogle Scholar
  6. 6.
    Fishkin, K.: A taxonomy for and analysis of tangible interfaces. Personal and Ubiquitous Computing 8(5), 347–358 (2004)CrossRefGoogle Scholar
  7. 7.
    Fitzmaurice, G.W., Buxton, W.: An Empirical Evaluation of Graspable User Interfaces: towards specialized, space-multiplexed input. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 43–50. ACM, Atlanta (1997)CrossRefGoogle Scholar
  8. 8.
    Inkpen, K.M.: Drag-and-drop versus point-and-click mouse interaction styles for children. ACM Transactions on Computer-Human Interaction 8(11), 1–33 (2001)CrossRefGoogle Scholar
  9. 9.
    Ishii, H.: The tangible user interface and its evolution. Communications of the ACM 51(6), 32–36 (2008)CrossRefGoogle Scholar
  10. 10.
    Istenic Starcic, A.: Educational technology for inclusive classroom. TOJET 9(3), 26–37 (2010)Google Scholar
  11. 11.
    Istenic Starcic, A., Zajc, M.: An interactive tangible user interface application for learning addition concepts. British Journal of Educational Technology 42(6), 131–135 (2011)CrossRefGoogle Scholar
  12. 12.
    Istenic Starcic, A., Niskala, M.: Vocational students with severe learning difficulties learning on the Internet. British Journal of Educational Technology 41(6), E155–E159 (2010)CrossRefGoogle Scholar
  13. 13.
    Istenic Starcic, A., Cotic, M., Zajc, M.: Design-based research on the use of a tangible user interface for geometry teaching in an inclusive class-room. British Journal of Educational Technology (accepted for publication, 2012) Google Scholar
  14. 14.
    Jordà, S., Geiger, G., Alonso, M., Kaltenbrunner, M.: The reacTable: Exploring the synergy between live music performance and desktop tangible interfaces. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction, TEI, pp. 139–146. ACM, New York (2007)CrossRefGoogle Scholar
  15. 15.
    Juan, C., Canu, R., Giménez, M.: Augmented reality interactive storytelling systems using tangible cubes for edutainment. In: Proceedings of the 8th IEEE International Conference on Advanced Learning Technologies, ICALT, pp. 233–235. IEEE Computer Society, Los Alamitos (2008)CrossRefGoogle Scholar
  16. 16.
    Kumpf, A.: Trackmate: Large-scale accessibility of tangible user interfaces (unpublished master’s thesis), Massachusetts Institute of Technology, Cambridge, MA (2009) Google Scholar
  17. 17.
    Leganchuk, A., Zhai, S., Buxton, W.: Manual and cognitive benefits of two-handed input: an experimental study. ACM Transactions on Computer-Human Interaction 5(4), 326–359 (1998)CrossRefGoogle Scholar
  18. 18.
  19. 19.
    Moggridge, B.: Designing Interactions. MIT Press (2007) Google Scholar
  20. 20.
    O’Malley, C., Fraser, D.S.: Literature review in learning with tangible technologies (Report 12). Nesta Futurelab Series, Bristol (2004)Google Scholar
  21. 21.
    Porta, M.: Human–computer input and output techniques: an analysis of current research and promising applications. Artificial Intelligence Review 28(3), 197–226 (2009)CrossRefGoogle Scholar
  22. 22.,
  23. 23.
    Resnick, M., Silverman, B.: Some reflections on designing construction kits for kids. In: Eisenberg, M., Eisenberg, A. (eds.) Proceedings of the 2005 Conference on Interaction Design and Children, pp. 117–122. ACM, New York (2005)CrossRefGoogle Scholar
  24. 24.
    Shaer, O., Hornecker, E.: Tangible user interfaces: Past, present, and future directions. Foundations and Trends in Human–Computer Interaction 3(1-2), 1–137 (2009)CrossRefGoogle Scholar
  25. 25.
    Shaer, O., Jacob, R.J.K.: A specification paradigm for the design and implementation of tangible user interfaces. ACM Transactions on Computer-Human Interaction 16(4), 1–39 (2009)Google Scholar
  26. 26.
    Sharlin, E., Watson, B., Kitamura, Y., Kishino, F., Itoh, Y.: On tangible user interfaces, humans and spatiality. Personal and Ubiquitous Computing 8(5), 338–346 (2004)CrossRefGoogle Scholar
  27. 27.
    Toney, A., Thomas, B.H.: Considering Reach in Tangible and Table Top Design. In: Proceedings of the 1st IEEE International Workshop on Horizontal Interactive Human-Computer Systems, pp. 57–58. IEEE CS, Adelaide (2006)Google Scholar
  28. 28.
  29. 29.
    Tuddenham, P.: Graspables Revisited: Multi-Touch vs. Tangible Input for Desktop Displays in Acquisition and Manipulation Tasks. In: Sarcevic, A. (ed.) Proceedings of the 28th International Conference on Human Factors in Computing Systems, pp. 2223–2232. ACM, New York (2010)Google Scholar
  30. 30.
    Wong, A.W.K., Chan, C.C.H., Li-Tsang, C.W.P., Lam, C.S.: Competence of people with intellectual disabilities on using human–computer interface. Research in Developmental Disabilities 30, 107–123 (2009)CrossRefGoogle Scholar
  31. 31.
    W3C Leading the Web to its full potential,
  32. 32.
    W3C WAI Web accessibility initiative,
  33. 33.
    Wong, A.W.K., Chan, C.C.H., Li-Tsang, C.W.P., Lam, C.S.: Competence of people with intellectual disabilities on using human–computer in-terface. Research in Developmental Disabilities 30, 107–123 (2009)CrossRefGoogle Scholar
  34. 34.
    Xu, D., Read, J.C., Mazzone, E., MacFarlane, S., Brown, M.: Evaluation of Tangible User Interfaces (TUIs) for and with Children – Methods and Challenges. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4551, pp. 1008–1017. Springer, Heidelberg (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Matej Zajc
    • 1
  • Andreja Istenic Starcic
    • 2
    • 3
  1. 1.Faculty of Electrical EngineeringUniversity of LjubljanaLjubljanaSlovenia
  2. 2.Faculty of Civil and Geodetic EngineeringUniversity of LjubljanaLjubljanaSlovenia
  3. 3.Faculty of EducationUniversity of PrimorskaKoperSlovenia

Personalised recommendations