Leveraging Web Technologies to Expose Multiple Contemporary Controller Input in Smart TV Rich Internet Applications Utilized in Elderly Assisted Living Environments

  • Evdokimos I. Konstantinidis
  • Panagiotis E. Antoniou
  • Antonis Billis
  • Georgios Bamparopoulos
  • Costas Pappas
  • Panagiotis D. Bamidis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8515)


This work describes a lightweight framework allowing internet applications to access controllers such as the Wii remote, Wii balance board and MS Kinect irrespective of proximity or configuration. This is achieved by utilizing predetermined schemas for encapsulating the controller information and transferring this data through standard internet communication technologies (RESTFUL services and Web Sockets) in platform independent, device naïve ways. These features of the framework provide Rich Internet Applications (RIAs) with ubiquitous access to sophisticated human computer interaction schemes for diverse uses. The proliferation of Smart TVs as central information hubs in elderly assisted living environments, along with the need for simple gesture control schemes for these demographics, provides one application of this framework. Thus, we demonstrate how this service can be incorporated for developing internet applications and how it can be utilized for providing intuitive interaction methods for RIAs deployed through Smart TVs in elderly assisted living environments.


cross-device communication smart home elderly ambient assisted living ubiquitous communication technologies exergaming serious gaming 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Son, J.P., Sowmya, A.: Single-handed driving system with kinect. In: Kurosu, M. (ed.) HCII/HCI 2013, Part II. LNCS, vol. 8005, pp. 631–639. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  2. 2.
    Le, H.-A., Mac, K.-N.C., Pham, T.-A., Nguyen, V.-T., Tran, M.-T.: Multimodal smart interactive presentation system. In: Kurosu, M. (ed.) HCII/HCI 2013, Part IV. LNCS, vol. 8007, pp. 67–76. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  3. 3.
    Chang, H.-T., Li, Y.-W., Chen, H.-T., Feng, S.-Y., Chien, T.-T.: A dynamic fitting room based on microsoft kinect and augmented reality technologies. In: Kurosu, M. (ed.) HCII/HCI 2013, Part IV. LNCS, vol. 8007, pp. 177–185. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  4. 4.
    Meneses Viveros, A., Hernández Rubio, E.: Kinect©, as interaction device with a tiled display. In: Kurosu, M. (ed.) HCII/HCI 2013, Part IV. LNCS, vol. 8007, pp. 301–311. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  5. 5.
    Mandiliotis, D., Toumpas, K., Kyprioti, K., Kaza, K., Barroso, J., Hadjileontiadis, L.J.: Symbiosis: An Innovative Human-Computer Interaction Environment for Alzheimer’s Support. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part II. LNCS, vol. 8010, pp. 123–132. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  6. 6.
    Lou, Y., Wu, W.: A Real-time Personalized Gesture Interaction System Using Wii Remote and Kinect for Tiled-Display Environment. In: 25th International Conference on Software Engineering and Knowledge Engineering, Boston, USA (2013)Google Scholar
  7. 7.
    Billis, A.S., Konstantinidis, E.I., Mouzakidis, C., Tsolaki, M.N., Pappas, C., Bamidis, P.D.: A game-like interface for training seniors’ dynamic balance and coordination. In: XII Mediterranean Conference on Medical and Biological Engineering and Computing 2010, pp. 691–694. Springer (2010)Google Scholar
  8. 8.
  9. 9.
    Yasui, Y.: A brainwave signal measurement and data processing technique for daily life applications. J. Physiol. Anthropol. 28, 145–150 (2009)CrossRefGoogle Scholar
  10. 10.
    Weiser, M.: The computer for the 21st century. ACM SIGMOBILE Mob. Comput. Commun. Rev. 3, 3–11 (1999)CrossRefGoogle Scholar
  11. 11.
    Tan, C.S.S., Schoning, J., Luyten, K., Coninx, K.: Informing intelligent user interfaces by inferring affective states from body postures in ubiquitous computing environments. In: Proceedings of the 2013 International Conference on Intelligent user Interfaces, pp. 235–246. ACM, Santa Monica (2013)CrossRefGoogle Scholar
  12. 12.
    Nebeling, M., Zimmerli, C., Husmann, M., Simmen, D., Norrie, M.C.: Information Concepts for Cross-device Applications. In: DUI 2013 3rd Work. Distrib. User Interfaces Model. Methods Tools. Conjunction with ACM EICS (2013)Google Scholar
  13. 13.
    Melchior, J., Vanderdonckt, J., Roy, P., Van: A model-based approach for distributed user interfaces. In: EICS 2011 Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 11–20. ACM, Pisa (2011)Google Scholar
  14. 14.
    Paterno, F., Santoro, C., Paternò, F.: A logical framework for multi-device user interfaces. In: EICS 2012 Proceedings of the 4th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 45–50. ACM, Copenhagen (2012)Google Scholar
  15. 15.
    Edwards, K.W., Grinter, R.E.: At home with ubiquitous computing: Seven challenges. In: Abowd, G.D., Brumitt, B., Shafer, S. (eds.) UbiComp 2001. LNCS, vol. 2201, pp. 256–272. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  16. 16.
    Hughes, J., Rodden, T.: Understanding Technology in Domestic Environments: lessons for cooperative buildings. In: Yuan, F., Konomi, S., Burkhardt, H.-J. (eds.) CoBuild 1998. LNCS, vol. 1370, pp. 248–261. Springer, Heidelberg (1998)CrossRefGoogle Scholar
  17. 17.
    Cabrer, M., Redondo, R., Vilas, A., Pazos Arias, J., Duquw, J.: Controlling the smart home from TV. Consum. Electron. IEEE Trans. 52, 421–429 (2006)CrossRefGoogle Scholar
  18. 18.
    Pisan, Y., Marin, J.J.G., Navarro, K.F.K.: Improving lives: using Microsoft Kinect to predict the loss of balance for elderly users under cognitive load. In: Proceedings of the 9th Australasian Conference on Interactive Entertainment Matters of Life and Death, IE 2013, pp. 1–4. ACM Press, New York (2013)Google Scholar
  19. 19.
    Jung, Y., Li, K.J., Janissa, N.S., Gladys, W.L.C., Lee, K.M.: Games for a better life: effects of playing Wii games on the well-being of seniors in a long-term care facility. In: Proceedings of the Sixth Australasian Conference on Interactive Entertainment, pp. 1–6. ACM, Sydney (2009)CrossRefGoogle Scholar
  20. 20.
    Bogost, I.: Videogames and the future of education. Horiz 13, 119–128 (2005)CrossRefGoogle Scholar
  21. 21.
    Görgü, L., Campbell, A., Dragone, M., O’Hare, G.: Exergaming: a future of mixing entertainment and exercise assisted by mixed reality agents. Comput. Entertain. - Theor. Pract. Comput. Appl. Entertain. 8 (2010)Google Scholar
  22. 22.
    Konstantinidis, E.I., Antoniou, P.E., Bamparopoulos, G., Bamidis, P.D.: A lightweight framework for transparent cross platform communication of controller data in ambient assisted living environments (2013)Google Scholar
  23. 23.
    Artikis, A., Bamidis, P.D., Billis, A., Bratsas, C., Frantzidis, C., Karkaletsis, V., Klados, M., Konstantinidis, E., Konstantopoulos, S., Kosmopoulos, D., Papadopoulos, H., Perantonis, S., Petridis, S., Spyropoulos, C.S.: Supporting tele-health and AI-based clinical decision making with sensor data fusion and semantic interpretation: The USEFIL case study. In: International Workshop on Artificial Intelligence and NetMedicine, p. 21 (2012)Google Scholar
  24. 24.
    Billis, A.S., Konstantinidis, E.I., Ladas, A.I., Tsolaki, M.N., Pappas, C., Bamidis, P.D.: Evaluating affective usability experiences of an exergaming platform for seniors. In: 2011 10th International Workshop on Biomedical Engineering, pp. 1–4. IEEE (2011)Google Scholar
  25. 25.
    Chen, W.: Gesture-based applications for elderly people. In: Kurosu, M. (ed.) HCII/HCI 2013, Part IV. LNCS, vol. 8007, pp. 186–195. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  26. 26.
    Atzori, L., Iera, A., Morabito, G.: The Internet of Things: A survey. Comput. Networks 54, 2787–2805 (2010)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Evdokimos I. Konstantinidis
    • 1
  • Panagiotis E. Antoniou
    • 1
  • Antonis Billis
    • 1
  • Georgios Bamparopoulos
    • 1
  • Costas Pappas
    • 1
  • Panagiotis D. Bamidis
    • 1
  1. 1.Medical Physics Laboratory, Medical School, Faculty of Health SciencesAristotle University of ThessalonikiGreece

Personalised recommendations