Towards User-Defined Cross-Device Interaction

  • Audrey Sanctorum
  • Beat Signer
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9881)


Over the last decade we have seen various research on distributed user interfaces (DUIs). We provide an overview of existing DUI approaches and classify the different solutions based on the granularity of the distributed UI components, location constraints as well as their support for the distribution of state. We propose an approach for user-defined cross-device interaction where users can author their customised user interfaces based on a hypermedia metamodel and the concept of active components. Furthermore, we discuss the configuration and sharing of customised distributed user interfaces by end users where the focus is on an authoring rather than programming approach.


Cross-device interaction DUIs End-user development 



The research of Audrey Sanctorum is funded by a PhD grant of the Research Foundation Flanders (FWO).


  1. 1.
    Bader, T., Heck, A., Beyerer, J.: Lift-and-drop: crossing boundaries in a multi-display environment by airlift. In: Proceedings of AVI 2010, Roma, Italy, May 2010Google Scholar
  2. 2.
    Balme, L., Demeure, A., Barralon, N., Calvary, G.: CAMELEON-RT: a software architecture reference model for distributed, migratable, and plastic user interfaces. In: Markopoulos, P., Eggen, B., Aarts, E., Crowley, J.L. (eds.) EUSAI 2004. LNCS, vol. 3295, pp. 291–302. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  3. 3.
    Bardram, J., Gueddana, S., Houben, S., Nielsen, S.: ReticularSpaces: activity-based computing support for physically distributed and collaborative smart spaces. In: Proceedings of CHI 2012, Austin, USA, May 2012Google Scholar
  4. 4.
    Bardram, J., Houben, S., Nielsen, S., Gueddana, S.: The design and architecture of reticularspaces: an activity-based computing framework for distributed and collaborative smartspaces. In: Proceedings of EICS 2012, Copenhagen, Denmark, June 2012Google Scholar
  5. 5.
    Biehl, J.T., Bailey, B.P.: ARIS: an interface for application relocation in an interactive space. In: Proceedings of GI 2004, London, Canada, May 2004Google Scholar
  6. 6.
    Biehl, J.T., Baker, W.T., Bailey, B.P., Tan, D.S., Inkpen, K.M., Czerwinski, M.: IMPROMPTU: a new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. In: Proceedings of CHI 2008, Florence, Italy, April 2008Google Scholar
  7. 7.
    Chang, T., Li, Y.: Deep shot: a framework for migrating tasks across devices using mobile phone cameras. In: Proceedings of CHI 2011, Vancouver, Canada, May 2011Google Scholar
  8. 8.
    Chi, P.P., Li, Y.: Weave: scripting cross-device wearable interaction. In: Proceedings of CHI 2015, Seoul, Republic of Korea, April 2015Google Scholar
  9. 9.
    Demeure, A., Sottet, J., Calvary, G., Coutaz, J., Ganneau, V., Vanderdonckt, J.: The 4C reference model for distributed user interfaces. In: Proceedings of ICAS 2008, Gosier, Guadeloupe, March 2008Google Scholar
  10. 10.
    Elmqvist, N.: Distributed user interfaces: state of the art. In: Distributed User Interfaces: Designing Interfaces for the Distributed Ecosystem. Human-Computer Interaction Series (2011)Google Scholar
  11. 11.
    Everitt, K., Shen, C., Ryall, K., Forlines, C.: MultiSpace: enabling electronic document micro-mobility in table-centric, multi-device environments. In: Proceedings of Tabletop 2006, Adelaide, Australia, January 2006Google Scholar
  12. 12.
    Frosini, L., Manca, M., Paternò, F.: A framework for the development of distributed interactive applications. In: Proceedings of EICS 2013, London, UK, June 2013Google Scholar
  13. 13.
    Hamilton, P., Wigdor, D.J.: Conductor: enabling and understanding cross-device interaction. In: Proceedings of CHI 2014, Toronto, Canada, April 2014Google Scholar
  14. 14.
    Han, R., Perret, V., Naghshineh, M.: WebSplitter: a unified XML framework for multi-device collaborative web browsing. In: Proceedings of CSCW 2000, Philadelphia, USA, December 2000Google Scholar
  15. 15.
    Husmann, M., Nebeling, M., Pongelli, S., Norrie, M.C.: MultiMasher: providing architectural support and visual tools for multi-device mashups. In: Benatallah, B., Bestavros, A., Manolopoulos, Y., Vakali, A., Zhang, Y. (eds.) WISE 2014, Part II. LNCS, vol. 8787, pp. 199–214. Springer, Heidelberg (2014)CrossRefGoogle Scholar
  16. 16.
    Johanson, B., Fox, A., Winograd, T.: The interactive workspaces project: experiences with ubiquitous computing rooms. IEEE Pervasive Comput. 1(2), 67–74 (2002)CrossRefGoogle Scholar
  17. 17.
    Leigh, S., Schoessler, P., Heibeck, F., Maes, P., Ishii, H.: THAW: tangible interaction with see-through augmentation for smartphones on computer screens. In: Proceedings of TEI 2015, Stanford, CA, USA, January 2015Google Scholar
  18. 18.
    Marquardt, N., Hinckley, K., Greenberg, S.: Cross-device interaction via micro-mobility and F-formations. In: Proceedings of UIST 2012, Cambridge, USA, October 2012Google Scholar
  19. 19.
    Melchior, J.: Distributed user interfaces in space and time. In: Proceedings of EICS 2011, Pisa, Italy, June 2011Google Scholar
  20. 20.
    Melchior, J., Grolaux, D., Vanderdonckt, J., Roy, P.V.: A toolkit for peer-to-peer distributed user interfaces: concepts, implementation, and applications. In: Proceedings of EICS 2009, Pittsburgh, USA, July 2009Google Scholar
  21. 21.
    Nebeling, M., Mintsi, T., Husmann, M., Norrie, M.C.: Interactive development of cross-device user interfaces. In: Proceedings of CHI 2014, Toronto, Canada, April 2014Google Scholar
  22. 22.
    Nebeling, M., Zimmerli, C., Husmann, M., Simmen, D.E., Norrie, M.C.: Information concepts for cross-device applications. In: Proceedings of DUI 2013, London, UK, June 2013Google Scholar
  23. 23.
    Paternò, F., Santoro, C.: A logical framework for multi-device user interfaces. In: Proceedings of EICS 2012, Copenhagen, Denmark, June 2012Google Scholar
  24. 24.
    Rädle, R., Jetter, H., Marquardt, N., Reiterer, H., Rogers, Y.: HuddleLamp: spatially-aware mobile displays for ad-hoc around-the-table collaboration. In: Proceedings of ITS 2014, Dresden, Germany, November 2014Google Scholar
  25. 25.
    Rekimoto, J.: Pick-and-drop: a direct manipulation technique for multiple computer environments. In: Proceedings of UIST 1997, Banff, Canada, October 1997Google Scholar
  26. 26.
    Robertson, S.P., Wharton, C., Ashworth, C., Franzke, M.: Dual device user interface design: PDAs and interactive television. In: Proceedings of CHI 1996, Vancouver, Canada, April 1996Google Scholar
  27. 27.
    Schreiner, M., Rädle, R., Jetter, H., Reiterer, H.: Connichiwa: a framework for cross-device web applications. In: Proceedings of CHI 2015, Seoul, Republic of Korea, April 2015Google Scholar
  28. 28.
    Signer, B., Norrie, M.C.: As we may link: a general metamodel for hypermedia systems. In: Proceedings of ER 2007, Auckland, New Zealand, November 2007Google Scholar
  29. 29.
    Signer, B., Norrie, M.C.: A framework for developing pervasive cross-media applications based on physical hypermedia and active components. In: Proceedings of ICPCA 2008, Alexandria, Egypt, October 2008Google Scholar
  30. 30.
    Signer, B., Norrie, M.C.: Active components as a method for coupling data and services – a database-driven application development process. In: Norrie, M.C., Grossniklaus, M. (eds.) Object Databases. LNCS, vol. 5936, pp. 59–76. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  31. 31.
    Streitz, N.A., Geißler, J., Holmer, T., Konomi, S., Müller-Tomfelde, C., Reischl, W., Rexroth, P., Seitz, P., Steinmetz, R.: i-LAND: an interactive landscape for creativity and innovation. In: Proceedings of the CHI 1999, Pittsburgh, USA, May 1999Google Scholar
  32. 32.
    Yang, J., Wigdor, D.: Panelrama: enabling easy specification of cross-device web applications. In: Proceedings of CHI 2014, Toronto, Canada, April 2014Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Web & Information Systems Engineering LabVrije Universiteit BrusselBrusselsBelgium

Personalised recommendations