Advertisement

Journal on Multimodal User Interfaces

, Volume 11, Issue 2, pp 197–210 | Cite as

Providing plasticity and redistribution for 3D user interfaces using the D3PART model

  • Jérémy LacocheEmail author
  • Thierry Duval
  • Bruno Arnaldi
  • Eric Maisel
  • Jérôme Royan
Article

Abstract

We propose dynamic 3D plastic and redistributable technology (D3PART), a model to handle redistribution for 3D user interfaces. Redistribution consists in changing the components distribution of an interactive system across different dimensions such as, platform, display and user. Our work is based on previous models for the creation of 3D plastic user interfaces, interactive systems that can handle the context of use modifications while preserving usability. In our previous work, we proposed a task model, a device model and an application component model for the creation of plastic user interfaces that handle the 3D specificities. With D3PART, we extend these models in order to include redistribution capabilities. The final solution lets developers create applications where 3D content and tasks can be automatically redistributed across the different dimensions at runtime. The proposed redistribution process is based on a client-server architecture with a meta-user interface to control the redistribution configuration. In order to illustrate D3PART, we describe three different scenarios of redistribution between a tablet and a CAVE for a 3D application for furniture planning. Indeed, with an implementation of our model, we show how redistribution can be used at runtime to combine these platforms, to switch seamlessly from one platform to another, and lastly, how redistribution can be used to create a collaborative context of use.

Keywords

Plasticity Redistribution 3D user interfaces Virtual reality 

Supplementary material

Supplementary material 1 (mp4 35578 KB)

12193_2017_239_MOESM2_ESM.pdf (5.7 mb)
Supplementary material 2 (pdf 5812 KB)
12193_2017_239_MOESM3_ESM.pdf (1.8 mb)
Supplementary material 3 (pdf 1855 KB)

References

  1. 1.
    (1992) A metamodel for the runtime architecture of an interactive system: the UIMS tool developers workshop. SIGCHI Bull 24(1):32–37Google Scholar
  2. 2.
    Badam SK, Elmqvist N (2014) Polychrome: a cross-device framework for collaborative web visualization. In: Proceedings of the ninth ACM international conference on interactive tabletops and surfaces. ACM, pp 109–118Google Scholar
  3. 3.
    Bandelloni R, Paternò F (2004) Migratory user interfaces able to adapt to various interaction platforms. International journal of human-computer studies 60(5):621–639CrossRefGoogle Scholar
  4. 4.
    Bharat KA, Cardelli L (1995) Migratory applications. In: Proceedings of the 8th annual ACM symposium on user interface and software technology. ACM, pp 132–142Google Scholar
  5. 5.
    Bierbaum A, Hartling P, Morillo P, Cruz-Neira C (2005) implementing immersive clustering with VR Juggler. In: ICCSA 2005, Springer, Berlin, pp 1119–1128Google Scholar
  6. 6.
    Bouville R, Gouranton V, Boggini T, Nouviale F, Arnaldi B (2015) No. five: high-level components for developing collaborative and interactive virtual environments. In: Proceedings of eighth workshop on software engineering and architectures for realtime interactive systems (SEARIS 2015), conjunction with IEEE virtual reality (VR)Google Scholar
  7. 7.
    Calvary G, Coutaz J, Dâassi O, Balme L, Demeure A (2005) Towards a new generation of widgets for supporting software plasticity: the “comet”. In: Bastide R, Palanque P, Roth J (eds) Engineering human computer interaction and interactive systems: joint working conferences EHCI-DSVIS 2004, Hamburg, 11-13 July 2004, Springer, Berlin, Hamburg, pp 306–324Google Scholar
  8. 8.
    Calvary G, Coutaz J, Thevenin D, Limbourg Q, Bouillon L, Vanderdonckt J (2003) A unifying reference framework for multi-target user interfaces. Interacting with computers 15(3):289–308CrossRefGoogle Scholar
  9. 9.
    Coffey D, Malbraaten N, Le T, Borazjani I, Sotiropoulos F, Keefe DF (2011) Slice wim: a multi-surface, multi-touch interface for overview + detail exploration of volume datasets in virtual reality. Symposium on interactive 3D graphics and games, I3D ’11ACM, New York, NY, USA, pp 191–198Google Scholar
  10. 10.
    Coutaz J (1987) PAC, on object oriented model for dialog design. In: Interact’87, 6 ppGoogle Scholar
  11. 11.
    Cruz-Neira C, Sandin DJ, DeFanti TA, Kenyon RV, Hart JC (1992) The CAVE: audio visual experience automatic virtual environment. Commun ACM 35(6):64–72CrossRefGoogle Scholar
  12. 12.
    Demeure A, Sottet JS, Calvary G, Coutaz J, Ganneau V, Vanderdonckt J The 4C reference model for distributed user interfaces. In: ICAS 2008, pp 61–69Google Scholar
  13. 13.
    Elmqvist N (2011) Distributed user interfaces: state of the art. In: Distributed user interfaces: designing interfaces for the distributed ecosystem Springer, London, pp 1–12Google Scholar
  14. 14.
    Figueroa P, Green M, Hoover HJ (2002) InTml: a description language for VR applications. In: Proceedings of the seventh international conference on 3D web technology, ACM, New York, pp 53–58Google Scholar
  15. 15.
    Fleury C, Duval T, Gouranton V, Arnaldi B (2010) Architectures and mechanisms to maintain efficiently consistency in collaborative virtual environments. In: SEARIS 2010 IEEE VR 2010 workshop on software engineering and architectures for realtime interactive systems, WalthamGoogle Scholar
  16. 16.
    Gonzalez-Calleros J, Vanderdonckt J, Muoz-Arteaga J (2009) A structured approach to support 3d user interface development. In: ACHI 2009, pp 75–81. doi: 10.1109/ACHI.2009.14
  17. 17.
    Hand C (1997) A survey of 3D interaction techniques. Comput Graph Forum 16:269–281CrossRefGoogle Scholar
  18. 18.
    Hutchings HM, Pierce JS (2006) Understanding the whethers, hows, and whys of divisible interfaces. In: Proceedings of the working conference on advanced visual interfaces. ACM, pp 274–277Google Scholar
  19. 19.
    Klokmose CN, Beaudouin-Lafon M (2009) VIGO: instrumental interaction in multi-surface environments. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, New York, pp 869–878Google Scholar
  20. 20.
    Lacoche J, Duval T, Arnaldi B, Maisel E, Royan J (2014) A survey of plasticity in 3D user interfaces. In: 2014 IEEE 7th workshop on software engineering and architectures for realtime interactive systems (SEARIS), pp 19–26Google Scholar
  21. 21.
    Lacoche J, Duval T, Arnaldi B, Maisel E, Royan J (2015) Plasticity for 3D user interfaces: new models for devices and interaction techniques. In: Proceedings of the 7th ACM SIGCHI symposium on engineering interactive computing systems, 23–26 June 2015, ACM, New York, pp 28–33Google Scholar
  22. 22.
    Lacoche J, Duval T, Arnaldi B, Maisel E, Royan J (2016) D3PART: a new model for redistribution and plasticity of 3D user interfaces. In: 2016 IEEE symposium on 3D user interfaces (3DUI), IEEE, Greenville, pp 23–26. doi: 10.1109/3DUI.2016.7460026
  23. 23.
    Lindt I (2009) Adaptive 3d-user-interfaces. Ph.D. thesisGoogle Scholar
  24. 24.
    Margery D, Arnaldi B, Plouzeau N (1999) A general framework for cooperative manipulation in virtual environments. In: Michael G, Dieter S, Axel H (eds) Virtual environments ’99. Springer, Vienna, pp 169–178Google Scholar
  25. 25.
    Massó JPM, Vanderdonckt J, López PG, Fernández-Caballero A, Pérez MDL (2007) Rapid prototyping of distributed user interfaces. In: Computer-aided design of user interfaces V. Springer, Dordrecht, pp 151–166Google Scholar
  26. 26.
    Medeiros D, Carvalho F, Teixeira L, Braz P, Raposo A, Santos I (2013) Proposal and evaluation of a tablet-based tool for 3D virtual environments. SBC 4(2):31Google Scholar
  27. 27.
    Melchior J, Grolaux D, Vanderdonckt J, Van Roy P A toolkit for peer-to-peer distributed user interfaces: concepts, implementation, and applications. In: EICS 2009. ACM, pp 69–78Google Scholar
  28. 28.
    Melchior J, Vanderdonckt J, Van Roy P (2011) A model-based approach for distributed user interfaces. In: Proceedings of the 3rd ACM SIGCHI symposium on engineering interactive computing systems. ACM, pp 11–20Google Scholar
  29. 29.
    Rauterberg M, Fjeld M, Krueger H, Bichsel M, Leonhardt U, Meier M BUILD-IT: a planning tool for construction and design. In: CHI 1998. ACM, pp 177–178Google Scholar
  30. 30.
    Rekimoto J Pick-and-drop: a direct manipulation technique for multiple computer environments. In UIST 1997. ACM, pp 31–39Google Scholar
  31. 31.
    Sjölund M, Larsson A, Berglund E (2004) Smartphone views: building multi-device distributed user interfaces. In: International conference on mobile human–computer interaction. Springer, pp 507–511Google Scholar
  32. 32.
    Stoakley R, Conway MJ, Pausch R Virtual reality on a WIM: interactive worlds in miniature. In: CHI 1995. ACM, pp 265–272Google Scholar
  33. 33.
    Thevenin D, Coutaz J (1999) Plasticity of user interfaces: framework and research agenda. Proc INTERACT 99:110–117Google Scholar
  34. 34.
    Yokoyama S, Ishikawa H (2011) Parallel distributed rendering of html5 canvas elements. In: International conference on web engineering. Springer, pp 331–345Google Scholar
  35. 35.
    Zöllner M, Jetter HC, Reiterer H (2011) ZOIL: a design paradigm and software framework for post-WIMP distributed user interfaces. In: Distributed user interfaces: designing interfaces for the distributed ecosystem, Springer, London, pp 87–94Google Scholar

Copyright information

© SIP 2017

Authors and Affiliations

  1. 1.UMR CNRS 6074 Irisa - Inria RennesIRT b<>comCesson-SévignéFrance
  2. 2.UMR CNRS 6285 Lab-STICIMT atlantiqueBrestFrance
  3. 3.UMR CNRS 6285 Lab-STIC, Telecom BretagneIRT b<>comCesson-SévignéFrance
  4. 4.UMR CNRS 6074 Irisa - Inria RennesINSA de RennesRennesFrance
  5. 5.UMR CNRS 6074 Irisa - Inria Rennes, INSA de RennesIRT b<>comCesson-SévignéFrance
  6. 6.UMR CNRS 6285 Lab-STICENIBBrestFrance
  7. 7.UMR CNRS 6285 Lab-STIC, ENIBIRT b<>comCesson-SévignéFrance
  8. 8.IRT b<>comCesson-SévignéFrance

Personalised recommendations