Skip to main content
SpringerLink
Log in

Providing plasticity and redistribution for 3D user interfaces using the D3PART model

  • Published:
Journal on Multimodal User Interfaces Aims and scope Submit manuscript

Abstract

We propose dynamic 3D plastic and redistributable technology (D3PART), a model to handle redistribution for 3D user interfaces. Redistribution consists in changing the components distribution of an interactive system across different dimensions such as, platform, display and user. Our work is based on previous models for the creation of 3D plastic user interfaces, interactive systems that can handle the context of use modifications while preserving usability. In our previous work, we proposed a task model, a device model and an application component model for the creation of plastic user interfaces that handle the 3D specificities. With D3PART, we extend these models in order to include redistribution capabilities. The final solution lets developers create applications where 3D content and tasks can be automatically redistributed across the different dimensions at runtime. The proposed redistribution process is based on a client-server architecture with a meta-user interface to control the redistribution configuration. In order to illustrate D3PART, we describe three different scenarios of redistribution between a tablet and a CAVE for a 3D application for furniture planning. Indeed, with an implementation of our model, we show how redistribution can be used at runtime to combine these platforms, to switch seamlessly from one platform to another, and lastly, how redistribution can be used to create a collaborative context of use.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. http://www.middlevr.com/middlevr-sdk/.

  2. https://www.unity3d.com/.

References

  1. (1992) A metamodel for the runtime architecture of an interactive system: the UIMS tool developers workshop. SIGCHI Bull 24(1):32–37

  2. Badam SK, Elmqvist N (2014) Polychrome: a cross-device framework for collaborative web visualization. In: Proceedings of the ninth ACM international conference on interactive tabletops and surfaces. ACM, pp 109–118

  3. Bandelloni R, Paternò F (2004) Migratory user interfaces able to adapt to various interaction platforms. International journal of human-computer studies 60(5):621–639

    Article  Google Scholar 

  4. Bharat KA, Cardelli L (1995) Migratory applications. In: Proceedings of the 8th annual ACM symposium on user interface and software technology. ACM, pp 132–142

  5. Bierbaum A, Hartling P, Morillo P, Cruz-Neira C (2005) implementing immersive clustering with VR Juggler. In: ICCSA 2005, Springer, Berlin, pp 1119–1128

  6. Bouville R, Gouranton V, Boggini T, Nouviale F, Arnaldi B (2015) No. five: high-level components for developing collaborative and interactive virtual environments. In: Proceedings of eighth workshop on software engineering and architectures for realtime interactive systems (SEARIS 2015), conjunction with IEEE virtual reality (VR)

  7. Calvary G, Coutaz J, Dâassi O, Balme L, Demeure A (2005) Towards a new generation of widgets for supporting software plasticity: the “comet”. In: Bastide R, Palanque P, Roth J (eds) Engineering human computer interaction and interactive systems: joint working conferences EHCI-DSVIS 2004, Hamburg, 11-13 July 2004, Springer, Berlin, Hamburg, pp 306–324

  8. Calvary G, Coutaz J, Thevenin D, Limbourg Q, Bouillon L, Vanderdonckt J (2003) A unifying reference framework for multi-target user interfaces. Interacting with computers 15(3):289–308

    Article  Google Scholar 

  9. Coffey D, Malbraaten N, Le T, Borazjani I, Sotiropoulos F, Keefe DF (2011) Slice wim: a multi-surface, multi-touch interface for overview + detail exploration of volume datasets in virtual reality. Symposium on interactive 3D graphics and games, I3D ’11ACM, New York, NY, USA, pp 191–198

  10. Coutaz J (1987) PAC, on object oriented model for dialog design. In: Interact’87, 6 pp

  11. Cruz-Neira C, Sandin DJ, DeFanti TA, Kenyon RV, Hart JC (1992) The CAVE: audio visual experience automatic virtual environment. Commun ACM 35(6):64–72

    Article  Google Scholar 

  12. Demeure A, Sottet JS, Calvary G, Coutaz J, Ganneau V, Vanderdonckt J The 4C reference model for distributed user interfaces. In: ICAS 2008, pp 61–69

  13. Elmqvist N (2011) Distributed user interfaces: state of the art. In: Distributed user interfaces: designing interfaces for the distributed ecosystem Springer, London, pp 1–12

  14. Figueroa P, Green M, Hoover HJ (2002) InTml: a description language for VR applications. In: Proceedings of the seventh international conference on 3D web technology, ACM, New York, pp 53–58

  15. Fleury C, Duval T, Gouranton V, Arnaldi B (2010) Architectures and mechanisms to maintain efficiently consistency in collaborative virtual environments. In: SEARIS 2010 IEEE VR 2010 workshop on software engineering and architectures for realtime interactive systems, Waltham

  16. Gonzalez-Calleros J, Vanderdonckt J, Muoz-Arteaga J (2009) A structured approach to support 3d user interface development. In: ACHI 2009, pp 75–81. doi:10.1109/ACHI.2009.14

  17. Hand C (1997) A survey of 3D interaction techniques. Comput Graph Forum 16:269–281

    Article  Google Scholar 

  18. Hutchings HM, Pierce JS (2006) Understanding the whethers, hows, and whys of divisible interfaces. In: Proceedings of the working conference on advanced visual interfaces. ACM, pp 274–277

  19. Klokmose CN, Beaudouin-Lafon M (2009) VIGO: instrumental interaction in multi-surface environments. In: Proceedings of the SIGCHI conference on human factors in computing systems ACM, New York, pp 869–878

  20. Lacoche J, Duval T, Arnaldi B, Maisel E, Royan J (2014) A survey of plasticity in 3D user interfaces. In: 2014 IEEE 7th workshop on software engineering and architectures for realtime interactive systems (SEARIS), pp 19–26

  21. Lacoche J, Duval T, Arnaldi B, Maisel E, Royan J (2015) Plasticity for 3D user interfaces: new models for devices and interaction techniques. In: Proceedings of the 7th ACM SIGCHI symposium on engineering interactive computing systems, 23–26 June 2015, ACM, New York, pp 28–33

  22. Lacoche J, Duval T, Arnaldi B, Maisel E, Royan J (2016) D3PART: a new model for redistribution and plasticity of 3D user interfaces. In: 2016 IEEE symposium on 3D user interfaces (3DUI), IEEE, Greenville, pp 23–26. doi:10.1109/3DUI.2016.7460026

  23. Lindt I (2009) Adaptive 3d-user-interfaces. Ph.D. thesis

  24. Margery D, Arnaldi B, Plouzeau N (1999) A general framework for cooperative manipulation in virtual environments. In: Michael G, Dieter S, Axel H (eds) Virtual environments ’99. Springer, Vienna, pp 169–178

  25. Massó JPM, Vanderdonckt J, López PG, Fernández-Caballero A, Pérez MDL (2007) Rapid prototyping of distributed user interfaces. In: Computer-aided design of user interfaces V. Springer, Dordrecht, pp 151–166

  26. Medeiros D, Carvalho F, Teixeira L, Braz P, Raposo A, Santos I (2013) Proposal and evaluation of a tablet-based tool for 3D virtual environments. SBC 4(2):31

    Google Scholar 

  27. Melchior J, Grolaux D, Vanderdonckt J, Van Roy P A toolkit for peer-to-peer distributed user interfaces: concepts, implementation, and applications. In: EICS 2009. ACM, pp 69–78

  28. Melchior J, Vanderdonckt J, Van Roy P (2011) A model-based approach for distributed user interfaces. In: Proceedings of the 3rd ACM SIGCHI symposium on engineering interactive computing systems. ACM, pp 11–20

  29. Rauterberg M, Fjeld M, Krueger H, Bichsel M, Leonhardt U, Meier M BUILD-IT: a planning tool for construction and design. In: CHI 1998. ACM, pp 177–178

  30. Rekimoto J Pick-and-drop: a direct manipulation technique for multiple computer environments. In UIST 1997. ACM, pp 31–39

  31. Sjölund M, Larsson A, Berglund E (2004) Smartphone views: building multi-device distributed user interfaces. In: International conference on mobile human–computer interaction. Springer, pp 507–511

  32. Stoakley R, Conway MJ, Pausch R Virtual reality on a WIM: interactive worlds in miniature. In: CHI 1995. ACM, pp 265–272

  33. Thevenin D, Coutaz J (1999) Plasticity of user interfaces: framework and research agenda. Proc INTERACT 99:110–117

    Google Scholar 

  34. Yokoyama S, Ishikawa H (2011) Parallel distributed rendering of html5 canvas elements. In: International conference on web engineering. Springer, pp 331–345

  35. Zöllner M, Jetter HC, Reiterer H (2011) ZOIL: a design paradigm and software framework for post-WIMP distributed user interfaces. In: Distributed user interfaces: designing interfaces for the distributed ecosystem, Springer, London, pp 87–94

Download references

Author information

Authors and Affiliations

  1. UMR CNRS 6074 Irisa - Inria Rennes, IRT b<>com, Cesson-Sévigné, France

    Jérémy Lacoche

  2. UMR CNRS 6285 Lab-STIC, IMT atlantique, Brest, France

    Thierry Duval

  3. UMR CNRS 6285 Lab-STIC, Telecom Bretagne, IRT b<>com, Cesson-Sévigné, France

    Thierry Duval

  4. UMR CNRS 6074 Irisa - Inria Rennes, INSA de Rennes, Rennes, France

    Bruno Arnaldi

  5. UMR CNRS 6074 Irisa - Inria Rennes, INSA de Rennes, IRT b<>com, Cesson-Sévigné, France

    Bruno Arnaldi

  6. UMR CNRS 6285 Lab-STIC, ENIB, Brest, France

    Eric Maisel

  7. UMR CNRS 6285 Lab-STIC, ENIB, IRT b<>com, Cesson-Sévigné, France

    Eric Maisel

  8. IRT b<>com, Cesson-Sévigné, France

    Jérôme Royan

Authors
  1. Jérémy Lacoche
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thierry Duval
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bruno Arnaldi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Eric Maisel
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jérôme Royan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jérémy Lacoche.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 35578 KB)

Supplementary material 2 (pdf 5812 KB)

Supplementary material 3 (pdf 1855 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lacoche, J., Duval, T., Arnaldi, B. et al. Providing plasticity and redistribution for 3D user interfaces using the D3PART model. J Multimodal User Interfaces 11, 197–210 (2017). https://doi.org/10.1007/s12193-017-0239-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12193-017-0239-x

Keywords

Search

Navigation