Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Tangible user interfaces for physically-based deformation: design principles and first prototype

  • 296 Accesses

  • 2 Citations

Abstract

We present design principles for conceiving tangible user interfaces for the interactive physically-based deformation of 3D models. Based on these design principles, we developed a first prototype using a passive tangible user interface that embodies the 3D model. By associating an arbitrary reference material with the user interface, we convert the displacements of the user interface into forces required by physically-based deformation models. These forces are then applied to the 3D model made out of any material via a physical deformation model. In this way, we compensate for the absence of direct haptic feedback, which allows us to use a force-driven physically-based deformation model. A user study on simple deformations of various metal beams shows that our prototype is usable for deformation with the user interface embodying the virtual beam. Our first results validate our design principles, plus they have a high educational value for mechanical engineering lectures.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3

Notes

  1. 1.

    www.measurand.com.

References

  1. 1.

    Balakrishnan, R., Hinckley, K.: The role of kinesthetic reference frames in two-handed input performance. In: UIST’99: Proceedings of the 12th Annual ACM Symposium on User Interface Software and Technology, pp. 171–178. ACM, New York (1999)

  2. 2.

    Bian, J., Chen, J., Sun, M.: Simulation of soft tissue deformation in virtual surgery based on physics engine. In: International Conference on Multimedia Information Networking and Security, pp. 60–64 (2011)

  3. 3.

    Blanco, F., Oliveira, M.M.: Instant mesh deformation. In: Proceedings of the 2008 Symposium on Interactive 3D Graphics and Games, I3D’08, pp. 71–78. ACM, New York (2008)

  4. 4.

    Blanding, R., Turkiyyah, G.: ECAD—A prototype screen-based VR solid modeling environment incorporating tangible deformable models. Comput-Aided Des. Appl. 4(5), 595–605 (2007)

  5. 5.

    Fishkin, K.P.: A taxonomy for and analysis of tangible interfaces. Pers. Ubiquitous Comput. 8, 347–358 (2004)

  6. 6.

    Fröhlich, S., Botsch, M.: Example-driven deformations based on discrete shells. Comput. Graph. Forum 30(8), 2246–2257 (2011)

  7. 7.

    Huang, H., Zhao, L., Yin, K., Qi, Y., Yu, Y., Tong, X.: Controllable hand deformation from sparse examples with rich details. In: Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA’11, pp. 73–82. ACM, New York (2011)

  8. 8.

    Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI’97, pp. 234–241. ACM, New York (1997)

  9. 9.

    Koleva, B., Benford, S., Hui Ng, K., Rodden, T.: A framework for tangible user interfaces. In: Workshop Proc. on Real World User Interfaces, pp. 257–264 (2003)

  10. 10.

    Jackie Lee, C.-H., Hu, Y., Selker, T.: iSphere: a free-hand 3D modeling interface. Int. J. Arch. Comput. 4(1), 19–31 (2006)

  11. 11.

    Llamas, I., Powell, A., Rossignac, J., Bender, C.D.S.: A virtual ribbon for deforming 3D shapes in biomedical and styling applications. In: ACM Symposium on Solid and Physical Modeling (SPM), pp. 89–99 (2005)

  12. 12.

    Martin, S., Kaufmann, P., Botsch, M., Grinspun, E., Gross, M.: Unified simulation of elastic rods, shells, and solids. In: Proceedings of ACM SIGGRAPH 2010 (2010)

  13. 13.

    Peterlík, I., Sedef, M., Basdogan, C., Matyska, L.: Technical section: real-time visio-haptic interaction with static soft tissue models having geometric and material nonlinearity. Comput. Graph. 34, 43–54 (2010)

  14. 14.

    Prados, F., Salas, A., Torres, J.: Haptic interaction with elastic volumetric structures. Int. J. Creative Interfaces Comput. Graph. 3, 63–76 (2012)

  15. 15.

    Scherer, K.R.: What are emotions? And how can they be measure? Soc. Sci. Inform. 44, 695–729 (2005)

  16. 16.

    Sugiura, Y., Kakehi, G., Withana, A., Lee, C., Sakamoto, D., Sugimoto, M., Inami, M., Igarashi, T.: Detecting shape deformation of soft objects using directional photoreflectivity measurement. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST’11, pp. 509–516. ACM, New York (2011)

  17. 17.

    Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. IBM Syst. J. 39(3–4), 915–931 (2000)

  18. 18.

    Young, W., Budynas, R.: Roark’s Formulas for Stress and Strain. McGraw-Hill’s International Editions. McGraw-Hill, New York (2002)

  19. 19.

    Zhao, J.B.Y.: Real-time large-deformation substructuring. ACM Trans. Graph. 30(4), 91:1–91:7 (2011)

  20. 20.

    Zhou, K., Huang, J., Snyder, J., Liu, X., Bao, H., Guo, B., Shum, H.-Y.: Large mesh deformation using the volumetric graph laplacian. In: ACM SIGGRAPH 2005 Papers, SIGGRAPH’05, pp. 496–503. ACM, New York (2005)

Download references

Acknowledgements

This work was supported by the ANR SeARCH project, Grant ANR-09-CORD-019 of the French National Research Agency (Agence Nationale de la Recherche). The authors would like to thank Térence Brochu for his support in the user study analysis.

Author information

Correspondence to Nawel Takouachet.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Takouachet, N., Couture, N., Reuter, P. et al. Tangible user interfaces for physically-based deformation: design principles and first prototype. Vis Comput 28, 799–808 (2012). https://doi.org/10.1007/s00371-012-0695-y

Download citation

Keywords

  • Tangible interface
  • Two-handed interaction
  • Physically-based deformation
  • ShapeTape