Phys-Sketch: Sketching 3D Dynamic Objects in Immersive Virtual Reality

  • Jose Abel TiconaEmail author
  • Steeven Villa
  • Rafael Torchelsen
  • Anderson Maciel
  • Luciana Nedel
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11542)


Sketching was traditionally a 2D task. Even when the new generation of VR devices allowed to sketch in 3D, the drawn models remained essentially static representations. In this paper, we introduce a new physics-inspired sketching technique built on the top of Position-based Dynamics to enrich the 3D drawings with dynamic behaviors. A particle-based method allows interacting in real time with a wide range of materials including fluids, rigid bodies, soft bodies and clothes. Users can interact with the dynamic sketches and sculpt them while they move, deform and fall. We analyze the expressiveness of the system from the regard of two experienced artists. Thus, this paper also gives a starting point to move towards an improved generation of physics-enabled sketching applications.


3D sketching Real-time physics-based simulation Human-computer interaction Immersive-environments 


  1. 1.
    Gravity Sketch - Bringing Virtual Reality Into Your Design Workflow.
  2. 2.
    Quill VR illustration and animation tool built to empower artists and creators.
  3. 3.
    Tilt Brush by Google.
  4. 4.
    Barrera Machuca, M.D., Asente, P., Lu, J., Kim, B., Stuerzlinger, W.: Multiplanes: assisted freehand VR drawing. In: Adjunct Publication of the Annual ACM Symposium on User Interface Software and Technology (UIST 2017 Adjunct), pp. 1–3 (2017). Scholar
  5. 5.
    Eroglu, S., Gebhardt, S., Schmitz, P., Hausch, D., Kuhlen, T.W.: Fluid sketching immersive sketching based on fluid flow. In: 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 475–482. IEEE (2018)Google Scholar
  6. 6.
    Kim, Y., Kim, B., Kim, J., Kim, Y.J.: CanvoX: High-resolution VR Painting in Large Volumetric Canvas (2017)Google Scholar
  7. 7.
    Lorensen, W.E., Cline, H.E.: Marching cubes: a high resolution 3D surface construction algorithm. In: ACM Siggraph Computer Graphics, vol. 21, pp. 163–169. ACM (1987)Google Scholar
  8. 8.
    Macklin, M., Müller, M.: Position based fluids. ACM Trans. Graph. 32(4), 1 (2013). Scholar
  9. 9.
    Macklin, M., Müller, M., Chentanez, N., Kim, T.Y.: Unified particle physics for real-time applications. ACM Trans. Graph. 33(4), 1–12 (2014). Scholar
  10. 10.
    Muller, M., Heidelberger, B., Hennix, M., Ratcliff, J.: Position based dynamics. J. Vis. Commun. Image Representation 18(2), 109–118 (2007). Scholar
  11. 11.
    Müller, M., Heidelberger, B., Teschner, M., Gross, M.: Meshless deformations based on shape matching. In: ACM Transactions on Graphics (TOG), vol. 24, pp. 471–478. ACM (2005)Google Scholar
  12. 12.
    Ren, B., Yan, X., Yang, T., Li, C.F., Lin, M.C., Hu, S.M.: Fast SPH simulation for gaseous fluids. Vis. Comput. 32(4), 523–534 (2016). Scholar
  13. 13.
    Salazar, S.V., Ticona, J.A., Torchelsen, R., Nedel, L., Maciel, A.: Heat-based bidirectional phase shifting simulation using position-based dynamics. Comput. Graph. 76, 107–116 (2018). Scholar
  14. 14.
    Sebastian, A., Sami, S.: GPU-based clay simulation and ray-tracing tech in Claybook.,
  15. 15.
    Seo, J.H., Bruner, M., Ayres, N.: Aura garden: collective and collaborative aesthetics of light sculpting in virtual reality. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems, pp. Art 12:1–Art12:6 (2018).
  16. 16.
    Yu, J., Turk, G.: Reconstructing surfaces of particle-based fluids using anisotropic kernels. ACM Trans. Graph. (TOG) 32(1), 5 (2013)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Institute of InformaticsFederal University of Rio Grande do Sul (UFRGS)Porto AlegreBrazil
  2. 2.Universidade Federal de Pelotas (UFPel)PelotasBrazil

Personalised recommendations