AiRSculpt: A Wearable Augmented Reality 3D Sculpting System

  • Sung-A Jang
  • Hyung-il Kim
  • Woontack Woo
  • Graham Wakefield
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8530)


In this paper, we present a new kind of wearable augmented reality (AR) 3D sculpting system called AiRSculpt in which users could directly translate their fluid finger movements in air into expressive sculptural forms and use hand gestures to navigate the interface. In AiRSculpt, as opposed to VR-based systems, users could quickly create and manipulate 3D virtual content directly with their bare hands in a real-world setting, and use both hands simultaneously in tandem or as separate tools to sculpt and manipulate their virtual creations. Our system uses a head-mounted display and a RGB-D head-mounted camera to detect the 3D location of hands and fingertips then render virtual content in calibration with real-world coordinates.


Augmented reality virtual sculpting direct 3D manipulation embodied interaction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Marshall, M.: Virtual Sculpture Gesture Controlled System for Artistic Expression. In: ConGAS Symposium on Gesture Interfaces for Multimedia Systems, AISB 2004, Leeds, UK (2004)Google Scholar
  2. 2.
    Cutler, L.D., Fröhlich, B., Hanrahan, P.: Two-handed direct manipulation on the responsive workbench. In: Proceedings of the 1997 Symposium on Interactive 3D Graphics, pp. 107–114. ACM (1997)Google Scholar
  3. 3.
    Kim, H., Albuquerque, G., Havemann, S., Fellner, D.W.: Tangible 3D: Hand Gesture Interaction for Immersive 3D Modeling. In: IPT/EGVE, pp. 191–199 (2005)Google Scholar
  4. 4.
    Segen, J., Kumar, S.: Gesture VR: Vision-based 3D hand interface for spatial interaction. In: Proceedings of the Sixth ACM International Conference on Multimedia, pp. 455–464. ACM (1998)Google Scholar
  5. 5.
    Abe, K., Saito, H., Ozawa, S.: 3-D drawing system via hand motion recognition from two cameras. In: 2000 IEEE International Conference on Systems, Man, and Cybernetics, vol. 2, pp. 840–845 (2000)Google Scholar
  6. 6.
    Kolaric, S., Raposo, A., Gattass, M.: Direct 3D manipulation using vision-based recognition of uninstrumented hands. In: X Symposium on Virtual and Augmented Reality, pp. 212–220 (2008)Google Scholar
  7. 7.
    Sachs, E., Roberts, A., Stoops, D.: 3-draw: A tool for designing 3d shapes. IEEE Computer Graphics and Applications 11(6), 18–26 (1991)CrossRefGoogle Scholar
  8. 8.
    Deering, M.F.: Holosketch: A virtual reality sketching/animation tool. ACM Transactions on Computer-Human Interaction 2(3), 220–238 (1995)CrossRefGoogle Scholar
  9. 9.
    Schkolne, S., Pruett, M., Schröder, P.: Surface drawing: Creating organic 3D shapes with the hand and tangible tools. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 261–268. ACM (2001)Google Scholar
  10. 10.
    Mäkelä, W.: Working 3D meshes and particles with finger tips: Towards an immersive artists’ interface. In: IEEE Virtual Reality Conference on New Directions in 3D User Interfaces Workshop, pp. 77–80 (2005)Google Scholar
  11. 11.
    Keefe, D.F., Feliz, D.A., Moscovich, T., Laidlaw, D.H., LaViola Jr, J.J.: CavePainting: A fully immersive 3D artistic medium and interactive experience. In: Proceedings of the 2001 Symposium on Interactive 3D Graphics, pp. 85–93. ACM (2001)Google Scholar
  12. 12.
    Galyean, T.A., Hughes, J.F.: Sculpting: An interactive volumetric modeling technique. ACM SIGGRAPH Computer Graphics 25(4), 267–274 (1991)CrossRefGoogle Scholar
  13. 13.
    Butterworth, J., Davidson, A., Hench, S., Olano, M.T.: 3DM: A three dimensional modeler using a head-mounted display. In: Proceedings of the 1992 Symposium on Interactive 3D Graphics, pp. 135–138. ACM (1992)Google Scholar
  14. 14.
    Yoshida, M., Tijerino, Y., Miyasato, T., Kishino, F.: An interface system based on hand gestures and verbal expressions that generates shapes for 3D virtual objects. In: Tech. Report of IEICE, MVE95-64, pp. 33–40 (1996)Google Scholar
  15. 15.
    Nishino, H., Utsumiya, K., Korida, K.: 3D object modeling using spatial and pictographic gestures. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pp. 51–58. ACM (1998)Google Scholar
  16. 16.
    Wang, S.W., Kaufman, A.E.: Volume sculpting. In: Proceedings of the 1995 Symposium on Interactive 3D Graphics, p. 151–156. ACM (1995)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Sung-A Jang
    • 1
  • Hyung-il Kim
    • 1
  • Woontack Woo
    • 1
  • Graham Wakefield
    • 1
  1. 1.Graduate School of Culture TechnologyKAISTRepublic of Korea

Personalised recommendations