A Novel Multi-touch Approach for 3D Object Free Manipulation
In the field of scientific visualization, 3D manipulation is a fundamental task for many different scientific datasets, such as particle data in physics and astronomy, fluid data in aerography, and structured data in medical science. Current researches show that large multi-touch interactive displays serve as a promising device providing numerous significant advantages for displaying and manipulating scientific data. Those benefits of direct-touch devices motivate us to use touch-based interaction techniques to explore scientific 3D data. However, manipulating object in 3D space via 2D touch input devices is challenging for precise control. Therefore, we present a novel multi-touch approach for manipulating structured objects in 3D visualization space, based on multi-touch gestures and an extra axis for the assistance. Our method supports 7-DOF manipulations. Moreover, with the help from the extra axis and depth hints, users can have better control of the interactions. We report on a user study to make comparisons between our method and standard mouse-based 2D interface. We show in this work that touch-based interactive displays can be more effective when applied to complex problems if the interactive visualizations and interactions are designed appropriately.
KeywordsDirect-touch interaction 3D manipulation Multi-touch gesture
We would like to thank Chenling Tang, Minda Chen and all the user study participants for their invaluable input. This work was supported by National Natural Science Foundation of China (Grant No. 61502132, No. 61502130) and Key Laboratory of Complex Systems Modeling and Simulation, Ministry of Education.
- 1.Isenberg, T.: Position paper: touch interaction in scientific visualization. In: Proceedings of the Workshop on Data Exploration on Interactive Surfaces—DEXIS, pp. 24–27 (2011)Google Scholar
- 2.Martinet, A., Casiez, G., Grisoni, L.: The effect of DOF separation in 3D manipulation tasks with multi-touch displays. In: Proceedings of VRST10 ACM Symposium on Virtual Reality Software & Technology, pp. 111–118 (2010)Google Scholar
- 4.Martinet, A., Casiez, G., Grisoni, L.: The design and evaluation of 3D positioning techniques for multi-touch displays. 3D User Interfaces 30, 115–118 (2010)Google Scholar
- 5.Kin, K., Miller, T., Bollensdorff, B., Derose, T., Hartmann, B., Agrawala, M.: Eden: a professional multitouch tool for constructing virtual organic environments. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1343–1352 (2011)Google Scholar
- 7.Keefe, D.F.: Integrating visualization and interaction research to improve scientific workflows. IEEE Comput. Graph. Appl. 30(2), 8–13 (2010)Google Scholar
- 8.Hancock, M.S., Vernier, F.D., Wigdor, D., Carpendale, S.: Rotation and translation mechanisms for tabletop interaction. In: IEEE International Workshop on Horizontal Interactive Human-Computer Systems, Tabletop IEEE, p. 8 (2006)Google Scholar
- 9.Reisman, J.L., Davidson, P.L., Han, J.Y.: A screen-space formulation for 2D and 3D direct manipulation. In: ACM Symposium on User Interface Software and Technology, Victoria, DBLP, pp. 69–78 (2009)Google Scholar
- 10.Hancock, M., Cate, T.T., Carpendale, S.: Sticky tools: full 6DOF force-based interaction for multi-touch tables. In: ACM International Conference on Interactive Tabletops and Surfaces, pp. 133–140 (2009)Google Scholar
- 12.Mendes, D., Ferreira, A.: Evaluation of 3D object manipulation on multi-touch surfaces using unconstrained viewing angles. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011. LNCS, vol. 6949, pp. 523–526. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-23768-3_73 CrossRefGoogle Scholar
- 13.Besançon, L., Issartel, P., Ammi, M., Isenberg, T.: Usability comparison of mouse, touch and tangible inputs for 3D data manipulation (2016)Google Scholar