A high-performance haptic rendering system for virtual reality molecular modeling
- 32 Downloads
To provide a virtual reality 3D user interface with comprehensive molecular modeling, we have developed a novel haptic rendering system with a fingertip haptic rendering device and a hand-tracking Leap Motion controller.
The system handles virtual molecular objects with real hands motion captured by the Leap Motion controller in a virtual reality environment. The fingertip haptic rendering device attached on each finger and a wrist gives haptic display, when virtual hands manipulating virtual molecular objects.
Based on preliminary software development studies using existing 3D graphics toolkit such as CHAI3D and Unity, the fingertip haptic rendering device works with a reasonable performance for a polygon surface model and a ribbon model, but not for an atomic model due to the low rendering performance. On the other hand, the device provides us a grasping feeling of a large molecule represented by an atomic model, when used with the particle simulation system running on graphics library, DirectX 12. The haptic rendering performances, among the three software systems are discussed.
KeywordsHaptic rendering Hand tracking Molecular modeling
This study is based on results obtained from an Artificial Molecular Muscle project commissioned by the New Energy and Industrial Technology Development Organization (NEDO) Japan. The authors would like to thank the Indonesia Endowment Fund for Education (LPDP) for supporting the author with a scholarship.
- 6.Daunay B, Micaelli A, Force A, Regnier S (2007) 6 DOF haptic feedback for molecular docking using wave variables. In: Robotics and Automation 2007 IEEE International Conference 840–845. https://doi.org/10.1109/ROBOT.2007.363090
- 7.Hou X, Sourina O (2011) Six degree-of-freedom haptic rendering for biomolecular docking. In: Gavrilova ML, Tan CJK, Sourin A, Sourina O (eds) Transactions on computational science XII. Lecture notes in computer science, vol 6670. Springer, Berlin, pp 98–117. https://doi.org/10.1007/978-3-642-22336-5_6 CrossRefGoogle Scholar
- 8.Choi I, Culbertson H, Miller MR, et al (2017) Grabity: a wearable haptic interface for simulating weight and grasping in virtual reality. In: Proceedings of the 30th Annual ACM Symposium User Interface Software Technology—UIST’17 119–130. https://doi.org/10.1145/3126594.3126599
- 9.Go Touch VR (2018) Touch the virtual reality with VR touch. https://www.gotouchvr.com/. Accessed 4 Sep 2018
- 10.Pramudwiatmoko A, Tsutoh S, Gutmann G et al (2019) Haptic rendering applied to hand tracking 3D user interface for a molecular modeling environment. 24th International symposium on artificial life and robotics. International Society of Artificial Life and Robotics, Beppu, pp 109–114Google Scholar
- 14.Gutmann G, Inoue D, Kakugo A, Konagaya A (2016) Using a master and slave approach for GPGPU computing to achieve optimal scaling in a 3D real-time simulation. In: 2016 IEEE 11th Annual International Conference on Nano/Micro Engineered Molecular Systems NEMS 2016 6:95–100. https://doi.org/10.1109/NEMS.2016.7758208