Human-assisted virtual reality for a magnetic-haptic micromanipulation platform
- 309 Downloads
This paper deals with the development of a virtual reality interface (VRI) for a magnetic-haptic micromanipulation platform (MHMP) (Mehrtash et al. in IEEE/ASME Trans Mechatron 16(3):459–469, 2011). Our previously developed MHMP has shown a great deal of promise in non-contact micromanipulations. This micromanipulation platform concerns the integration of magnetic actuation technology and a bilateral macro–micro teleoperation. The MHMP has two separate stations: one magnetic microrobotic station and one haptic. The magnetic microrobotic station manipulates micro-sized objects based on the commands from the haptic station. The haptic station uses bilateral communication with the magnetic microrobotic station to allow a human operator the feeling of a micro-domain environment. In this paper, we report a VRI that enables human operators to improve their skills in using the MHMP, before carrying out an actual dexterous task. The VRI is made up of three main components: a haptic station, a simulation engine, and a display unit. The haptic station provides the operator with the force/torque information from virtual or remote environments, and is also used to recognize the operator’s hand motion command. Dynamical computation and control system modeling have been carried out on the simulation engine. Based on the real-time computation, this engine, as the heart of the system, provides force applied to the operator’s hand and the microrobot’s position for the haptic station and the display unit, respectively. The display unit employs 3D computer graphics to demonstrate the micromanipulation tasks and environments. The VRI is also developed in such a way that it can be separately used in parallel with the MHMP for the 3D visualization of a real task by providing multiple virtual viewports. This paper introduces the configuration of the proposed VRI, and reports the result of a preliminary experiment using micromanipulation investigation for validation.
KeywordsPermanent Magnet External Magnetic Field Magnetic Force Haptic Device Simulation Engine
The authors gratefully acknowledge the Canada Foundation for Innovation (CFI) and the Natural Science and Engineering Research Council of Canada (NSERC) for financial support.
- Ammi M, Ferreira A (2004) Path planning of an AFM-based nanomanipulator using virtual force reflection. In: Proceedings of the international conference on intelligent robots and systems, 2004 (IROS 2004). 2004 IEEE/RSJ, vol 1, pp 577–582Google Scholar
- CPOL (2009) Solving ordinary differential equations in C++. http://www.codeproject.com/KB/recipes/odeint.aspx
- Earnshaw S (1842) On the nature of the molecular forces which regulate the constitution of the luminiferous ether. Trans Camb Philos Soc 7:97–112Google Scholar
- Hamdi M, Ferreira A (2004) Microassembly planning using physical-based models in virtual environment. In: Proceedings of the international conference on intelligent robots and systems, 2004 (IROS 2004). 2004 IEEE/RSJ, vol 4, pp 3369–3374Google Scholar
- Mehrtash M, Shameli E, Khamesee MB (2010) Magnetic telemanipulation device with mass uncertainty: Modeling, simulation and testing. Int J Appl Electromagn Mech 34(4):211–223Google Scholar
- Probst M, Hurzeler C, Borer R, Nelson B (2007) Virtual reality for microassembly. In: Society of photo-optical instrumentation engineers (SPIE) conference series, vol 6718Google Scholar
- Stratton JA (2007) Electromagnetic theory. Wiley, HobokenGoogle Scholar
- Wernecke J (1994) The inventor mentor: programming object-oriented 3D graphics with open inventor, release 2. Addison-Wesley, BostonGoogle Scholar
- Zhou Q, Kallio P, Koivo HN (2000) Virtual environment for operations in the microworld. In: Nelson BJ, Brequet J-M (eds) Microrobotics and microassembly II, SPIE, USA, pp 56–64Google Scholar