Abstract
In the past few years, studying in the field of Augmented Reality (AR) has been expanded from technical aspect such as tracking system, authoring tools and etc. to applications ranging from the fields of education, entertainment, medicine to manufacturing. In manufacturing, which relies on assembly process, AR is used for assisting staffs in the field of maintenance and assembly. Usually, it has been used as a guidance system, for example using graphical instructions for advising the users with the steps in performing the maintenance or assembly operation. In assembly training, especially for small, expensive or harmful devices, interactive technique using real hands may be suitable than the guiding technique. Using tracking algorithm to track both hands in real time, interaction can occurs by the execution of grasp and release gestures. Bare hand tracking technique, which uses gesture recognition to enable interaction with augmented objects are also possible. In this paper, we attempted to use marker based AR technique to assemble 3D virtual objects using natural hand interaction. By applying the markers to fit on fingertip and assigned the corresponding virtual 3D finger that have physical properties such as surface, volume, density, friction and collision detection properties to them, interaction between fingers and objects could be executed. This setup was designed on a PC based system but could be ported to iOS or Android, so that it would work on tablet or mobile phones as well. Unity 3D game engine was used with Vuforia AR platform. In order to grab and move the virtual object by hand, the shape of the virtual finger (Vulforia’s target) has been investigated. Appropriate friction coefficient were applied to both virtual fingers and the object and then at least two virtual fingers were force to press on the 3D virtual object in opposite directions so that frictional force is more than gravitational force. To test this method, virtual model of LEGO’s mini-figures which composed of five pieces, was used and the assembly could be done in just a short time. Comparing with other popular technique such as “gestures recognition”, we have found that our technique could provide more efficient result in term of cost and natural feeling.
Chapter PDF
Similar content being viewed by others
References
Pathomaree, N., Charoenseang, S.: Augmented Reality for Skill Transfer in Assembly Task. In: The 14th IEEE International Workshop on Robot and Human Interactive Communication (RO-MAN), Nashville, Tennessee, USA, August 13-15 (2005)
Wang, Z.B., Shen, Y., Ong, S.K., Nee, A.Y.C.: Assembly Design and Evaluation based on Bare-Hand Interaction in an Augmented Reality Environment. In: International Conference on Cyber Worlds, pp. 21–28 (2009)
Woll, R., Damerau, T., Wrasse, K., Stark, R.: Augmented reality in a serious game for manual assembly processes. In: 2011 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities (ISMAR-AMH), pp. 37–39 (2011)
Tang, A., Owen, C., Biocca, F., Mou, W.: Experimental Evaluation of Augmented Reality in Object Assembly Task. In: Proceedings of the International Symposium on Mixed and Augmented Reality, ISMAR 2002 (2002)
Imbert, N., Vignat, F., Kaewrat, C., Boonbrahm, P.: Adding Physical Properties to 3D Models in Augmented Reality for Realistic Interactions Experiments. Procedia Computer Science 25, 364–369 (2013)
Lee, M., Green, R., Billinghurst, M.: 3D natural hand interaction for AR applications. In: 23rd International Conference on Image and Vision Computing (IVCNZ 2008), New Zealand, vol. 1(6), pp. 26–28 (November 2008)
Wang, Z., Shen, Y., Ong, S.K., Nee, A.Y.-C.: Assembly Design and Evaluation Based on Bare-Hand Interaction in an Augmented Reality Environment. In: International Conference on CyberWorlds (CW 2009), vol. 21(28), pp. 7–11 (2009)
Li, Y., Shen, X.: A Real-time Collision Detection between Virtual and Real Objects Based on Three-dimensional Tracking of Hand. In: 2010 International Conference on Audio Language and Image Processing, ICALIP 2010, pp. 1346–1351 (2010)
Choi, J., Park, H., Park, J., Park, J.-I.: Bare-Hand-Based Augmented Reality Interface on Mobile Phone. In: IEEE International Symposium on Mixed and Augmented Reality 2011, Science and Technology Proceedings, Basel, Switzerland, October 26-29, pp. 275–276 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Boonbrahm, P., Kaewrat, C. (2014). Assembly of the Virtual Model with Real Hands Using Augmented Reality Technology. In: Shumaker, R., Lackey, S. (eds) Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. https://doi.org/10.1007/978-3-319-07458-0_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-07458-0_31
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07457-3
Online ISBN: 978-3-319-07458-0
eBook Packages: Computer ScienceComputer Science (R0)