Abstract
Mixed Reality (MR) technologies may play an important role in assisting on-site operators during maintenance and repair activities. Nevertheless, industrial equipment augmentation requires a high level of precision when co-registering virtual objects to the corresponding real counterparts. In this paper we describe a comprehensive proposal for a mixed reality environment aimed to improve the effectiveness of servicing and repair procedures in mission critical systems, while reducing the time required for the intervention. The tracking of the user’s point of view exploits a multi-marker based solution for robust and precise augmentation of the operating field. The architecture also features a diminishing visualization strategy allowing the user to see only the fraction of real equipment that is relevant for the maintenance task. A finger color-based tracking provides powerful interaction capabilities by means of a not-instrumented interface exploiting colored fingertips caps. An evaluation study of the proposed MR environment, performed by technicians with no previous experience of MR systems, highlights the potential of the approach.
Chapter PDF
Similar content being viewed by others
References
Henderson, S., Feiner, S.: Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In: International Symposium on Mixed and Augmented Reality (ISMAR 2009), pp. 135–144 (2009)
Henderson, S., Feiner, S.: Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Transactions on Visualization and Computer Graphics 17(10), 1355–1368 (2011)
Friedrich, W., Jahn, D., Schmidt, L.: ARVIKA-augmented reality for development, production and service. In: Proceedings of the IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR 2002), pp. 3–4 (2002)
Kiyokawa, K., Billinghurst, M., Campbell, B., Woods, E.: An occlusion-capable optical see-through head mount display for supporting co-located collaboration. In: Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality, p. 133. IEEE (2003)
Zhiqiang, B.I.A.N., Ishii, H., Shimoda, H., Yoshikawa, H., Morishita, Y., Kanehira, Y., Izumi, M.: Development of a tracking method for augmented reality applied to NPP maintenance work and its experimental evaluation. IEICE Transactions on Information and Systems 90(6), 963–974 (2007)
Wagner, D., Langlotz, T., Schmalstieg, D.: Robust and unobtrusive marker tracking on mobile phones. In: 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (ISMAR 2008), pp. 121–124. IEEE (2008)
Maidi, M., Preda, M.: Markerless tracking for mobile augmented reality. In: IEEE International Conference on Signal and Image Processing Applications (ICSIPA 2011), pp. 301–306. IEEE (2011)
Comport, A.I., Marchand, E., Pressigout, M., Chaumette, F.: Real-time markerless tracking for augmented reality: the virtual visual servoing framework. IEEE Transactions on Visualization and Computer Graphics 12(4), 615–628 (2006)
Fue, P., Lepetit, V.: Vision based 3D tracking and pose estimation for mixed reality, pp. 1–22. Interfaces and Design, Emerging Technologies of Augmented Reality (2005)
Wang, W., Qi, Y., Wang, Q.: An Augmented Reality Application Framework for Complex Equipment Collaborative Maintenance. In: Luo, Y. (ed.) CDVE 2011. LNCS, vol. 6874, pp. 154–161. Springer, Heidelberg (2011)
Wang, R.Y., Popović, J.: Real-time hand-tracking with a color glove. ACM Transactions on Graphics (TOG) 28(3), 63
Mistry, P., Maes, P.: SixthSense: a wearable gestural interface. In: ACM SIGGRAPH ASIA 2009 Sketches, p. 11. ACM (2009)
Jarusirisawad, S., Hosokawa, T., Saito, H.: Diminished reality using plane-sweep algorithm with weakly-calibrated cameras. Progress in Informatics 7, 11–20 (2010)
Enomoto, A., Saito, H.: Diminished Reality using Multiple Handheld Cameras. In: ACCV 2007 Workshop on Multi-Dimensional and Multi-View Image Processing, Tokyo (November 2007)
Herling, J., Broll, W.: Advanced self-contained object removal for realizing real-time Diminished Reality in unconstrained environments. In: 9th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2010), pp. 207–212. IEEE (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Abate, A.F., Narducci, F., Ricciardi, S. (2013). Mixed Reality Environment for Mission Critical Systems Servicing and Repair. In: Shumaker, R. (eds) Virtual, Augmented and Mixed Reality. Systems and Applications. VAMR 2013. Lecture Notes in Computer Science, vol 8022. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39420-1_22
Download citation
DOI: https://doi.org/10.1007/978-3-642-39420-1_22
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39419-5
Online ISBN: 978-3-642-39420-1
eBook Packages: Computer ScienceComputer Science (R0)