Abstract
User-perspective rendering in Video See-through Augmented Reality (V-AR) creates a view that always shows what is behind the screen, from the user’s point of view. It is used for better registration between the real and virtual world instead of the traditional device-perspective rendering which displays what the camera sees. There is a small number of approaches towards user-perspective rendering that over all improve the registration between the real world, the video captured from real world that is displayed on the screen and the augmentations. There are still some registration errors that cause misalignment in the user-perspective rendering. One source of error is from the device registration which, based on the used tracking method, can be the misalignment between the camera and the screen and also the tracked frame of reference that the screen and the camera are attached to it. In this paper we first describe a method for the user perspective V-AR based on 3D projective geometry. We then address the device registration problem in user perspective rendering by presenting two methods: First, for estimating the misalignment between the camera and the screen. Second, for estimating the misalignment between the camera and the tracked frame.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Brown, D.C.: Decentering distortion of lenses. Photometric Eng. 32(3), 444–462 (1966)
Conrady, A.E.: Decentered lens systems. Mon. Not. R. Astron. Soc. 79, 384–390 (1919)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, New York (2003)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, New York (2004). ISBN: 0521540518
Hill, A., Schiefer, J., Wilson, J., Davidson, B., Gandy, M., MacIntyre, B.: Virtual transparency: introducing parallax view into video see-through AR. In: 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 239–240 (2011)
Liang, R.-H., Mao, J.-F.: Hand-eye calibration with a new linear decomposition algorithm. J. Zhejiang Univ. Sci. A 9(10), 1363–1368 (2008)
Samini, A., Palmerius, K.L.: A perspective geometry approach to user-perspective rendering in hand-held video see-through augmented reality. In: Proceedings of the 20th ACM Symposium on Virtual Reality Software and Technology, VRST 2014, pp. 207–208. ACM, New York (2014)
Shah, M., Eastman, R.D., Hong, T.: An overview of robot-sensor calibration methods for evaluation of perception systems. In: Proceedings of the Workshop on Performance Metrics for Intelligent Systems, PerMIS 2012, pp. 15–20. ACM, New York (2012)
Shiu, Y.C., Ahmad, S.: Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form ax = xb. IEEE Trans. Rob. Autom. 5(1), 16–29 (1989)
Shreiner, D., T. K. O. A. W. Group: OpenGL Programming Guide: The Official Guide to Learning OpenGL, Versions 3.0 and 3.1. Addison-Wesley Professional, 7th edn. (2009)
Tomioka, M., Ikeda, S., Sato, K.: Approximated user-perspective rendering in tablet-based augmented reality. In: 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 21–28, October 2013
Ware, C., Arthur, K., Booth, K.S.: Fish tank virtual reality. In: Proceedings of the INTERACT 1993 and CHI 1993 Conference on Human Factors in Computing Systems, CHI 1993, pp. 37–42. ACM, New York (1993)
Yoshida, T., Kuroki, S., Nii, H., Kawakami, N., Tachi, S.: Arscope. In: ACM SIGGRAPH 2008 New Tech Demos, SIGGRAPH 2008, pp. 4:1–4:1. ACM, New York (2008)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Acknowledgments
The authors would like to thank Joakim Kilby for his help with the project development and the staff at the Indoor Micro Unmanned Aerial Vehicle Laboratory.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Samini, A., Palmerius, K.L. (2015). Device Registration for 3D Geometry-Based User-Perspective Rendering in Hand-Held Video See-Through Augmented Reality. In: De Paolis, L., Mongelli, A. (eds) Augmented and Virtual Reality. AVR 2015. Lecture Notes in Computer Science(), vol 9254. Springer, Cham. https://doi.org/10.1007/978-3-319-22888-4_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-22888-4_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22887-7
Online ISBN: 978-3-319-22888-4
eBook Packages: Computer ScienceComputer Science (R0)