Abstract
In virtual studios, most of the setting is not constructed in reality but generated synthetically by a graphics computer and mixed into the camera image. A convincing mixing requires very precise coordination of the real camera with the graphics pipeline, especially in the case of camera moves. This process is called camera tracking.
The paper describes an image-based algorithm for camera tracking. The algorithm uses real world reference points which are identified interactively in the first image and tracked in the image sequence in real-time. Based on these measurements, the camera data is calculated. The most demanding task is the smoothing of measurements and camera data to achieve stable and coherent camera moves. Kalman filtering methods are used to eliminate jitters from the calculated camera data.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ali Azarbayejani et al.: Recursive estimation of structure and motion using relative orientation constraints. IEEE Conference on Computer Vision and Pattern Recognition, June 1993, 294–299.
Yaakov Bar-Shalom, Thomas E. Fortmann: Tracking and Data Association. Academic Press, San Diego, 1988
Rod G. Bogart: View correlation. In: Graphics Gems II, Academic Press (1991) 181–190.
T. J. Broida, R. Chellappa: Estimation of object motion parameters from noisy images. IEEE Trans. Pattern Analysis and Machine Intelligence, 8(1):90–99, January 1986.
C.K. Chui, G. Chen: Kalman Filtering with Real Time Applications. Springer Series in Information Sciences 17. Springer Verlag, Berlin, 1987.
Olivier Faugeras: Three-Dimensional Computer Vision. MIT Press Cambridge, Massachusetts, USA, 1993.
Klaus Kansy, Thomas Berlage, Günther Schmitgen, Peter Wiükirchen: Real time integration of synthetic computer graphics into live video scenes. Proc. Interface of Real and Virtual Worlds. Montpellier, France, June 26–30, 1995, pp. 93–101
Klaus Kansy, Günther Schmitgen, Peter Wiükirchen: Bildbasierte Kameraführung im Virtuellen Studio — Pixelgenaues Mischen von Realität und Virtualität. Fernseh-und Kinotechnik 50, Heft 1-2, pp. 27–32 (1996)
Frank L. Lewis: Applied Optimal Control and Estimation, Prentice Hall, 1992.
Tomasz Mazuryk, Michael Gervautz: Two-Step Prediction and Image Deflection for Exact Head Tracking in Virtual Environments. Computer Graphics Forum 14(1995) C–29–C–41.
J. S. Meditch: Stochastic Optimal Linear Estimation and Control. McGraw Hill, New York, 1969.
ORAD Hi-tec Systems Ltd: ORAD’s Virtual Set. Data sheet by ORAD Hi-tec Systems Ltd., 40 Ravutski Street, Ra’anana, POBox 695, Israel 43106. URL: http://orad.co.il/
D. Routsis, P. Le Floch, A.V. Sahiner: Real-Time Camera Tracking Server on the ELSET Accelerator. In Proc. European Workshop “Combined Real and Synthetic Image Processing for Broadcast and Video Production”, 23.–24.11.1994, VAP Media Centre, Hamburg, Germany (1994)
F. Sommerhäuser: Das virtuelle Studio — Grundlagen einer neuen Studio-produktionstechnik. Fernseh-und Kinotechnik 50, Heft 1-2, pp. 11–22 (1996)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1996 Springer-Verlag/Wien
About this paper
Cite this paper
Wißkirchen, P., Kansy, K., Schmitgen, G. (1996). Integrating Graphics Into Video Image-Based Camera Tracking and Filtering. In: Göbel, M., David, J., Slavik, P., van Wijk, J.J. (eds) Virtual Environments and Scientific Visualization ’96. Eurographics. Springer, Vienna. https://doi.org/10.1007/978-3-7091-7488-3_8
Download citation
DOI: https://doi.org/10.1007/978-3-7091-7488-3_8
Publisher Name: Springer, Vienna
Print ISBN: 978-3-211-82886-1
Online ISBN: 978-3-7091-7488-3
eBook Packages: Springer Book Archive