Virtual Post-its: Visual Label Extraction, Attachment, and Tracking for Teleconferencing
We present a novel functionality for tele-conferencing and tele-teaching, coined ‘virtual post-IT’. A virtual label can be cut out of a scene or can have been determined beforehand. This label can then be virtually attached to either a part of the screen or to an object in the scene. When made part of the screen, it remains there as a reminder, e.g. to a complicated formula. When glued to an object, the label automatically follows it when the speaker moves the object around. This real-time tracking includes out-of-plane rotation and does not require any special markers. The selection of the pattern to be used as a label can be carried out on-line by the speaker, by simply encircling it with a laser pointer. S/he can also determine on which object it has to be glued and where. Also these commands are given through simple, intuitive motions with a laser pointer. As the encircling motion to cut out the label will be rather sloppy, the system autonomously determines a rectangle that encloses the data and that has edges which are aligned with the dominant directions of the environment (typically horizontal and vertical).
Keywordsvirtual and augmented reality visual annotation laser point detection real-time and markerless tracking affine invariant features
Unable to display preview. Download preview PDF.
- 1.IST-project STAR (Services and Training through Augmented Reality), http://www.realviz.com/STAR/
- 2.Pentalfa project of the medical faculty of the K.U.Leuven, http://www.med.kuleuven.ac.be/pentalfa/
- 3.M. Chen, Design of a Virtual Auditorium, Proceedings of ACM Multimedia 2001Google Scholar
- 5.L. Van Gool, T. Tuytelaars, A. Turina, Local features for image retrieval, State-of-the-Art in Content-Based Image and Video Retrieval, Kluwer Academic Publishers 2001, pp. 21–41Google Scholar
- 6.T. Tuytelaars, L. Van Gool, Content-based Image Retrieval based on Local Affinely Invariant Regions, International Conference on Visual Information Systems, VISUAL’99, pp. 493–500, Amsterdam, June 2–4, 1999Google Scholar
- 7.V. Ferrari, T. Tuytelaars, L. Van Gool, Markerless Augmented Reality with Real-time Affine Region Tracker, Proc. Int’l Symposium on Augmented Reality, pp. 87–96, New York, october 2001.Google Scholar
- 8.Richard Hartley, Andrew Zisserman, book: Multiple view geometry in computer vision, Cambridge University Press 2001Google Scholar