Skip to main content

Management of Tracking for Mixed and Augmented Reality Systems

  • Chapter
  • First Online:
The Engineering of Mixed Reality Systems

Part of the book series: Human-Computer Interaction Series ((HCIS))

Abstract

Position and orientation tracking is a major challenge for mixed/augmented reality applications, especially in heterogeneous and wide-area sensor setups. In this chapter, we describe trackman, a planning and analysis tool which supports the AR-engineer in setup and maintenance of the tracking infrastructure. A new graphical modeling approach based on spatial relationship graphs (SRGs) eases the specification of known as well as the deduction of new relationships between entities in the scene. Modeling is based on reusable patterns representing the underlying sensor drivers or algorithms. Recurring constellations in the scene can be condensed into reusable meta patterns. The process is further simplified by semi-automatic modeling techniques which automize trivial steps. Data flow networks can be generated automatically from the SRG and are guaranteed to be semantically correct. Furthermore, generic tools are described that allow for the calibration/registration of static spatial transformations as well as for the live surveillance of tracking accuracy. In summary, this approach reduces tremendously the amount of expert knowledge needed for the administration of tracking setups.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The Ubitrack runtime library and trackman can be downloaded from http://campar.in.tum.de/UbiTrack/WebHome

  2. 2.

    A comprehensive reference is provided at http://campar.in.tum.de/UbiTrack/WebHome

  3. 3.

    http://ar.in.tum.de/static/files/ubitrack/utql/utql.xsd

  4. 4.

    http://ar.in.tum.de/static/files/ubitrack/utql/utql_templates.xsd, http://ar.in.tum.de/static/files/ubitrack/utql/utql_types.xsd

  5. 5.

    FARO Technologies Inc.

References

  1. J. Albus. 4D/RCS: a reference model architecture for intelligent unmanned ground vehicles. In Proceedings of SPIE, volume 4715, page 303. SPIE, 2002.

    Google Scholar 

  2. M. Bauer, M. Schlegel, D. Pustka, N. Navab, and G. Klinker. Predicting and estimating the accuracy of vision-based optical tracking systems. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Santa Barbara, USA, October 2006.

    Google Scholar 

  3. B. Becker, M. Huber, and G. Klinker. Utilizing RFIDs for location aware computing. In Proceedings of the 5th International Conference on Ubiquitous Intelligence and Computing (UIC’08), Oslo, Norway, 2008.

    Google Scholar 

  4. J. Bouchet, L. Nigay, and T. Ganille. ICARE software components for rapidly developing multimodal interfaces.In Proceedings of the 6th International Conference on Multimodal Interfaces, pages 251–258. ACM New York, USA, 2004.

    Chapter  Google Scholar 

  5. E. Coelho, B. MacIntyre, and S. Julier. OSGAR: A scene graph with uncertain transformations. In International Symposium on Mixed and Augmented Reality (ISMAR 2004), pages 6–15, 2004.

    Google Scholar 

  6. M. Darms, P. Rybski, C. Urmson, C. Inc, and M. Aubur. Hills. Classification and tracking of dynamic objects with multiple sensors for autonomous driving in urban environments. In Intelligent Vehicles Symposium, 2008 IEEE, pages 1197–1202, 2008.

    Google Scholar 

  7. E. D. Dickmanns. Dynamic Vision for Perception and Control of Motion. Springer Verlag, Berlin, 2007.

    Google Scholar 

  8. P. Dragicevic and J. Fekete. Input device selection and interaction configuration with ICON. In People and Computer XV-Interaction Without Frontier (Joint proceedings of HCI 2001 and IHM 2001), pages 543–448, 2001.

    Google Scholar 

  9. F. Echtler, M. Huber, D. Pustka, P. Keitler, and G. Klinker. Splitting the scene graph - using spatial relationship graphs instead of scene graphs in augmented reality. In Proceedings of the 3rd International Conference on Computer Graphics Theory and Applications (GRAPP), January. 2008.

    Google Scholar 

  10. B. Horn, H. Hilden, and S. Negahdaripour. Closed-form solution of absolute orientation using unit quaternions. Journal of the Optical Society of America A, 4(4):629–642, 1987.

    Article  Google Scholar 

  11. M. Huber, D. Pustka, P. Keitler, E. Florian, and G. Klinker. A system architecture for ubiquitous tracking environments. In Proceedings of the 6th International Symposium on Mixed and Augmented Reality (ISMAR ’07), November 2007.

    Google Scholar 

  12. P. Keitler, M. Schlegel, and G. Klinker. Indirect tracking for on-the-fly elimination of occlusion problems. Demonstration at IEEE International Symposium on Mixed and Augmented Reality (ISMAR ’08), September 2008.

    Google Scholar 

  13. P. Keitler, M. Schlegel, and G. Klinker. Indirect tracking to reduce occlusion problems. In Advances in Visual Computing, Fourth International Symposium, ISVC 2008 Las Vegas, USA, December 1–3, volume 5359(2) of Lecture Notes in Computer Science, pages 224–235, Springer Berlin, 2008.

    Google Scholar 

  14. J. Newman, A. Bornik, D. Pustka, F. Echtler, M. Huber, D. Schmalstieg, and G. Klinker. Tracking for distributed mixed reality environments. In Workshop on Trends and Issues in Tracking for Virtual Environments at the IEEE Virtual Reality Conference (VR ’07), March 2007.

    Google Scholar 

  15. J. Newman, M. Wagner, M. Bauer, A. MacWilliams, T. Pintaric, D. Beyer, D. Pustka, F. Strasser, D. Schmalstieg, and G. Klinker. Ubiquitous tracking for augmented reality. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR ’04), Arlington, USA, November 2004.

    Google Scholar 

  16. D. Pustka. Construction of data flow networks for augmented reality applications. In Proceedings of the Dritter Workshop Virtuelle und Erweiterte Realität der GI-Fachgruppe VR/AR, Koblenz, Germany, September 2006.

    Google Scholar 

  17. D. Pustka, M. Huber, M. Bauer, and G. Klinker. Spatial relationship patterns: Elements of reusable tracking and calibration systems. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR ’06), October 2006.

    Google Scholar 

  18. D. Pustka, M. Huber, F. Echtler, and P. Keitler. UTQL: The Ubiquitous Tracking Query Language v1.0. Technical Report TUM-I0718, Institut für Informatik, Technische Universität München, 2007.

    Google Scholar 

  19. D. Pustka and G. Klinker. Integrating gyroscopes into ubiquitous tracking environments. In Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR ’08), September 2008.

    Google Scholar 

  20. G. Reitmayr and D. Schmalstieg. An open software architecture for virtual reality interaction. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pages 47–54. ACM New York, USA, 2001.

    Chapter  Google Scholar 

  21. M. Serrano, D. Juras, and L. Nigay. A three-dimensional characterization space of software components for rapidly developing multimodal interfaces. In Proceedings of the 10th International Conference on Multimodal Interfaces, pages 149–156. ACM New York, USA, 2008.

    Chapter  Google Scholar 

  22. P. Strauss and R. Carey. An object-oriented 3D graphics toolkit. Computer Graphics, 26(2):341–349, July 1992. Siggraph ’92.

    Article  Google Scholar 

  23. R. M. Taylor, T. C. Hudson, A. Seeger, H. Weber, J. Juliano, and A. T. Helser. Vrpn: a device-independent, network-transparent vr peripheral system. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology, pages 55–61. ACM Press, New York, USA, 2001.

    Chapter  Google Scholar 

  24. S. Thrun, W. Burgard, and D. Fox. Probabilistic Robotics (Intelligent Robotics and Autonomous Agents). MIT press, Cambridge, Massachusetts, USA, 2005.

    Google Scholar 

  25. R. Tsai and R. Lenz. Real time versatile robotics hand/eye calibration using 3D machine vision. In IEEE International Conference on Robotics and Automation, volum. 1, pages 554–561, 1988.

    Google Scholar 

  26. G. Welch and E. Foxlin. Motion tracking: No silver bullet, but a respectable arsenal. IEEE Computer Graphics and Applications, pages 24–38, 2002.

    Google Scholar 

Download references

Acknowledgments

This work was supported by the Bayerische Forschungsstiftung (project trackframe, AZ-653-05) and the PRESENCCIA Integrated Project funded under the European Sixth Framework Program, Future and Emerging Technologies (FET) (contract no. 27731).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Peter Keitler .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London

About this chapter

Cite this chapter

Keitler, P., Pustka, D., Huber, M., Echtler, F., Klinker, G. (2010). Management of Tracking for Mixed and Augmented Reality Systems. In: Dubois, E., Gray , P., Nigay, L. (eds) The Engineering of Mixed Reality Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-733-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-1-84882-733-2_13

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84882-732-5

  • Online ISBN: 978-1-84882-733-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics