Skip to main content

A Distributed Calibration Algorithm for Color and Range Camera Networks

  • Chapter
  • First Online:
Robot Operating System (ROS)

Part of the book series: Studies in Computational Intelligence ((SCI,volume 625))

  • 13k Accesses

Abstract

In this tutorial chapter we present a package to calibrate multi-device vision systems such as camera networks or robots. The proposed approach is able to estimate—in a unique and consistent reference frame—the rigid displacements of all the sensors in a network of standard cameras, Kinect-like depth sensors and Time-of-Flight range sensors. The sensor poses can be estimated in a few minutes with a user-friendly procedure: the user is only asked to move a checkerboard around while the ROS nodes acquire the data and perform the calibration. To make the system scalable, the data analysis is distributed in the network. This results in a low bandwidth usage as well as a really fast calibration procedure. The ROS package is available on GitHub within the repository iaslab-unipd/calibration_toolkit (https://github.com/iaslab-unipd/calibration_toolkit). The package has been developed for ROS Indigo in C++11 and Python, and tested on PCs equipped with Ubuntu 14.04 64 bit.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://openptrack.org/.

  2. 2.

    http://wiki.ros.org/openni_kinect/kinect_accuracy.

References

  1. S. Agarwal, K. Mierle et al., Ceres solver, http://ceres-solver.org

  2. E. Auvinet, J. Meunier, F. Multon, Multiple depth cameras calibration and body volume reconstruction for gait analysis, in 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA), pp. 478–483, July 2012

    Google Scholar 

  3. F. Basso, R. Levorato, E. Menegatti, Online calibration for networks of cameras and depth sensors, in Proceedings of the 12th Workshop on Non-classical Cameras, Camera Networks and Omnidirectional Vision (OMNIVIS), Hong Kong, China, June 2014

    Google Scholar 

  4. F. Basso, M. Munaro, S. Michieletto, E. Menegatti, Fast and robust multi-people tracking from RGB-D data for a mobile robot, in Proceedings of the 12th Intelligent Autonomous Systems (IAS) Conference. vol. 193, Jeju Island, Korea, pp. 265–276, June 2012

    Google Scholar 

  5. F. Basso, A. Pretto, E. Menegatti, Unsupervised intrinsic and extrinsic calibration of a camera-depth sensor couple, IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China, pp. 6244–6249, June 2014

    Google Scholar 

  6. G. Bradski, The OpenCV library. Dr. Dobb’s Journal of Software Tools (2000)

    Google Scholar 

  7. A. Canessa, M. Chessa, A. Gibaldi, S.P. Sabatini, F. Solari, Calibrated depth and color cameras for accurate 3D interaction in a stereoscopic augmented reality environment. J. Vis. Commun. Image Representation 25(1), 227–237 (2014)

    Article  Google Scholar 

  8. M. Di Cicco, L. Iocchi, Grisetti, G.: Non-parametric calibration for depth sensors, in Proceedings of the 13th International Conference on Intelligent Autonomous Systems, (IAS-13), Padova, Italy (2014)

    Google Scholar 

  9. M.A. Fischler, R.C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  10. P. Furgale, J. Rehder, R. Siegwart, Unified temporal and spatial calibration for multi-sensor systems, in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1280–1286, Nov 2013

    Google Scholar 

  11. G. Guennebaud, B. Jacob et al., Eigen (2010), http://eigen.tuxfamily.org

  12. Q. Le, A. Ng, Joint calibration of multiple sensors. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3651–3658, Oct 2009

    Google Scholar 

  13. R. Levorato, E. Pagello, Probabilistic 2D acoustic source localization using direction of arrivals in robot sensor networks. In: D. Brugali, J.F. Broenink, T. Kroeger, B.A. MacDonald (eds.) Simulation, Modeling, and Programming for Autonomous Robots. Lecture Notes in Computer Science, vol. 8810, (Springer International Publishing, 2014), pp. 474–485

    Google Scholar 

  14. M. Munaro, F. Basso, E. Menegatti, Tracking people within groups with RGB-D data, in Proceedings of the International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal, pp. 2101–2107, Oct 2012

    Google Scholar 

  15. M. Munaro, A. Horn, R. Illum, J. Burke, R.B. Rusu, OpenPTrack: People tracking for heterogeneous networks of color-depth cameras, in IAS-13 Workshop Proceedings: 1st Intl Workshop on 3D Robot Perception with Point Cloud Library, Padova, Italy, pp. 235–247, July 2014

    Google Scholar 

  16. J. Smisek, M. Jancosek, T. Pajdla, 3D with kinect, in IEEE International Conference on Computer Vision Workshops (ICCV Workshops), ICCVW 2011, pp. 1154–1160 (2011)

    Google Scholar 

  17. E. So, F. Basso, E. Menegatti, Calibration of a rotating 2D laser range finder using point-plane constraints. J. Autom. Mob. Robot. Intell Syst. 7(2), 30–38 (2013)

    Google Scholar 

  18. A. Teichman, S. Miller, S. Thrun, Unsupervised intrinsic calibration of depth sensors via SLAM, in Proceedings of Robotics: Science and Systems, Berlin, Germany, June 2013

    Google Scholar 

  19. B. Triggs, P.F. McLauchlan, R.I. Hartley, A.W. Fitzgibbon, Bundle adjustment-a modern synthesis, in Vision Algorithms: Theory and Practice, vol. 1883, Lecture Notes in Computer Science, ed. by B. Triggs, A. Zisserman, R. Szeliski (Springer, Berlin Heidelberg, 2000), pp. 298–372

    Google Scholar 

  20. R. Unnikrishnan, M. Hebert, Fast extrinsic calibration of a laser rangefinder to a camera, Technical report, Carnegie Mellon University (2005)

    Google Scholar 

  21. M. Warren, D. McKinnon, B. Upcroft, Online calibration of stereo rigs for long-term autonomy, in IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany (2013)

    Google Scholar 

  22. C. Zhang, Z. Zhang, Calibration between depth and color sensors for commodity depth cameras, in IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2011)

    Google Scholar 

Download references

Acknowledgments

The authors would like to thank Prof. Mohamed Chetouani, Salvatore Maria Anzalone and Stéphane Michelet from Université Pierre-et-Marie-Curie (UPMC) and the Institut des Systèmes Intelligents et de Robotique (ISIR) for their support and help.

The authors would also like to thank Jeff Burke, Alexander Horn and Randy Illum from University of California, Los Angeles (UCLA) for the extensive collaboration in designing and testing the calibration methods during the development of OpenPTrack [15]. OpenPTrack has been sponsored by UCLA REMAP and Open Perception. Key collaborators include the University of Padova and Electroland. Portions of the work have been supported by the National Science Foundation (IIS-1323767).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Filippo Basso .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Basso, F., Levorato, R., Munaro, M., Menegatti, E. (2016). A Distributed Calibration Algorithm for Color and Range Camera Networks. In: Koubaa, A. (eds) Robot Operating System (ROS). Studies in Computational Intelligence, vol 625. Springer, Cham. https://doi.org/10.1007/978-3-319-26054-9_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26054-9_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26052-5

  • Online ISBN: 978-3-319-26054-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics