Abstract
In this tutorial chapter we present a package to calibrate multi-device vision systems such as camera networks or robots. The proposed approach is able to estimate—in a unique and consistent reference frame—the rigid displacements of all the sensors in a network of standard cameras, Kinect-like depth sensors and Time-of-Flight range sensors. The sensor poses can be estimated in a few minutes with a user-friendly procedure: the user is only asked to move a checkerboard around while the ROS nodes acquire the data and perform the calibration. To make the system scalable, the data analysis is distributed in the network. This results in a low bandwidth usage as well as a really fast calibration procedure. The ROS package is available on GitHub within the repository iaslab-unipd/calibration_toolkit (https://github.com/iaslab-unipd/calibration_toolkit). The package has been developed for ROS Indigo in C++11 and Python, and tested on PCs equipped with Ubuntu 14.04 64 bit.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
S. Agarwal, K. Mierle et al., Ceres solver, http://ceres-solver.org
E. Auvinet, J. Meunier, F. Multon, Multiple depth cameras calibration and body volume reconstruction for gait analysis, in 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA), pp. 478–483, July 2012
F. Basso, R. Levorato, E. Menegatti, Online calibration for networks of cameras and depth sensors, in Proceedings of the 12th Workshop on Non-classical Cameras, Camera Networks and Omnidirectional Vision (OMNIVIS), Hong Kong, China, June 2014
F. Basso, M. Munaro, S. Michieletto, E. Menegatti, Fast and robust multi-people tracking from RGB-D data for a mobile robot, in Proceedings of the 12th Intelligent Autonomous Systems (IAS) Conference. vol. 193, Jeju Island, Korea, pp. 265–276, June 2012
F. Basso, A. Pretto, E. Menegatti, Unsupervised intrinsic and extrinsic calibration of a camera-depth sensor couple, IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China, pp. 6244–6249, June 2014
G. Bradski, The OpenCV library. Dr. Dobb’s Journal of Software Tools (2000)
A. Canessa, M. Chessa, A. Gibaldi, S.P. Sabatini, F. Solari, Calibrated depth and color cameras for accurate 3D interaction in a stereoscopic augmented reality environment. J. Vis. Commun. Image Representation 25(1), 227–237 (2014)
M. Di Cicco, L. Iocchi, Grisetti, G.: Non-parametric calibration for depth sensors, in Proceedings of the 13th International Conference on Intelligent Autonomous Systems, (IAS-13), Padova, Italy (2014)
M.A. Fischler, R.C. Bolles, Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
P. Furgale, J. Rehder, R. Siegwart, Unified temporal and spatial calibration for multi-sensor systems, in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1280–1286, Nov 2013
G. Guennebaud, B. Jacob et al., Eigen (2010), http://eigen.tuxfamily.org
Q. Le, A. Ng, Joint calibration of multiple sensors. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 3651–3658, Oct 2009
R. Levorato, E. Pagello, Probabilistic 2D acoustic source localization using direction of arrivals in robot sensor networks. In: D. Brugali, J.F. Broenink, T. Kroeger, B.A. MacDonald (eds.) Simulation, Modeling, and Programming for Autonomous Robots. Lecture Notes in Computer Science, vol. 8810, (Springer International Publishing, 2014), pp. 474–485
M. Munaro, F. Basso, E. Menegatti, Tracking people within groups with RGB-D data, in Proceedings of the International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal, pp. 2101–2107, Oct 2012
M. Munaro, A. Horn, R. Illum, J. Burke, R.B. Rusu, OpenPTrack: People tracking for heterogeneous networks of color-depth cameras, in IAS-13 Workshop Proceedings: 1st Intl Workshop on 3D Robot Perception with Point Cloud Library, Padova, Italy, pp. 235–247, July 2014
J. Smisek, M. Jancosek, T. Pajdla, 3D with kinect, in IEEE International Conference on Computer Vision Workshops (ICCV Workshops), ICCVW 2011, pp. 1154–1160 (2011)
E. So, F. Basso, E. Menegatti, Calibration of a rotating 2D laser range finder using point-plane constraints. J. Autom. Mob. Robot. Intell Syst. 7(2), 30–38 (2013)
A. Teichman, S. Miller, S. Thrun, Unsupervised intrinsic calibration of depth sensors via SLAM, in Proceedings of Robotics: Science and Systems, Berlin, Germany, June 2013
B. Triggs, P.F. McLauchlan, R.I. Hartley, A.W. Fitzgibbon, Bundle adjustment-a modern synthesis, in Vision Algorithms: Theory and Practice, vol. 1883, Lecture Notes in Computer Science, ed. by B. Triggs, A. Zisserman, R. Szeliski (Springer, Berlin Heidelberg, 2000), pp. 298–372
R. Unnikrishnan, M. Hebert, Fast extrinsic calibration of a laser rangefinder to a camera, Technical report, Carnegie Mellon University (2005)
M. Warren, D. McKinnon, B. Upcroft, Online calibration of stereo rigs for long-term autonomy, in IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany (2013)
C. Zhang, Z. Zhang, Calibration between depth and color sensors for commodity depth cameras, in IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6 (2011)
Acknowledgments
The authors would like to thank Prof. Mohamed Chetouani, Salvatore Maria Anzalone and Stéphane Michelet from Université Pierre-et-Marie-Curie (UPMC) and the Institut des Systèmes Intelligents et de Robotique (ISIR) for their support and help.
The authors would also like to thank Jeff Burke, Alexander Horn and Randy Illum from University of California, Los Angeles (UCLA) for the extensive collaboration in designing and testing the calibration methods during the development of OpenPTrack [15]. OpenPTrack has been sponsored by UCLA REMAP and Open Perception. Key collaborators include the University of Padova and Electroland. Portions of the work have been supported by the National Science Foundation (IIS-1323767).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Basso, F., Levorato, R., Munaro, M., Menegatti, E. (2016). A Distributed Calibration Algorithm for Color and Range Camera Networks. In: Koubaa, A. (eds) Robot Operating System (ROS). Studies in Computational Intelligence, vol 625. Springer, Cham. https://doi.org/10.1007/978-3-319-26054-9_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-26054-9_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26052-5
Online ISBN: 978-3-319-26054-9
eBook Packages: EngineeringEngineering (R0)