Abstract
Visual pattern recognition is a basic capability of many species in nature. The skill of visually recognizing and distinguishing different objects in the surrounding environment gives rise to the development of sensory-motor maps in the brain, with the consequent capability of object reaching and manipulation. This paper presents the implementation of a real-time tracking algorithm for following and evaluating the 3D position of a generic spatial object. The key issue of our approach is the development of a new algorithm for pattern recognition in machine vision, the Least Constrained Square-Fitting of Ellipses (LCSE), which improves the state of the art ellipse fitting procedures. It is a robust and direct method for the least-square fitting of ellipses to scattered data. In this work we applied it to the iCub humanoid robotics platform simulator and real robot. We used it as a base for a circular object localization within the 3D surrounding space. We compared its performance with the Hough Transform and the state of the art ellipse fitting algorithms, in terms of robustness (succes/failure in the object detection) and fitting precision. Our experiments involve robustness against noise, occlusion, and computational complexities analyses.
Similar content being viewed by others
References
Cheng, Y., Lee, S.: A new method for quadrative curve detection using k-ransac with accelereration techniques. Pattern Recogn. 28(5), 663–682 (1995)
Dave’, R.N., Bhaswan, K.: Adaptive fuzzy c-shells clustering and detection of ellipses. IEEE Trans. Neural Netw. 3, 643–662 (1992)
Deniz, O., Castrillon, M., Lorenzo, J., Guerra, C., Hernandez, D., Hernandez, M.: Casimiro: A robot head for human-computer interaction. In: Proceedings of the 11th IEEE International Workshop on Robot and Human Interactive Communication, pp. 319–324. ISBN: 0-7803-7545-9 (2002)
DeSouza, G.N., Kak, A.C.: Vision for mobile robot navigation: A survey. IEEE Trans. Pattern Anal. Mach. Intell. 24, 237–267 (2002)
Dhome, M., Lapreste, J.T., Rives, G., Richetin, M.: Spatial Localisation of Modelled Objects of Revolution in Monocular Perspective Vision, pp. 475–485 (1990)
Fitzgibbon, A., Pilu, M., Fisher, R.: Direct least square fitting of ellipses. IEEE Trans. Pattern Anal. Mach. Intell. 21, 476–480 (1999)
Forsyth, D., Mundy, J., Zisserman, A., Coelho, C., Heller, A., Rothwell, C.: Invariant descriptors for 3-d object recognition and pose. IEEE Trans. Pattern Anal. Mach. Intell. 13(10), 971–991 (1991)
Gander, W., Golub, G., Strebel, R.: Fitting of Circles and Ellipses Least Squares Solution. Technical Report tr-217, Institut für Wissenschaftliches Rechen, ETH, Zurich, Switzerland (1994)
Gander, W., Strebel, G.G.R.: Least-square fitting of circles and ellipses. BIT 34, 558–578 (1994)
Gath, I., Hoory, D.: Fuzzy clustering of elliptic ring-shaped clusters. Pattern Recogn. Lett. 16, 727–741 (1995)
Gauss, C.F.: Theory of the Motion of the Heavenly Bodies Moving About the Sun in Conic Sections (Theoria Motus Corporum Coelestium in Sectionibus Conicis Solem Ambientum). Translation by C.H. Davis. Dover, New York (1963). First published in 1809
Greggio, N., Bernardino, A., Laschi, C., Santos-Victor, J., Dario, P.: An algorithm for the least square-fitting of ellipses. In: 22th International Conference on Tools with Artificial Intelligence (ICTAI 2010). Arras, France (2010)
Greggio, N., Manfredi, L., Laschi, C., Dario, P., Carrozza, M.: Robotcub implementation of real-time least-square fitting of ellipses. In: IEEE-RAS International Conference on Humanoid Robots (HUMANOIDS-08)—Daejeon (Korea), December 1–3 (2008)
Greggio, N., Silvestri, G., Menegatti, E., Pagello, E.: Simulation of small humanoid robots for soccer domain. J. Franklin Inst. Eng. Appl. Math. 346(5), 500–519 (2009)
Hough, P.: Method and means for recognizing complex patterns. US Patent No. 3 069 654 (Dec. 18, 1962)
Kanatani, K.: Statistical bias of conic fitting and renormalization. IEEE Trans. Patt. Anal. Mach. Intell. 16, 320–326 (1994)
Kwolek, B.: Real-time head tracker using color, stereovision and ellipse fitting in a particle filter. Informatica 15(2), 219–230 (2004)
Leavers, V.F.: Shape Detection in Computer Vision Using the Hough Transform. Springer, Berlin (1992)
Maini, E.S.: Enhanced direct least square fitting of ellipses. Int. J. Pattern Recogn. Artif. Intell. 20(6), 939–954 (2006)
Mariottini, G.L., Oriolo, G., Prattichizzo, D.: Image-based visual servoing for nonholonomic mobile robots using epipolar geometry. IEEE Trans. Robot. 23(1), 87–100 (2007)
Metta, G., Sandini, G., Vernon, D., Caldwell, D., Tsagarakis, N., Beira, R., Santos-Victor, J., Ijspeert, A., Righetti, L., Cappiello, G., Stellin, G., Becchi, F.: The robotcub project—an open framework for research in embodied cognition. In: Humanoids Workshop, IEEE–RAS International Conference on Humanoid Robots (2005)
Nelson, B.J., Khosla, P.K.: The resolvability ellipsoid for visual servoing. In: Proc. of the 1994 Conf. on Computer Vision and Pattern Recognition (CVPR94) (1994)
Paromtchik, I.E.: Optical guidance method for robots capable of vision and communication. Robot. Auton. Syst. 54(6), 461–471 (2006)
Paton, K.: Conic sections in chromosome analysis. Pattern Recogn. 2, 39–51 (1970)
Perdereau, V., Passi, C., Drouin, M.: Real-time control of redundant robotic manipulators for mobile obstacle avoidance. Robot. Auton. Syst. 41(1), 41–59 (2002)
RobotCub: The Robotcub Project—European Commission fp6 Project ist-004370. URL: http://www.robotcub.org/ (2004–2009)
Rosin, P.L.: Ellipse fitting by accumulating five-point fits. Pattern Recogn. Lett. 14, 661–699 (1993)
Rosin, P.L., West, G.A.: Non parametric segmentation of curves into various representations. IEEE Trans. Pattern Anal. Mach. Intell. 17, 140–153 (1995)
Sabatini, A., Genovese, V., Maini, E.: Low-cost vision-based 2d localization systems for application in rehabilitation robotics. In: IEEE Proc. IROS, pp. 1355–1360 (2002)
Shim, H., Kwon, D., Yun, I., Lee, S.: Robust segmentation of cerebral arterial segments by a sequential monte carlo method: particle filtering. Comput. Methods Programs Biomed. 84(2–3), 135–145 (2006)
Song, X., Seneviratne, L.D., Althoefer, K.: A kalman filter-integrated optical flow method for velocity sensing of mobile robots. IEEE/ASME Trans. Mechatron. PP(99), 1–13 (2010)
Stellin, G., Cappiello, G., Roccella, S., Carrozza, M.C., Dario, P., Metta, G., Sandini, G., Becchi, F.: Preliminary design of an anthropomorphic dexterous hand for a 2-years-old humanoid: towards cognition. In: IEEE BioRob, Pisa, February, pp. 20–22 (2006)
Stentz, A.: Robotic technologies for outdoor industrial vehicles. Unmanned ground vehicle technology. In: Conference No. 3, Orlando FL, ETATS-UNIS (16/04/2001), vol. 4364, pp. 192–199 (2001)
Teutsch, C., Berndt, D., Trostmann, E., Weber, M.: Real-time detection of elliptic shapes for automated object. Machine vision applications in industrial inspection XIV. Edited by Fabrice Meriaudeau and Kurt S. Niel. Proc. SPIE 6070, 171–179 (2006)
Tikhanoff, V., Fitzpatrick, P., Nori, F., Natale, L., Metta, G., Cangelosi, A.: The iCub humanoid robot simulator. In: International Conference on Intelligent RObots and Systems IROS. Nice, France (2008)
Vincze, M.: Robust tracking of ellipses at frame rate. Pattern Recogn. 34, 487–498 (2001)
Werman, M., Geyzel, G.: Fitting a second degree curve in the presence of error. IEEE Trans. Pattern Anal. Mach. Intell. 17(2), 207–211 (1995)
Wu, C.J., Tsai, W.H.: Location estimation for indoor autonomous vehicle navigation by omni-directional vision using circular landmarks on ceilings. Robot. Auton. Syst. 57(5), 546–555 (2009)
Wu, W.Y., Wang, M.J.J.: Elliptical object detection by using its geometric properties. Pattern Recogn. 26, 1499–1509 (1993)
Yin, R.K.K., Tam, P.K.S., Leung, N.K.: Modification of Hough transform for circles and ellipses detection using 2-d array. Pattern Recogn. 25(9), 1007–1022 (1992)
Yoo, J., Sethi, I.: An ellipse detection method from the polar and pole definition of conics. Pattern Recogn. 26(2), 307–315 (1993)
Yuen, H.K., Illingworth, J., Kittler, J.: Detecting partially occluded ellipses using the Hough transform. Image Vis. Comput. 7(1), 31–37 (1989)
Zhang, Z.: Parameter estimation techniques: a tutorial with application to conic fitting. Image Vis. Comput. 15, 59–76 (1997)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Greggio, N., Bernardino, A., Laschi, C. et al. Real-Time 3D Stereo Tracking and Localizing of Spherical Objects with the iCub Robotic Platform. J Intell Robot Syst 63, 417–446 (2011). https://doi.org/10.1007/s10846-010-9527-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10846-010-9527-3