Skip to main content
SpringerLink
Log in

Hierarchical Clustering Matching for Features with Repetitive Patterns in Visual Odometry

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

In this study, a hierarchical clustering matching (HCM) algorithm is proposed to match features with ambiguity due to repetitive patterns in visual odometry. Visual odometry is a real-time system that estimates the motions of camera setups, in which feature matching is a key step for tracking and relocalization. However, it is still difficult to remove outliers fast and reliably when a high proportion of outliers exist. The proposed HCM algorithm solves this problem by clustering accurate matches hierarchically. Dubious matches excluded from any clusters are removed during the iterations, which finally converges when new clusters no longer generate. Local geometric consistency and descriptor of features are both considered to be a metric to link two clusters using a centroid linkage criterion. Experimental results demonstrate that the proposed method works well on solving the problem mentioned above. Compared to state-of-the-art methods on feature matching, HCM performs much better on efficiency with comparable accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Aguilar, W., Frauel, Y., Escolano, F., Martinezperez, M. E., Espinosaromero, A., Lozano, M.: A robust graph transformation matching for non-rigid registration. Image Vis. Comput. 27(7), 897–910 (2009)

    Article  Google Scholar 

  2. Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (2008)

    Article  Google Scholar 

  3. Engel, J., Koltun, V., Cremers, D.: Direct sparse odometry. IEEE Trans. Pattern Anal. Mach. Intell. 40(3), 611–625 (2018)

    Article  Google Scholar 

  4. Engel, J., Schöps, T., Cremers, D.: Lsd-Slam: Large-Scale Direct Monocular Slam. In: European Conference on Computer Vision, pp. 834–849. Springer (2014)

  5. Fan, B., Wu, F., Hu, Z.: Towards reliable matching of images containing repetitive patterns. Pattern Recogn. Lett. 32(14), 1851–1859 (2011)

    Article  Google Scholar 

  6. Finkel, R. A., Bentley, J. L.: Quad trees a data structure for retrieval on composite keys. Acta Inform. 4(1), 1–9 (1974)

    Article  Google Scholar 

  7. Fischler, M. A., Bolles, R. C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  8. Geiger, A., Lenz, P., Stiller, C., Urtasun, R.: Vision meets robotics: The kitti dataset. Int. J. Robot. Res. 32(11), 1231–1237 (2013)

    Article  Google Scholar 

  9. Ha, S. J., Kim, S., Cho, N. I.: Image Registration by Using a Descriptor for Repetitive Patterns. In: 2012 Visual Communications and Image Processing, pp. 1–6. IEEE (2012)

  10. Ha, S. J., Lee, S. H., Cho, N. I.: Discrimination and description of repetitive patterns for enhancing the performance of feature-based recognition. Image Vis. Comput. 30(11), 817–828 (2012)

    Article  Google Scholar 

  11. Hartley, R., Zisserman, A.: Multiple view geometry in computer vision. Kybernetes 30(9/10), 1865–1872 (2008)

    MATH  Google Scholar 

  12. Izadi, M., Saeedi, P.: Robust weighted graph transformation matching for rigid and nonrigid image registration. IEEE Trans. Image Process. 21(10), 4369–4382 (2012)

    Article  MathSciNet  Google Scholar 

  13. Klein, G., Murray, D.: Parallel Tracking and Mapping for Small Ar Workspaces. In: 2007 6Th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225–234. IEEE (2007)

  14. Kümmerle, R., Grisetti, G., Strasdat, H., Konolige, K., Burgard, W.: G2o: a General Framework for Graph Optimization. In: 2011 IEEE International Conference on Robotics and Automation, pp. 3607–3613. IEEE (2011)

  15. Le Brese, C., Young, C. N., Zou, J. J.: A Robust Match Filtering Algorithm for Use with Repetitive Patterns. In: 2013, 7Th International Conference on Signal Processing and Communication Systems (ICSPCS), pp. 1–6. IEEE (2013)

  16. Liu, Z., An, J., Jing, Y.: A simple and robust feature point matching algorithm based on restricted spatial order constraints for aerial image registration. IEEE Trans. Geosci. Remote Sens. 50(2), 514–527 (2012)

    Article  Google Scholar 

  17. Lowe, D. G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60 (2), 91–110 (2004)

    Article  Google Scholar 

  18. Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)

    Article  Google Scholar 

  19. Mirsadeghi, S. E., Faez, K., Fotouhi, M., Kasaei, S.: Feature-Based Image Stitching with Repetitive Patterns Using Local Phase Quantization. In: 2014 22Nd Iranian Conference on Electrical Engineering (ICEE), pp. 1147–1151. IEEE (2014)

  20. Murartal, R., Montiel, J. M. M., Tardos, J. D.: Orb-slam: a versatile and accurate monocular slam system. IEEE Trans. Robot. 31(5), 1147–1163 (2015)

    Article  Google Scholar 

  21. Nister, D: Preemptive RANSAC for live structure and motion estimation. Machine Vision and Applications 16(5), 321–329 (2005)

    Article  Google Scholar 

  22. Nistér, D., Naroditsky, O., Bergen, J.: Visual odometry. In: Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004., vol. 1, pp. I–I. IEEE (2004)

  23. Nister, D., Stewenius, H.: Scalable Recognition with a Vocabulary Tree. In: 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), Vol. 2, pp. 2161–2168. IEEE (2006)

  24. Rokach, L., Maimon, O.: Clustering Methods. In: Data Mining and Knowledge Discovery Handbook, pp. 321–352. Springer (2005)

  25. Rosten, E., Drummond, T.: Machine Learning for High-Speed Corner Detection. In: European Conference on Computer Vision, pp. 430–443. Springer (2006)

  26. Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: Orb: an Efficient Alternative to Sift Or Surf. In: 2011 International Conference on Computer Vision, pp. 2564–2571. IEEE (2011)

  27. Scaramuzza, D., Fraundorfer, F.: Visual odometry [tutorial]. IEEE robotics & automation magazine 18(4), 80–92 (2011)

    Article  Google Scholar 

  28. Schmidt, A., Kraft, M., Kasiński, A.: An Evaluation of Image Feature Detectors and Descriptors for Robot Navigation. In: International Conference on Computer Vision and Graphics, pp. 251–259. Springer (2010)

  29. Stewenius, H., Engels, C., Nister, D.: Recent developments on direct relative orientation. Isprs J. Photogr. Remote Sens. 60(4), 284–294 (2006)

    Article  Google Scholar 

  30. Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A Benchmark for the Evaluation of Rgb-D Slam Systems. In: Proc. of the International Conference on Intelligent Robot Systems (IROS) (2012)

  31. Taketomi, T., Uchiyama, H., Ikeda, S.: Visual slam algorithms: a survey from 2010 to 2016. Ipsj Trans. Comput. Vis. Appl. 9(1), 16 (2017)

    Article  Google Scholar 

  32. Tax, D. M. J., Duin, R. P. W.: Support vector data description. Mach. Learn. 54(1), 45–66 (2004)

    Article  Google Scholar 

  33. Wang, S., Guo, X., Mu, X., Huo, Y., Qi, L.: Advanced weight graph transformation matching algorithm. Iet Comput. Vis. 9(6), 960–966 (2015)

    Article  Google Scholar 

  34. Wen, H., Sheng, X. Y.: An Improved Sift Operator-Based Image Registration Using Cross-Correlation Information. In: 2011 4Th International Congress on Image and Signal Processing, vol. 2, pp. 869–873. IEEE (2011)

  35. Werner, T., Zisserman, A.: New Techniques for Automated Architectural Reconstruction from Photographs. In: European Conference on Computer Vision, pp. 541–555. Springer (2002)

  36. Zhang, Z.: Flexible camera calibration by viewing a plane from unknown orientations. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 1, pp. 666–673. IEEE (1999)

  37. Zhu, Y., Cheng, S., Stankovic, V., Stankovic, L.: Image registration using bp-sift. J. Vis. Commun. Image Represent. 24(4), 448–457 (2013)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. The State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, No. 38 Zheda Road, Hangzhou, Zhejiang, 310027, People’s Republic of China

    Tianpei Lin & Xuanyin Wang

Authors
  1. Tianpei Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xuanyin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xuanyin Wang.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, T., Wang, X. Hierarchical Clustering Matching for Features with Repetitive Patterns in Visual Odometry. J Intell Robot Syst 100, 1139–1155 (2020). https://doi.org/10.1007/s10846-020-01230-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-020-01230-z

Keywords

Search

Navigation