Skip to main content

Point Set Registration of Large Deformation Using Auxiliary Landmarks

  • Conference paper
  • First Online:
Urban Intelligence and Applications (ICUIA 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1319))

Included in the following conference series:

Abstract

We present a probabilistic non-rigid point set registration method to deal with large and uneven deformations. The registration is treated as a density estimation problem. The main ideas of our method are to add constraints to enforce landmark correspondences and preserving local neighborhood structure. Landmarks represent the salient points in point sets, which can be computed using feature descriptors such as scale-invariant feature transform. By enforcing landmark correspondences, we preserve the overall global shape of the point set with significant deformations. In addition, we incorporate constraints to preserve local neighborhood structure by leveraging Stochastic Neighbor Embedding (SNE), which penalizes incoherent transformation within a neighborhood. We evaluate our method with both 2D and 3D datasets and show that our method outperforms the state-of-the-art methods in a large degree of deformations. In particular, quantitative results show our method is 49% better than the second best result (from the state-of-the-art methods). Finally, we demonstrate the importance of using correct landmark correspondences in registration by showing good registration results in large and uneven deformations point sets.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(4), 509–522 (2002)

    Article  Google Scholar 

  2. Bronstein, A.M., Bronstein, M.M., Bruckstein, A.M., Kimmel, R.: Analysis of two-dimensional non-rigid shapes. Int. J. Comput. Vision 78(1), 67–88 (2008)

    Article  Google Scholar 

  3. Chui, H., Rangarajan, A.: A new point matching algorithm for non-rigid registration. Comput. Vision Image Understand. 89(2), 114–141 (2003)

    Article  Google Scholar 

  4. Ge, S., Fan, G.: Non-rigid articulated point set registration with local structure preservation. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 126–133, June 2015

    Google Scholar 

  5. Gold, S., Rangarajan, A., Lu, C., Pappu, S., Mjolsness, E.: New algorithms for 2D and 3D point matching: pose estimation and correspondence. Pattern Recognit. 31(8), 1019–1031 (1998)

    Article  Google Scholar 

  6. Hinton, G.E., Roweis, S.T.: Stochastic neighbor embedding. In: Becker, S., Thrun, S., Obermayer, K. (eds.) Advances in Neural Information Processing Systems, vol. 15, pp. 857–864. MIT Press (2003)

    Google Scholar 

  7. Jian, B., Vemuri, B.C.: Robust point set registration using gaussian mixture models. IEEE Trans. Pattern Anal. Mach. Intell. 33(8), 1633–1645 (2011)

    Article  Google Scholar 

  8. Kong, L., Yuan, X., Maharjan, A.M.: A hybrid framework for automatic joint detection of human poses in depth frames. Pattern Recognit. 77(C), 216–225 (2018)

    Article  Google Scholar 

  9. Ling, H., Jacobs, D.W.: Shape classification using the inner-distance. IEEE Trans. Pattern Anal. Mach. Intell. 29(2), 286–299 (2007)

    Article  Google Scholar 

  10. Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the Seventh IEEE International Conference on Computer Vision, vol. 2, pp. 1150–1157 (1999)

    Google Scholar 

  11. Ma, J., Zhao, J., Yuille, A.L.: Non-rigid point set registration by preserving global and local structures. IEEE Trans. Image Process. 25(1), 53–64 (2016)

    Article  MathSciNet  Google Scholar 

  12. Myronenko, A., Song, X.: Point set registration: coherent point drift. IEEE Trans. Pattern Anal. Mach. Intell. 32(12), 2262–2275 (2010)

    Article  Google Scholar 

  13. Panaganti, V., Aravind, R.: Robust nonrigid point set registration using graph-Laplacian regularization. In: IEEE Winter Conference on Applications of Computer Vision, pp. 1137–1144, January 2015

    Google Scholar 

  14. Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)

    Article  Google Scholar 

  15. Rusu, R.B., Blodow, N., Beetz, M.: Fast point feature histograms (FPFH) for 3D registration. In: 2009 IEEE International Conference on Robotics and Automation, pp. 3212–3217, May 2009

    Google Scholar 

  16. Tsin, Y., Kanade, T.: A correlation-based approach to robust point set registration. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3023, pp. 558–569. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24672-5_44

    Chapter  Google Scholar 

  17. Wang, G., Chen, Y.: Fuzzy correspondences guided gaussian mixture model for point set registration. Knowl.-Based Syst. 136, 200–209 (2017)

    Article  Google Scholar 

  18. Yuan, X., Kong, L., Feng, D., Wei, Z.: Automatic feature point detection and tracking of human actions in time-of-flight videos. IEEE/CAA J. Automatica Sinica 4(4), 677–685 (2017)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amar Maharjan .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Maharjan, A., Yuan, X. (2020). Point Set Registration of Large Deformation Using Auxiliary Landmarks. In: Yuan, X., Elhoseny, M., Shi, J. (eds) Urban Intelligence and Applications. ICUIA 2020. Communications in Computer and Information Science, vol 1319. Springer, Singapore. https://doi.org/10.1007/978-981-33-4601-7_9

Download citation

  • DOI: https://doi.org/10.1007/978-981-33-4601-7_9

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-33-4600-0

  • Online ISBN: 978-981-33-4601-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics