Multimedia Tools and Applications

, Volume 78, Issue 21, pp 30943–30958 | Cite as

Multi-feature distance metric learning for non-rigid 3D shape retrieval

  • Huibing Wang
  • Haohao Li
  • Jinjia Peng
  • Xianping FuEmail author


In the past decades, feature-learning-based 3D shape retrieval approaches have been received widespread attention in the computer graphic community. These approaches usually explored the hand-crafted distance metric or conventional distance metric learning methods to compute the similarity of the single feature. The single feature always contains onefold geometric information, which cannot characterize the 3D shapes well. Therefore, the multiple features should be used for the retrieval task to overcome the limitation of single feature and further improve the performance. However, most conventional distance metric learning methods fail to integrate the complementary information from multiple features to construct the distance metric. To address these issue, a novel multi-feature distance metric learning method for non-rigid 3D shape retrieval is presented in this study, which can make full use of the complimentary geometric information from multiple shape features by utilizing the KL-divergences. Minimizing KL-divergence between different metric of features and a common metric is a consistency constraints, which can lead the consistency shared latent feature space of the multiple features. We apply the proposed method to 3D model retrieval, and test our method on well known benchmark database. The results show that our method substantially outperforms the state-of-the-art non-rigid 3D shape retrieval methods.


Multi-view learning Distance metric learning Non-rigid 3D shape retrieval 



This study was funded by the National Natural Science Foundation of China Grant 61370142 and Grant 61272368, by the Fundamental Research Funds for the Central Universities Grant 3132016352, by the Fundamental Research of Ministry of Transport of P.R. China Grant 2015329225300. Huibing Wang, Haohao Li and Xianping Fu declare that they have no conflict of interest. Huibing Wang and Haohao Li contribute equally to this article. This article does not contain any studies with human participants or animals performed by any of the authors.


  1. 1.
    Aubry M, Schlickewei U, Cremers D (2011) The wave kernel signature: A quantum mechanical approach to shape analysis. In: 2011 IEEE international conference on computer vision workshops (ICCV Workshops), pp 1626–1633. IEEEGoogle Scholar
  2. 2.
    Bronstein AM, Bronstein MM, Guibas LJ, Ovsjanikov M (2011) Shape google: Geometric words and expressions for invariant shape retrieval. ACM Trans Graph (TOG) 30(1):1Google Scholar
  3. 3.
    Bronstein MM, Kokkinos I (2010) Scale-invariant heat kernel signatures for non-rigid shape recognition. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR), pp 1704–1711. IEEEGoogle Scholar
  4. 4.
    Chiotellis I, Triebel R, Windheuser T, Cremers D (2016) Non-rigid 3d shape retrieval via large margin nearest neighbor embedding. In: European conference on computer vision, pp 327–342. SpringerGoogle Scholar
  5. 5.
    Davis JV, Kulis B, Jain P, Sra Suvrit, Dhillon IS (2007) Information-theoretic metric learning. In: Proceedings of the 24th international conference on Machine learning, pp 209–216. ACMGoogle Scholar
  6. 6.
    Hardoon DR, Szedmak Sr, Shawe-Taylor J (2004) Canonical correlation analysis: An overview with application to learning methods. Neural Comput 16(12):2639–2664zbMATHGoogle Scholar
  7. 7.
    Hu J, Lu J, Tan Y-P (2014) Discriminative deep metric learning for face verification in the wild. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1875–1882Google Scholar
  8. 8.
    Kan M, Shan S, Zhang H, Lao S, Chen X (2016) Multi-view discriminant analysis. IEEE Trans Pattern Anal Mach Intell 38(1):188–194Google Scholar
  9. 9.
    Kuang Z, Li Z, Lv Q, Weiwei T, Liu Y (2015) Modal function transformation for isometric 3d shape representation. Comput Graph 46:209–220Google Scholar
  10. 10.
    Kumar A, Rai P, Daume H (2011) Co-regularized multi-view spectral clustering. In: Advances in neural information processing systems, pp 1413–1421Google Scholar
  11. 11.
    Li C, Hamza BA (2013) Intrinsic spatial pyramid matching for deformable 3d shape retrieval. International Journal of Multimedia Information Retrieval 2(4):261–271Google Scholar
  12. 12.
    Li C, Hamza BA (2014) Spatially aggregating spectral descriptors for nonrigid 3d shape retrieval: a comparative survey. Multimed Syst 20(3):253–281Google Scholar
  13. 13.
    Lian Z (2015) Shrec’15 track: Non-rigid 3d shape retrievalGoogle Scholar
  14. 14.
    Lian Z, Godil A, Bustos B, Daoudi M, Hermans J, Kawamura S, Kurita Y, Lavoua G, Suetens PDP (2011) Shape retrieval on non-rigid 3d watertight meshes. In: Eurographics workshop on 3d object retrieval (3DOR)Google Scholar
  15. 15.
    Lian Z, Godil A, Bustos B, Daoudi M, Hermans J, Kawamura S, Kurita Y, Lavoué G, Van Nguyen H, Ohbuchi R et al (2013) A comparison of methods for non-rigid 3d shape retrieval. Pattern Recogn 46(1):449–461Google Scholar
  16. 16.
    Lian Z, Godil A, Fabry T, Furuya T, Hermans J, Ohbuchi R, Shu C, Smeets D, Suetens P, Vandermeulen D et al (2010) Shrec’10 track: Non-rigid 3d shape retrieval. 3DOR 10:101–108Google Scholar
  17. 17.
    Limberger FA (2017) Spectral signatures for non-rigid 3D shape retrieval. University of York, PhD thesisGoogle Scholar
  18. 18.
    Limberger FA, Wilson RC (2015) Feature encoding of spectral signatures for 3d non-rigid shape retrieval. In: BMVC, pp 56–1Google Scholar
  19. 19.
    Litman R, Bronstein A, Bronstein M, Castellani U (2014) Supervised learning of bag-of-features shape descriptors using sparse coding. In: Computer Graphics Forum, vol 33, pp 127–136. Wiley Online LibraryGoogle Scholar
  20. 20.
    Mika S, Ratsch Gr, Weston J, Scholkopf B, Mullers K-R (1999) Fisher discriminant analysis with kernels. In: Neural networks for signal processing IX, 1999. Proceedings of the 1999 IEEE signal processing society workshop., pages 41–48. IEEEGoogle Scholar
  21. 21.
    Ohbuchi R, Furuya T (2010) Distance metric learning and feature combination for shape-based 3d model retrieval. In: Proceedings of the ACM workshop on 3D object retrieval, pp 63–68. ACMGoogle Scholar
  22. 22.
    Pickup D, Sun X, Rosin PL, Martin RR, Cheng Z, Lian Z, Aono M, Hamza Ben A, Bronstein A, Bronstein M (2014) Shape retrieval of non-rigid 3d human models. In: Eurographics workshop on 3d object retrievalGoogle Scholar
  23. 23.
    Pinkall U, Polthier K (1993) Computing discrete minimal surfaces and their conjugates. Exp Math 2(1):15–36MathSciNetzbMATHGoogle Scholar
  24. 24.
    Reuter M, Wolter F-E, Peinecke N (2006) Laplace–beltrami spectra as ’shape-dna’of surfaces and solids. Comput Aided Des 38(4):342–366Google Scholar
  25. 25.
    Rustamov RM (2007) Laplace-beltrami eigenfunctions for deformation invariant shape representation. In: Proceedings of the 5th Eurographics symposium on Geometry processing, pp 225–233. Eurographics AssociationGoogle Scholar
  26. 26.
    Shilane P, Min P, Kazhdan M, Funkhouser T (2004) The princeton shape benchmark. In: Proceedings shape modeling applications, 2004., pp 167–178. IEEEGoogle Scholar
  27. 27.
    Sun J, Ovsjanikov M, Guibas L (2009) A concise and provably informative multi-scale signature based on heat diffusion. In: Computer graphics forum, vol 28, pp 1383–1392. Wiley Online LibraryGoogle Scholar
  28. 28.
    Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300Google Scholar
  29. 29.
    Wang H, Feng L, Zhang J, Liu Y (2016) Semantic discriminative metric learning for image similarity measurement. IEEE Trans Multimed 18(8):1579–1589Google Scholar
  30. 30.
    Wang Y, Lin X, Wu L, Zhang W, Qing Zhang. (2014) Exploiting correlation consensus: Towards subspace clustering for multi-modal data. In: Proceedings of the 22nd ACM international conference on Multimedia, pp 981–984. ACMGoogle Scholar
  31. 31.
    Wang Y, Lin X, Wu L, Zhang W (2017) Effective multi-query expansions: Collaborative deep networks for robust landmark retrieval. IEEE Transactions on Image ProcessingGoogle Scholar
  32. 32.
    Wang Y, Lin X, Wu L, Zhang W, Zhang Q, Huang X (2015) Robust subspace clustering for multi-view data by exploiting correlation consensus. IEEE Trans Image Process. 24(11):3939–3949MathSciNetzbMATHGoogle Scholar
  33. 33.
    Wang Y, Wu L (2018) Beyond low-rank representations: Orthogonal clustering basis reconstruction with optimized graph structure for multi-view spectral clustering. Neural Netw 103:1–8Google Scholar
  34. 34.
    Wang Y, Wu L, Lin X, Gao J (2018) Multiview spectral clustering via structured low-rank matrix factorization. IEEE Transactions on Neural Networks and Learning SystemsGoogle Scholar
  35. 35.
    Wang Y, Zhang W, Wu L, Lin X, Fang M, Pan S (2016) Iterative views agreement: An iterative low-rank based structured optimization method to multi-view spectral clustering. In: International joint conference on artificial intelligence (IJCAI)Google Scholar
  36. 36.
    Wang Y, Zhang W, Wu L, Lin X, Zhao X (2017) Unsupervised metric fusion over multiview data by graph random walk-based cross-view diffusion. IEEE Trans Neural Netw Learning Syst 28(1):57–70Google Scholar
  37. 37.
    Wang Yang, Lin Xuemin, Lin W u, expansions Wenjie Zhang. (2015) Effective multi-query Robust landmark retrieval. In: Proceedings of the 23rd ACM international conference on Multimedia, pp 79–88. ACMGoogle Scholar
  38. 38.
    Weinberger KQ, Saul LK (2009) Distance metric learning for large margin nearest neighbor classification. J Mach Learn Res 10(Feb):207–244zbMATHGoogle Scholar
  39. 39.
    Wold S, Esbensen K, Geladi P (1987) Principal component analysis. Chemom Intell Lab Syst 2(1-3):37–52Google Scholar
  40. 40.
    Wu L, Wang Y, Gao J, Li X (2018) Deep adaptive feature embedding with local sample distributions for person re-identification. Pattern Recogn 73:275–288Google Scholar
  41. 41.
    Wu L, Wang Y, Gao J, Li X (2018) Where-and-when to look: Deep siamese attention networks for video-based person re-identification. IEEE Transactions on MultimediaGoogle Scholar
  42. 42.
    Wu L, Wang Y, Li X, Gao J (2018) Deep attention-based spatially recursive networks for fine-grained visual recognition. IEEE Transactions on CyberneticsGoogle Scholar
  43. 43.
    Wu L, Wang Y, Li X, Junbin G (2018) What-and-where to match: Deep spatially multiplicative integration networks for person re-identification. Pattern Recogn 76:727–738Google Scholar
  44. 44.
    Wu L, Wang Y, Shao L (2019) Cycle-consistent deep generative hashing for cross-modal retrieval. IEEE Trans Image Process 28(4):1602–1612MathSciNetGoogle Scholar
  45. 45.
    Wu L, Wang Y, Shao L, Wang M (2018) 3d personvlad: Learning deep global representations for video-based person re-identification. arXiv:1812.10222
  46. 46.
    Wu P, Hoi SCH, Zhao P, Miao C, Liu Z-Y (2016) Online multi-modal distance metric learning with application to image retrieval. IEEE Trans Knowl Data Eng 28(2):454–467Google Scholar
  47. 47.
    Xie J, Dai G, Yi F (2017) Deep multimetric learning for shape-based 3d model retrieval. IEEE Trans Multimed 19(11):2463–2474Google Scholar
  48. 48.
    Xie J, Dai G, Zhu F, Wong EK, Fang Y (2017) Deepshape Deep-learned shape descriptor for 3d shape retrieval. IEEE Trans Pattern Anal Mach Intell 39 (7):1335–1345Google Scholar
  49. 49.
    Xu C, Tao D, Xu C (2013) A survey on multi-view learning. arXiv:1304.5634
  50. 50.
    Xu C, Tao D, Xu C (2015) Multi-view self-paced learning for clustering. In: IJCAI, pp 3974–3980Google Scholar
  51. 51.
    Zhai D, Chang H, Shan S, Chen X, Gao W (2012) Multiview metric learning with global consistency and local smoothness. ACM Transactions on Intelligent Systems and Technology (TIST) 3(3):53Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  • Huibing Wang
    • 1
  • Haohao Li
    • 2
  • Jinjia Peng
    • 1
  • Xianping Fu
    • 1
    Email author
  1. 1.College of Information and Science TechnologyDalian Maritime UniversityDalianChina
  2. 2.School of Mathematical SciencesDalian University of TechnologyDalianChina

Personalised recommendations