Abstract
The definition of reliable shape descriptors is an essential topic for 3D object retrieval. In general, two main approaches are considered: global, and local. Global approaches are effective in describing the whole object, while local ones are more suitable to characterize small parts of the shape. Recently some strategies to combine these two approaches have been proposed which are mainly concentrated to the so-called bag of words paradigm. With this paper we address this problem and propose an alternative strategy that goes beyond the bag of word approach. In particular, a sparse coding technique is exploited for the 3D domain: a set of local shape descriptors are collected from the shape, and then a dictionary is trained as generative model. In this fashion the dictionary is used as global shape descriptor for shape retrieval purposes. Several experiments are performed on standard databases in order to evaluate the proposed method in challenging situations like the case of ‘SHREC 2011: robustness benchmark’ where strong shape transformations are included, and the case of ‘SHREC 2007: partial matching track’ where composite models are considered in the query phase. A drastic improvement of the proposed method is observed by showing that sparse coding approach is particularly suitable for local-to-global description and outperforms other approaches such as the bag of words.
Similar content being viewed by others
References
Aubry, M., Schlickewei, U., Cremens, D.: The wave kernel signature: a quantum mechanical approach to shape analysis. In: Proc. of ICCV Workshop Dyn. Shape Capture Anal. (4DMOD) (2011)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Trans. Pattern Anal. Mach. Intell. 24(24), 509–522 (2002)
Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)
Boscaini, D., Castellani, U.: Local signature quantization by sparse coding. In: Eurographics Workshop on 3D Object Retr. (2013)
Boyer, E., Bronstein, A.M., Bronstein, M.M., Bustos, B., Darom, T., Horaud, R.: SHREC 2011: robust feature detection and description benchmark. Proc. of Eurographics Workshop 3D Object Retr. (3DOR) (2011)
Bronstein, A.M., Bronstein, M.M., Guibas, L.J., Ovsjanikov, M.: Shape google: geometric words and expressions for invariant shape retrieval. ACM Trans. Graph. (TOG) 30(1), 1–20 (2011)
Bronstein, A.M., Bronstein, M.M., Kimmel, R.: Numerical Geometry of Non-rigid Shapes, Monographs in Computer Science. Springer, New York (2008)
Bronstein, M.M., Kokkinos, I.: Scale-invariant heat kernel signature for non-rigid shape recognition. In: Proc. Comput. Vis. Pattern Recognit. (CVPR), pp. 1704–1711 (2010)
Castellani, U., Bartoli, A.: 3D shape registration. 3D Imaging, Analysis, and Applications. Springer, Berlin (2012)
Castellani, U., Cristani, M., Murino, V.: Statistical 3D shape analysis by local generative descriptors. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 33, 2555–2560 (2011)
Castellani, U., Mirtuono, P., Murino, V., Bellani, M., Rambaldelli, G., Tansella, M., Brambilla, P.: A new shape diffusion descriptor for brain classification. . In: Medical Image Computing and Computer-Assisted Intervention (MICCAI), Lecture Notes in Computer Science, vol 6892. Springer, Berlin, pp 426–433 (2011)
Darom, T., Keller, Y.: Scale-invariant features for 3-D mesh models. IEEE Trans. Image Process. 21(5), 2758–2769 (2012)
Elad, A., Kimmel, R.: On bending invariant signatures for surfaces. Trans. Pattern Anal. Mach. Intell. 25(10), 1285–1295 (2003)
Funkhouser, T., Kazhdan, M., Min, P., Shilane, P.: Shape-based retrieval and analysis of 3D models. Commun. ACM 48, 58–64 (2005)
Johnson, A.E., Hebert, M.: Using spin images for efficient object recognition in cluttered 3-D scenes. IEEE Trans. Pattern Anal. Mach. Intell. 21(5), 433–449 (1999)
Lavoue, G.: Combination of bag-of-words descriptors for robust partial shape retrieval. Vis. Comput. 26, 1257–1268 (2012)
Lévy, B.: Laplace–Beltrami eigenfunctions: towards an algorithm that “understands” geometry. In: IEEE Int. Conf. on Shape Model. Appl. (2006)
Lian, Z., Godil, A., Bustos, B., Daoudi, M., et al.: SHREC 2011 track: shape retrieval on non-rigid 3D watertight meshes. In: Proceedings of the Eurographics Workshop on 3D Object Retrieval, pp. 79–88 (2011)
Lian, Z., Godil, A., Bustos, B., et al.: A comparison of methods for non-rigid 3D shape retrieval. Pattern Recognit. 46(1), 449–461 (2013)
Lian, Z., Godil, A., Fabry, T., T., F., et al.: SHREC 2010: Non-rigid 3D shape retrieval. In: Proc. Eurographics Workshop 3D Object Retr. (3DOR) (2010)
Litman, R., Bronstein, A.M.: Learning spectral descriptors for deformable shape correspondence. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 171–180 (2014)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Mairal, J., Bach, F., Ponce, J., Sapiro, G.: Online dictionary learning for sparse coding. In: Proc. Int. Conf. Mach. Learn. (ICML), pp. 689–696 (2009)
Mairal, J., Bach, F., Ponce, J., Sapiro, G.: Online learning for matrix factorization and sparse coding. J. Mach. Learn. Res. 11, 19–60 (2010)
Marini, S., Paraboschi, L., Biasotti, S.: Shape retrieval contest 2007 (SHREC07): Partial matching track. technical report 10/07, IMATI (2007)
Mitra, N.J., Guibas, L., Giesen, J., Pauly, M.: Probabilistic fingerprints for shapes. In: Symposium on Geometry Processing, pp. 121–130 (2006)
Ovsjanikov, M., Ben-Chen, M., Solomon, J., Butscher, A., Guibas, L.: Functional Maps: A flexible representation of maps between shapes. ACM Trans. Graph. 31(4), 30:1–30:11 (2012)
Pokrass, J., Bronstein, A.M., Bronstein, M.M., Sprechmann, P., Sapiro, G.: Sparse modeling of intrinsic correspondences. Comput. Graph. Forum 32(2), 459G–468 (2013)
Reuter, M., Wolter, F.E., Peinecke, N.: Laplace–Beltrami spectra as ‘shape-DNA’ of surfaces and solids. Comput.-Aided Des. 38, 342–366 (2006)
Rustamov, R.M.: Laplace–Beltrami eigenfunctions for deformation invariant shape representation. In: Eurographics Symp. Geom. Process., pp. 225–233 (2007)
Schölkopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. The MIT Press, Cambridge (2002)
Sumner, R.W., Popović, J.: Deformation transfer for triangle meshes. ACM Trans. Graph. (TOG) 23, 399–405 (2004)
Sun, J., Ovsjanikov, M., Guibas, L.: A concise and provably informative multi-scale signature based on heat diffusion. In: Proc. Symp. Geom. Process., pp. 1383–1392 (2009)
Tangelder, J.W., Veltkamp, R.C.: A survey of content based 3D shape retrieval methods. In: Int. Conf. Shape Modell. Appl., pp. 145–156 (2004)
Tibshirani, R.: Regression shrinkage and selection via the Lasso. J. R. Stat. Soc. pp. 267–288 (1996)
Toldo, R., Castellani, U., Fusiello, A.: The bag of words approach for retrieval and categorization of 3D objects. Vis. Comput. 26, 1257–1268 (2010)
Veltkamp, R.C., Haar, F.B.: Shrec 2007: 3D shape retrieval contest. Tech. Rep. UU-CS-2007-015, Department of Information and Computing Sciences, Utrecht University (2007)
Wuhrer, S., Azouz, Z.B., Shu, C.: Posture invariant surface description and feature extraction. In: IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 374–381 (2010)
Acknowledgments
We would like to thank Alex and Michael Bronstein for useful suggestions and fruitful discussions.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Boscaini, D., Castellani, U. A sparse coding approach for local-to-global 3D shape description. Vis Comput 30, 1233–1245 (2014). https://doi.org/10.1007/s00371-014-0938-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-014-0938-1