Abstract
This work offers an overview of the state-of-the-art on the emerging area of 3D object retrieval based on partial queries. This research area is associated with several application domains, including face recognition and digital libraries of cultural heritage objects. The existing partial 3D object retrieval methods can be mainly classified as: i) view-based, ii) part-based, iii) bag of visual words (BoVW)-based, and iv) hybrid methods combining these three main paradigms or methods which cannot be straightforwardly classified. Several methodological aspects are identified, including the use of interest points and the exploitation of 2.5D projections, whereas the available evaluation datasets and campaigns are addressed. A thorough discussion follows, identifying advantages and limitations.
Similar content being viewed by others
References
Adan A, Merchan P, Salamanca S (2011) 3D scene retrieval and recognition with depth gradient images. Patt Rec Lett 32(9):1337–1353
Agathos A, Pratikakis I, Papadakis P, Perantonis S, Azariadis P, Sapidis S (2010) 3D articulated object retrieval using a graph-based representation. Vis Comp 26(10):1301–1319
Agathos A, Pratikakis I, Perantonis S, Sapidis N (2009) Protrusion-oriented 3D mesh segmentation. Vis Comp 26(1):63–81
Akgul C, Axenopoulos A, Bustos B, Chaouch M, Daras P, Dutagaci H, Furuya T, Godil A, Kreft S, Lian Z, Napoleon T, Mademlis A, Ohbuchi R, Rosin PL, Sankur B, Schreck T, Sun X, Tezuka M, Yemez Y, Verroust-Blondet A, Walter M (2009) SHREC 2009 track: generic shape retrieval contest. Proc. Eurographics, 3DOR workshop
Atmosukarto I, Shapiro LG (2013) 3D object retrieval using salient views. Int J Mult Inform Retr 2:103–115
Axenopoulos A, Daras P, Dutagaci H, Furuya T, Godil A, Ohbuchi R (2009) SHREC 2009: shape retrieval contest of partial 3D models. Proc. Eurographics, 3DOR workshop
Biasotti S, Marini S, Spagnuolo M, Falcidieno B (2006) Sub-part correspondence by structural descriptors of 3D shapes. Comput-Aid Design 38(9):1002–1019
Biederman I (1987) Recognition-by-components: a theory of human image understanding. Psychol Rev 94(2):115–147
Bosch A, Zisserman A, Munoz X (2007) Image graphiclassification using random forests and ferns. Proc ICCV: 1–8
Bronstein AM, Bronstein MM, Guibas LJ, Ovsjanikov M (2011) Shape google: geometric words and expressions for invariant shape retrieval. ACM TOG 30(1):1–20
Chaouch M, Verroust-Blondet A (2006) Enhanced 2D/3D approaches based on relevance index for 3D-shape retrieval. Proc SMI: 36
Chen H, Bhanu B (2004) 3D free-form object recognition in range images using local surface patches. Proc ICPR 3:136–139
Chen H, Bhanu B (2007) 3D free-form object recognition in range images using local surface patches. Patt Rec Lett 28(10):1252–1262
Chen D-Y, Ouhyoung M, Tian X-P, Shen Y-T, Ouhyoung M (2003) On visual similarity based 3d model retrieval. Proc. Eurographics, 3DOR workshop: 223–232
Cornea ND, Demirci MF, Silver D, Shokoufandeh A, Dickinson S, Kantor PB (2005) 3D object retrieval using many-to-many matching of curve skeletons. Proc IEEE SMI: 366–371
Correa S, Shapiro L (2001) A new signature-based method for efficient 3-D object recognition. Proc. IEEE CVPR 1:769–776
Daras P, Axenopoulos A (2009) A compact multi-view descriptor for 3D object retrieval. Proc. CBMI, 115–119
Daras P, Axenopoulos A (2009) A 3D shape retrieval framework supporting multimodal queries. Int J Comp Vis 89:229–247
Daras P, Zarpalas D, Tzovaras D, Strintzis MG (2006) Efficient 3-d model search and retrieval using generalized 3-d radon transforms. IEEE Trans Multimedia 8(1):101–114
Dorai C, Jain A (1997) COSMOS-A representation scheme for 3D free-form objects. IEEE Trans Patt Anal Mach Intell 19(10):1115–1130
Dutagaci H, Godil A, Axenopoulos A, Daras P, Furuya T, Ohbuchi R (2009) SHREC 2009 track: querying with partial models. Proc. Eurographics, 3DOR workshop: 69–76
Dutagaci H, Godil A, Cheung CP, Furuya T, Hillenbrand U, Ohbuchi R (2010) SHREC 2010 track: range scan retrieval. Proc. Eurographics, 3DOR workshop: 109–115
Eberhart RC, Hu X (1999) Human tremor analysis using Particle Swarm Optimization. Proc Congress on Evol Comput: 1927–1930
Furuya T, Ohbuchi R (2009) Dense sampling and fast encoding for 3D model retrieval using bag-of-visual features. Proc ACM Int Conf Imag Vid Retriev
Gal R, Shamir A, Cohen-Or D (2007) Pose oblivious shape signature. IEEE Trans Vis Comput Graph 13(2):261–271
Gao Y, Dai Q, Wang M, Zhang N (2011) 3D model retrieval using weighted bipartite graph matching. Signal Process: Image Commun 26:39–47
Gao Y, Dai Q, Zhang N-Y (2010) 3D Model comparison using spatial structure circular descriptor. Pattern Recogn 43(3):1142–1151
Gao Y, Tang J, Hong R, Yan S, Dai Q, Zhang N, Chua T-S (2012) Camera constraint-free view-based 3-D object retrieval. IEEE Trans Image Process 21(4):2269–2281
Gao Y, Tang J, Li H, Dai Q, Zhang N (2010) View-based 3D model retrieval with probabilistic graph model. Neurocomputing 73(10–12):1900–1905
Gao Y, Wang M, Ji R, Wu X, Dai Q (2014) 3-D object retrieval with Hausdorff distance learning. IEEE Trans Ind Electron 61(4):2088–2098
Gao Y, Wang M, Shen J, Dai Q, Zhang N (2010) Intelligent query: open another door to 3D object retrieval. Proc ACM Multimedia: 1711–1714
Gao Y, Wang M, Tao D, Ji R, Dai Q (2012) 3-D object retrieval and recognition with hypergraph analysis. IEEE Trans Image Process 21(9):4290–4303
Gao Y, Wang M, Zha Z-J, Tian Q, Dai Q, Zhang N (2011) Less is more: efficient 3-D object retrieval with query view selection. IEEE Trans Multimedia 13(5):1007–1018
Gao Y, Yang Y, Dai Q, Zhang N (2010) 3D object retrieval with bag-of-region-words. Proc ACM Multimedia: 955–958
Germann M, Breirenstein MD, Park IK, Pfister H (2007) Automatic pose estimation for range images on the GPU. Proc 3D Digital Imaging and Modeling: 81–90
Giorgi D, Biasotti S, Paraboschi L (2007) SHREC 2007 track: shape retrieval-watertight models, Proc. Eurographics, 3DOR workshop
Guerts P, Ernst D, Wehenkel L (2006) Extremely randomized trees. Mach Learn 36(1):3–42
Hartveldt J, Spagnuolo M, Axenopoulos A, Biasotti S, Daras P, Dutagaci H, Furuya T, Godil A, Li X, Mademlis A, Marini S, Napoleon T, Ohbuchi R, Tezuka M (2009) SHREC 2009 track: structural shape retrieval on watertight models. Proc. Eurographics, 3DOR workshop
Hetzel G, Keibe B, Levi P, Schiele B (2001) 3D object recognition from range images using local feature histograms. Proc IEEE CVPR 2:394–399
Hoffman DD, Singh M (1997) Salience of visual parts. Cognition 63(1):29–78
Jayanti S, Kalyanaraman Y, Iyer N, Ramani K (2006) Developing an engineering shape benchmark for cad models. Comput Aided Des 38:939–953
Johnson AE, Hebert M (1999) Using spin images for efficient object recognition in cluttered 3D scenes. IEEE Trans Patt Anal Mach Intell 21(5):433–449
Kazhdan M, Funkhouser T, Rusinkiewicz S (2003) Rotation invariant spherical harmonic representation of 3D shape descriptors. Proc Eurographics/ACM SIGGRAPH Symp Geom Process: 156–164
Kim DH, Park IK, Yun ID, Lee SU (2004) A new MPEG-7 standard: perceptual 3D shape descriptor. Proc Pacific Rim Conf Multimedia: 238–245
Koutsoudis A (2013) A 3D pottery content based retrieval benchmark dataset. http://www.ipet.gr/˜akoutsou/benchmark
Lavoué G (2012) Combination of bag-of-words descriptors for robust partial shape retrieval. Vis Comput 28(9):931–942
Li F, Dai Q, Xu W, Er G (2010) Statistical modeling and many-to-many matching for view-based 3D object retrieval. Signal Process Image Commun 25(1):18–27
Li B, Godil A, Joham H (2013) Hybrid shape descriptor and meta similarity generation for non-rigid and partial 3D model retrieval. Accepted to Multimed Tools Appl
Li P, Ma H, Ming A (2013) Combining topological and view-based features for 3D model retrieval. Multimed Tools Appl 65:335–361
Lian Z, Rosin PL, Sun X (2010) Rectilinearity of 3D meshes. Int J Comput Vis 89(2):130–151
Lowe D (2004) Distinctive image features from scale-invariant keypoint. IJCV 60(2):91–110
Marini S, Paraboschi L, Biasotti S (2007) Proc IEEE SMI, SHREC 2007 track: partial matching: 13–16
Marton ZC, Rusu RB, Beetz M (2009) On fast surface reconstruction methods for large and noisy datasets. Proc IEEE ICRA: 2829–2834
Mian AS, Bennamoun M, Owens R (2006) Three-dimensional model-based object recognition and segmentation in cluttered scenes. IEEE Trans Patt Anal Mach Intell 28(10):1584–1601
O’Hara S, Draper BA (2011) Introduction to the bag of features paradigm form image classification and retrieval, arXiv. doi 1101.3354
Ohbuchi R, Osada K, Furuya T, Banno T (2008) Salient local visual features for shape-based 3D model retrieval, Proc. IEEE SMI: 93–102
Ohbuchi R, Osada K, Furuya T, Banno T (2008) Salient local visual features for shape-based 3D model retrieval. Proc IEEE SMI: 93–102
Ohkita Y, Ohishi Y, Furuya T, Ohbuchi R (2012) Non-rigid 3D model retrieval using set of local statistical features. Proc IEEE Multim Expo Workshops: 593–598
Papadakis P, Pratikakis I, Perantonis S, Theoharis T (2007) Efficient 3D shape matching and retrieval using a concrete radicalized spherical projection representation. Patt Rec 40(9):2437–2452
Papadakis P, Pratikakis I, Theoharis T, Passalis G, Perantonis S (2008) 3D object retrieval using an efficient and compact hybrid shape descriptor. Proc Eurographics, 3DOR workshop
Papadakis P, Pratikakis I, Theoharis T, Perantonis SJ (2010) PANORAMA: A 3D shape descriptor based on panoramic views for unsupervised 3D object retrieval. Int J Comp Vis 89(2–3):177–192
Pauly M, Mitra NJ, Giesen J, Guibas L, Gross M (2005) Example-based 3D scan completion. Proc. Symp Geometry Processing: 23–32
Pu J, Ramani K (2005) An approach to drawing-like view generation from 3D models. Proc. IDETC/CIE, ASME
Sfikas K, Pratikakis I, Koutsoudis A, Savelonas M, Theoharis T (2013) 3D object partial matching using panoramic views. Proc ICIAP, MMC4H workshop, Naples, Italy
Shilane P, Min P, Kazhdan M, Funkhouser T (2004) The Princeton shape benchmark. Shape Modeling International
Siddiqi K, Zhang J, Macrini D, Shokoufandeh A, Bouix S, Dickinson S (2008) Retrieving articulated 3D models using medial surfaces. Mach Vis Appl 19(4):261–274
Sipiran I, Meruane R, Bustos B, Schreck T, Johan H, Li B, Lu Y (2013) SHREC 2013 track: large-scale partial shape retrieval using simulated range images. Proc. Eurographics, 3DOR workshop: 81–88
Stavropoulos G, Moschonas P, Moustakas K, Tzovaras D, Strintzis MG (2010) 3D model search and retrieval from range images using salient features. IEEE Trans Multim 12(7):692–704
Tierny J, Vandeborre JP, Daoudi M (2008) Enhancing 3D mesh topological skeletons with discrete contour constrictions. Vis Comput 24(3):155–172
Tierny J, Vandeborre J, Daoudi M (2009) Partial 3D shape retrieval by Reeb pattern unfolding. Comput Graph For 28(1):41–55
Toldo R, Castellani U, Fusiello A (2009) Visual vocabulary signature for 3D object retrieval and partial matching. Proc Eurographics, 3DOR workshop. 21–28
Veltkamp RC, Giezeman G-J, Bast H, Baumbach T, Furuya T, Giesen J, Godil A, Lian Z, Ohbuchi R, Saleem W (2010) SHREC 2010 Track: Large Scale Retrieval. Proc. Eurographics, 3DOR workshop. 63–69
Vranic D (2004) 3D model retrieval. PhD thesis, University of Leipzig, Germany
Wahl E, Hillenbrand U, Hirzinger G (2003). Surflet-pair-relation histograms: a statistical 3D-shape representation for rapid classification, Proc 3DIM. 474–481
Wang M, Gao Y, Lu K, Rui Y (2013) View-based discriminative probabilistic modeling for 3D object retrieval and recognition. IEEE Trans Image Process 22(4):1395–1407
Wang F, Li F, Dai Q, Er G (2008) View-based 3D object retrieval and recognition using tangent subspace analysis. Proc. SPIE 6822, Visual Communications and Image Processing
Wen Y, Gao Y, Hong R, Luan H, Liu Q, Shen J, Ji R (2012) View-based 3D object retrieval by bipartite graph matching. Research Collection School of Information Systems. 897–900
Zarpalas D, Daras P, Axenopoulos A, Tzovaras D, Strintzis MG (2007) 3D model search and retrieval using the spherical trace transform. EURASIP J Adv Sig Proc
Zhou K, Gong M, Huang X, Guo B (2011) Data-parallel octrees for surface reconstruction. IEEE Trans Vis Graph 17(5):669–681
Acknowledgments
This study received funding from the European Union’s Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 600533 PRESIOUS.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Savelonas, M.A., Pratikakis, I. & Sfikas, K. An overview of partial 3D object retrieval methodologies. Multimed Tools Appl 74, 11783–11808 (2015). https://doi.org/10.1007/s11042-014-2267-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2267-9