Abstract
The recent advances of low-cost and mobile depth sensors dramatically extend the potential of 3D shape retrieval and analysis. While the traditional research of 3D retrieval mainly focused on searching by a rough 2D sketch or with a high-quality CAD model, we tackle a novel and challenging problem of cross-domain 3D shape retrieval, in which users can use 3D scans from low-cost depth sensors like Kinect as queries to search CAD models in the database. To cope with the imperfection of user-captured models such as model noise and occlusion, we propose a cross-domain shape retrieval framework, which minimizes the potential function of a Conditional Random Field to efficiently generate the retrieval scores. In particular, the potential function consists of two critical components: one unary potential term provides robust cross-domain partial matching and the other pairwise potential term embeds spatial structures to alleviate the instability from model noise. Both potential components are efficiently estimated using random forests with 3D local features, forming a Regression Tree Field framework. We conduct extensive experiments on two recently released user-captured 3D shape datasets and compare with several state-of-the-art approaches on the cross-domain shape retrieval task. The experimental results demonstrate that our proposed method outperforms the competing methods with a significant performance gain.
Chapter PDF
Similar content being viewed by others
References
Tangelder, J.W., Veltkamp, R.C.: A Survey of Content based 3D Shape Retrieval Methods. Multimedia Tools and Applications 39(3), 441–471 (2008)
Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., Jacobs, D.: A Search Engine for 3D Models. ToG 22(1), 83–105 (2003)
Zeleznik, R.C., Herndon, K.P., Hughes, J.F.: SKETCH: An Interface for Sketching 3D Scenes. In: ACM SIGGRAPH 2007 Courses (2007)
Google Inc.: Project Tango, http://www.google.com/atap/projecttango/
Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., Dobkin, D.: Modeling by Example. ToG 23(3), 652–663 (2004)
Johnson, A., Hebert, M.: Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(5), 433–449 (1999)
Zaharescu, A., Boyer, E., Varanasi, K., Horaud, R.: Surface Feature Detection and Description with Applications to Mesh Matching. In: Proc. of CVPR, pp. 373–380 (2009)
Sun, J., Ovsjanikov, M., Guibas, L.: A Concise and Provably Informative Multi-Scale Signature Based on Heat Diffusion. Computer Graphics Forum 28(5), 1383–1392 (2009)
Kokkinos, I., Bronstein, M.M., Litman, R., Bronstein, A.M.: Intrinsic Shape Context Descriptors for Deformable Shapes. In: Proc. of CVPR, pp. 159–166 (2012)
Bronstein, A.M., Bronstein, M.M., Guibas, L.J., Ovsjanikov, M.: Shape Google: Geometric Words and Expressions for Invariant Shape Retrieval. ToG 30(1) (February 2011)
Bronstein, M., Kokkinos, I.: Scale-Invariant Heat Kernel Signatures for Non-Rigid Shape Recognition. In: Proc. of CVPR, pp. 1704–1711 (2010)
Machado, J., Ferreira, A., Pascoal, P.B., Abdelrahman, M., Aono, M., El-Melegy, M.T., Farag, A.A., Johan, H., Li, B., Lu, Y., Tatsuma, A.: Shrec’13 track: Retrieval of objects captured with low-cost depth-sensing cameras. In: Proc. of EuroGraphics 3DOR, pp. 65–71 (2013)
Philbin, J., Chum, O., Isard, M., Sivic, J., Zisserman, A.: Object Retrieval with Large Vocabularies and Fast Spatial Matching. In: Proc. of CVPR (2007)
Jancsary, J., Nowozin, S., Sharp, T., Rother, C.: Regression Tree Fields - an Efficient, Non-Parametric Approach to Image Labeling Problems. In: Proc. of CVPR, 2376–2383 (2012)
Dutagaci, H., Godil, A., Axenopoulos, A., Daras, P., Furuya, T., Ohbuchi, R.: SHREC’09 Track: Querying with Partial Models. In: Proc. of Eurographics 3DOR, 69–76 (2009)
Li, B., Lu, Y., Godil, A., Schreck, T., Bustos, B., Ferreira, A., Furuya, T., Fonseca, M.J., Johan, H., Matsuda, T., Ohbuchi, R., Pascoal, P.B., Saavedra, J.M.: A Comparison of Methods for Sketch-Based 3D Shape Retrieval. CVIU 119, 57–80 (2014)
Yoon, S.M., Scherer, M., Schreck, T., Kuijper, A.: Sketch-based 3D Model Retrieval Using Diffusion Tensor Fields of Suggestive Contours. In: Proc. of ACM Multimedia, pp.193–200 (2010)
Shao, T., Xu, W., Yin, K., Wang, J., Zhou, K., Guo, B.: Discriminative Sketch-based 3D Model Retrieval via Robust Shape Matching. Computer Graphics Forum (PG), 2011–2020 (2011)
Tung, T., Matsuyama, T.: Topology dictionary for 3d video understanding. TPAMI 34, 1645–1657 (2012)
Huang, P., Hilton, A., Starck, J.: Shape similarity for 3D video sequences of people. IJCV 89(2-3), 362–381 (2010)
Pickup, D., Sun, X., Rosin, P.L., Martin, R.R., Cheng, Z., Lian, Z., Aono, M., Ben Hamza, A., Bronstein, A., Bronstein, M., Bu, S., Castellani, U., Cheng, S., Garro, V., Giachetti, A., Godil, A., Han, J., Johan, H., Lai, L., Li, B., Li, C., Li, H., Litman, R., Liu, X., Liu, Z., Lu, Y., Tatsuma, A., Ye, J.: SHREC’14 track: Shape retrieval of non-rigid 3D human models. In: EG 3DOR (2014)
Wang, C., Bronstein, M.M., Bronstein, A.M., Paragios, N.: Discrete minimum distortion correspondence problems for non-rigid shape matching. In: Bruckstein, A.M., ter Haar Romeny, B.M., Bronstein, A.M., Bronstein, M.M. (eds.) SSVM 2011. LNCS, vol. 6667, pp. 580–591. Springer, Heidelberg (2012)
Chen, D.Y., Tian, X.P., Shen, Y.T., Ouhyoung, M.: On Visual Similarity Based 3D Model Retrieval. Computer Graphics Forum (EuroGraphics) 22(3), 223–232 (2003)
Daras, P., Axenopoulos, A.: A 3D shape retrieval framework supporting multimodal queries. IJCV 89(2-3), 229–247 (2010)
Darom, T., Keller, Y.: Scale-Invariant Features for 3-D Mesh Models. TIP 21(5), 2758–2769 (2012)
Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., Fitzgibbon, A.: KinectFusion: Real-time 3D Reconstruction and Interaction Using a Moving Depth Camera. In: Proc. of UIST, pp. 559–568 (2011)
Ohbuchi, R., Osada, K., Furuya, T., Banno, T.: Salient Local Visual Features for Shape-Based 3D Model Retrieval. In: Proc. of Shape Modeling and Applications, pp. 93–102 (June 2008)
Yilmaz, E., Aslam, J.A.: Estimating average precision with incomplete and imperfect judgments. In: Proc. of CIKM (2006)
Ben-Haim, Y., Tom-Tov, E.: A streaming parallel decision tree algorithm. JMLR 11, 849–872 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, Y., Feng, J., Wu, Z., Wang, J., Chang, SF. (2014). From Low-Cost Depth Sensors to CAD: Cross-Domain 3D Shape Retrieval via Regression Tree Fields. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds) Computer Vision – ECCV 2014. ECCV 2014. Lecture Notes in Computer Science, vol 8689. Springer, Cham. https://doi.org/10.1007/978-3-319-10590-1_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-10590-1_32
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10589-5
Online ISBN: 978-3-319-10590-1
eBook Packages: Computer ScienceComputer Science (R0)