Abstract
In this paper, we propose an efficient method for 3D model retrieval using a single depth image. Unlike existing algorithms that use a complete 3D model or a user sketch as input queries, a single depth image is used as an input query, which can be captured easily with an off-the-shelf lowcost 3D camera, such as a Kinect camera. 3D models in the database are represented by multiple depth images acquired from adaptively sampled viewpoints. The proposed algorithm can retrieve relevant 3D models while considering local 3D geometric characteristics using a rotation-invariant feature descriptor. The proposed method consists of three steps: preprocessing, multiple depth image based representation (M-DIBR), and description of 3D models, and similarity measurement and comparison. Experimental results demonstrate that the proposed algorithm is convenient to use and its performance is comparable to recent algorithms in terms of retrieval accuracy and speed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Chaouch, A., Verroust, A.: A new descriptor for 2d depth image indexing and 3D model retrieval. In: Proc. of IEEE International Conference on Image Processing, pp. 373–376 (2007)
Daras, P., Axenopoulos, A.: A 3D shape retrieval framework supporting multimodal queries. Int. J. Comput. Vis. 89(2), 229–247 (2010)
Eitz, M., Richter, R., Boubekeur, T., Hildebrand, K.: Sketch-based shape retrieval. ACM Trans. Graph. 31(4), 31:1–31:10 (2012)
Funkhouser, T., Min, P., Kazhdan, M., Chen, J., Halderman, A., Dobkin, D., Jacobs, D.: A search engine for 3D models. ACM Trans. Graph. 22(1), 83–105 (2003)
Google: 3D Warehouse. http://sketchup.google.com/3dwarehouse
Heczko, M., Keim, D., Saupe, D., Vranic, D.: Method for similarity search on 3D databases. Datenbank Spektrum 2(2), 54–63 (2002)
Hilaga, M., Shinagawa, Y., Kohmura, T.: Topology matching for fully automatic similarity estimation of 3D shapes. In: Proc. of ACM SIGGRAPH, pp. 203–212 (2001)
Horn, B.: Extended Gaussian images. Proc. IEEE 72(12), 1671–1686 (1984)
Khotanzad, A.: Invariant image recognition by Zernike moments. IEEE Trans. Pattern Anal. Mach. Intell. 12(5), 489–497 (1990)
Loop, C.T.: Smooth subdivision surfaces based on triangles. M.S. thesis, Department of Mathematics, University of Utah (1987)
Maslyuk, L., Igntenko, A., Zhirkov, A., Konushin, A., Park, I.K., Han, M., Bayakovski, Y.: Depth image-based representation and compression for static and animated 3D objects. IEEE Trans. Circuits Syst. Video Technol. 14(7), 1032–1045 (2004)
Microsoft: Kinect. http://www.microsoft.com/en-us/kinectforwindows
NVIDIA Corporation: Compute Unified Device Architecture (CUDA). http://developer.nvidia.com/object/cuda.html
Ohbuchi, R., Nakazawa, M., Takei, T.: Retrieving 3D models shapes based on their appearance. In: Proc. of ACM SIGMM International Workshop on Multimedia Information Retrieval, pp. 39–45 (2003)
Ohbuchi, R., Osada, K., Furuya, T., Banno, T.: Salient local visual features for shape-based 3D model retrieval. In: Proc. of IEEE International Conference on Image Processing, pp. 93–102 (2008)
Osada, R., Funkhouser, T., Chazelle, B., Dobkin, D.: Shape distributions. ACM Trans. Graph. 21(4), 807–832 (2002)
Paquet, E., Rioux, M., Murching, A., Naveen, T., Tabatabai, A.: Description of shape information for 2-d and 3-d objects. Signal Process. Image Commun. 16(1–2), 103–122 (2000)
Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., Toyama, K.: Digital photography with ash and no-ash image pairs. ACM Trans. Graph. 23(3), 664–672 (2004)
Rother, C., Kolmogorov, V., Blake, A.: Grabcut: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23(3), 309–314 (2004)
Shih, J., Hsing, C., Wang, J.: A new 3D model retrieval approach based on the elevation descriptor. Pattern Recognit. 40(1), 283–295 (2007)
Shilane, P.: The Princeton shape benchmark. In: Proc. of International Conference on Shape Modeling and Applications, pp. 167–178 (2004)
Sundar, H., Silver, D., Gragvani, N., Dickenson, S.: Skeleton based shape matching and retrieval. In: Proc. of International Conference on Shape Modeling and Applications, pp. 130–139 (2003)
Tangelder, J.W., Veltkamp, R.C.: A survey of content based 3D shape retrieval methods. Multimed. Tools Appl. 39(3), 441–471 (2008)
Tung, T., Schmitt, F.: Augmented reeb graphs for content-based retrieval of 3D mesh models. In: Proc. of International Conference on Shape Modeling and Applications, pp. 157–166 (2004)
Vajramushti, N., Kakadiaris, I.A., Theoharis, T., Papaioannou, G.: Efficient 3D object retrieval using depth images. In: Proc. of ACM SIGMM International Workshop on Multimedia Information Retrieval, pp. 189–196 (2004)
Acknowledgements
This research was supported by the MKE (The Ministry of Knowledge Economy), NHN Corp., under IT/SW Creative research program supervised by the NIPA (National IT Industry Promotion Agency) (NIPA-2012-(H0505-12-1003)). This research was supported by the Basic Science Research Program through the National Research Foundation of Korea funded by the Ministry of Education, Science, and Technology (2012R1A1A2009495).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Bae, M.S., Park, I.K. Content-based 3D model retrieval using a single depth image from a low-cost 3D camera. Vis Comput 29, 555–564 (2013). https://doi.org/10.1007/s00371-013-0819-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-013-0819-z