Building hierarchical structures for 3D scenes with repeated elements
- 41 Downloads
We propose a novel hierarchy construction algorithm for 3D scenes with repeated elements, such as classrooms with multiple desk–chair pairs. Most existing algorithms focus on scenes such as bedrooms or living rooms, which rarely contain repeated patterns. Consequently, such methods may not recognize repeated patterns, which are vital for understanding the structure and context of scenes such as classrooms. Therefore, we propose a new global optimization algorithm for recognizing repeated patterns and building hierarchical structures based on repeated patterns. First, we find a repeated template by calculating the coverage ratios and frequencies of many substructures in a scene. Once the repeated template has been determined, a minimum cost maximum flow problem can be solved to find all instances (repetitions) of it in the scene and then group objects accordingly. Second, we group objects in the region outside the repeated elements according to their adjacency. Finally, based on these two sets of results, we build the hierarchy of the entire scene. We test this hierarchy construction algorithm on the Princeton and SceneNN databases and show that our algorithm can correctly find repeated patterns and construct a hierarchy that is more similar to the ground truth than the results of previous methods.
Keywords3D scene Scene analysis Hierarchy Repeated patterns
This study was funded by the National Natural Science Foundation of China (61602366) and the China Postdoctoral Science Foundation (2015M582664).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
- 1.Ahuja, N., Todorovic, S.: Extracting texels in 2.1D natural textures. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8 (2007)Google Scholar
- 2.Alhashim, I., Li, H., Xu, K., Cao, J., Ma, R., Zhang, H.: Topology-varying 3D shape creation via structural blending. ACM Trans. Gr. (TOG) 33(4), 158 (2014)Google Scholar
- 3.Bokeloh, M., Wand, M., Seidel, H.P.: A connection between partial symmetry and inverse procedural modeling. ACM Trans. Gr. (TOG) 29(4), 104 (2010)Google Scholar
- 6.Fisher, M., Savva, M., Hanrahan, P.: Characterizing structural relationships in scenes using graph kernels. ACM Trans. Gr. (TOG) 30, 34 (2011)Google Scholar
- 11.Hueting, M., Monszpart, A., Mellado, N.: MCGraph: multi-criterion representation for scene understanding. In: SIGGRAPH Asia 2014 Indoor Scene Understanding Where Graphics Meets Vision, p. 3. ACM (2014)Google Scholar
- 12.Kalogerakis, E., Chaudhuri, S., Koller, D., Koltun, V.: A probabilistic model for component-based shape synthesis. ACM Trans. Gr. (TOG) 31(4), 55 (2012)Google Scholar
- 17.MacDonald, D., Lang, J., McAllister, M.: Evaluation of colour image segmentation hierarchies. In: The 3rd Canadian Conference on Computer and Robot Vision, 2006, p. 27 (2006)Google Scholar
- 18.Mitra, N., Wand, M., Zhang, H.R., Cohen-Or, D., Kim, V., Huang, Q.X.: Structure-aware shape processing. In: SIGGRAPH Asia 2013 Courses, SA ’13, pp. 1:1–1:20. ACM, New York (2013)Google Scholar
- 19.Moulin, M., Dutré, P.: On the use of local ray termination for efficiently constructing qualitative BSPs, BIHs and (S)BVHs. Vis. Comput. (2018). https://doi.org/10.1007/s00371-018-1575-x
- 21.Paraboschi, L., Biasotti, S., Falcidieno, B.: 3D scene comparison using topological graphs. In: Eurographics Italian Chapter Conference, pp. 87–93 (2007)Google Scholar
- 23.Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., Cohen-Or, D.: Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering. ACM Trans. Gr. (TOG) 30, 126 (2011)Google Scholar
- 24.Wang, Y., Xu, K., Li, J., Zhang, H., Shamir, A., Liu, L., Cheng, Z., Xiong, Y.: Symmetry hierarchy of man-made objects. In: Computer Graphics Forum, vol. 30, pp. 287–296. Wiley Online Library (2011)Google Scholar
- 25.Xu, K., Ma, R., Zhang, H., Zhu, C., Shamir, A., Cohen-Or, D., Huang, H.: Organizing heterogeneous scene collections through contextual focal points. ACM Trans. Gr. (TOG) 33(4), 35 (2014)Google Scholar
- 27.Zhao, X., Hu, R., Guerrero, P., Mitra, N., Komura, T.: Relationship templates for creating scene variations. ACM Trans. Gr. 35(6), 207:1–207:13 (2016)Google Scholar