Selectively densified 3D object modeling based on regions of interest detection using neural gas networks
The paper discusses automated solutions for 3D object modeling at multiple resolutions in the context of virtual reality. An original solution, based on an unsupervised neural network, is proposed to guide the creation of selectively densified meshes. A neural gas network, applied over a sparse density object mesh, adapts its nodes during training to capture the embedded shape of the object. Regions of interest are then identified as areas with higher density of nodes in the adapted neural gas map. Meshes at different level of detail for an object, which preserve these regions of interest, are constructed by adapting a classical simplification algorithm, the QSlim. The simplification process will therefore only affect the regions of lower interest, ensuring that the characteristics of an object are preserved even at lower resolutions. Various interest point detectors are incorporated in selectively densified meshes in a similar manner to enable the comparison with the proposed neural gas approach. A novel solution based on learning is proposed to select the number of faces for the discrete models of an object at different resolutions. Finally, selectively densified object meshes are incorporated in a discrete level-of-detail method for presentation in virtual reality applications.
KeywordsNeural gas 3D object models Interest point detectors Mesh simplification
The authors thank H. Monette-Thériault for his help with the implementation of the adapted QSlim algorithm.
Compliance with ethical standards
The authors acknowledge the support to this research from the Natural Sciences and Engineering Research Council of Canada, under the Discovery Grant RGPIN-2014-04953.
Conflict of interest
The authors declare that there is no conflict of interest related to this work.
Human and animal rights
This article does not contain any studies with human participants performed by any of the authors.
- A Benchmark for 3D Interest Points Marked by Human Subjects [Online]. http://www.itl.nist.gov/iad/vug/sharp/benchmark/3DInterestPoint/
- Castellani U, Cristiani M, Fantoni S, Murino V (2008) Sparse points matching by combining 3D mesh saliency with statistical descriptors. Eurographics 27(2):643–652Google Scholar
- Cignoni P, Rocchini C, Scopigno R (1998) Metro: measuring error on simplified surfaces. Comput Graph Forum 17(2):167–174. [AAOnline]. http://vcg.isti.cnr.it/activities/surfacegrevis/simplification/
- CloudCompare—3D Point Cloud and Mesh Processing Software, Open Source Project [Online]. http://www.danielgm.net/cc/
- Cretu A-M (2009) Experimental data acquisition and modeling of 3D deformable objects. Ph.D. Thesis, University of OttawaGoogle Scholar
- Garland M, Heckbert PS (1997) Surface simplification using quadric error meshes. In: Proceedings of ACM Siggraph 97, pp 209–216Google Scholar
- Godil A, Wagan AI (2011) Salient local 3D features for 3D shape retrieval. In: Beraldin, JA, Cheok GS, McCarthy MB, Neuschaefer-Rube U, Baskurt AM, McDowall IE, Dolinsky M (eds) Three-dimensional imaging, interaction, and measurement. Proceedings of the SPIE, vol 7864. San Francisco, USA, pp 78640S-1–78640S-8Google Scholar
- Ho T-C, Lin Y-C, Chuang J-H, Peng C-H, Cheng Y-J (2006) User-assisted mesh simplification. In: Proceedings of ACM international conference on virtual reality continuum and its applications, pp 59–66Google Scholar
- Kho Y, Garland M (2003) User-guided simplification. In: Proceedings of ACM symposium on interactive 3D graphics, pp 123–126Google Scholar
- Leifman G, Shtrom E, Tal A (2012) Surface regions of interest for viewpoint selection. IEEE conference on computer vision and pattern recognition, pp 414–421Google Scholar
- Liu Y-S, Liu M, Kihara D, Ramani K (2007) Salient critical points for meshes. ACM symposium on solid and physical modelling, pp 277–282Google Scholar
- Luebke D, Reddy M, Cohen JD, Varshney A, Watson B, Huebner R (2003) Level of detail for 3D graphics. In: The Morgan Kaufmann Series in Computer Graphics and Geometric Modeling. Elsevier, San FranciscoGoogle Scholar
- Monette-Thériault H, Cretu A-M, Payeur P (2014) 3D object modeling with neural gas based selective densification of surface meshes. IEEE international conference on systems, man, and cybernetics, pp 1373–1378, San Diego, USGoogle Scholar
- Novatnack J, Nishino K (2007) Scale-dependent 3D geometric features. IEEE international conference on computer vision, pp 1–8Google Scholar
- Payeur P, Curtis P, Cretu A-M (2013) Computational methods for selective acquisition of depth measurements in machine perception. IEEE international conference on systems, man, and cybernetics, pp 876–881, Manchester, UKGoogle Scholar
- Peyre G (2007) Toolbox graph. [Online]. http://www.mathworks.com/matlabcentral/fileexchange/5355-toolbox-graph
- Pojar E, Schmalstieg D (2003) User-controlled creation of multiresolution meshes. In: Proceedings of ACM symposium on interactive 3D graphics, pp 127–130Google Scholar
- Sipiran I, Bustos B (2010) A robust 3D interest points detector based on Harris operator. Eurographics workshop on 3D object retrieval, pp 7–14Google Scholar
- Song R, Liu Y, Zhao Y, Martin RR, Rosin PL (2012) Conditional random field-based mesh saliency. IEEE international conference on image processing, pp 637–640Google Scholar
- Sun J, Ovsjanikov M, Guibas L (2009) A concise and provably informative multi-scale signature based on heat diffusion. Eurograph Symp Geom Process 28(5):1383–1392Google Scholar
- Yang Y-B, Lu T, Lin J-J (2009) Saliency regions for 3D mesh abstraction. In: Muneesawang P et al (eds) Advances in multimedia information processing, LNCS 5879, pp 292–299Google Scholar
- Zaharescu A, Boyer E, Varanasi K, Horaud R (2009) Surface feature detection and description with applications to mesh matching. IEEE international conference on computer vision and pattern recognition, pp 373–380Google Scholar
- Zhao Y, Liu Y, Song R, Zhang M (2012) Extended non-local means filter for surface saliency detection. IEEE international conference on image processing, pp 633–636Google Scholar
- Zhao Y, Liu Y, Song R, Zhang M (2013a) A Retinex theory based points sampling method. Int J Comput Inf Syst Ind Manag Appl 5:1–10Google Scholar
- Zhao Y, Liu Y, Zeng Z (2013b) Using region-based saliency for 3D interest points detection. In: Wilson R et al (eds) CAIP 2013, Part II, LNCS 8048, pp 108–116Google Scholar