Skip to main content
SpringerLink
Log in

An Interactive Indoor 3D Reconstruction Method Based on Conformal Geometry Algebra

  • Published:
Advances in Applied Clifford Algebras Aims and scope Submit manuscript

Abstract

This paper presents an approach for indoor reconstruction using smartphones. The smartphones sensors are used for measuring the azimuth angle and pitch angle. With these angles, the rooms of the indoor scene are effectively reconstructed. Then the separately reconstructed models are aligned together to form a complete model. Meanwhile, the conformal geometry algebra is used as computing framework. Comparing to other reconstruction approaches, the use of conformal geometry algebra not only simplifies the construction of geometry, but also unifies the representation of all kinds of geometry relations. Remarkably the proposed approach does not need to take photos during the reconstruction process, and it requires only a little clicking on the developed mobile application to build the model. To verify the proposed approach, a typical apartment was chosen as experiment environment. Result from the experiment suggests that the proposed approach is very efficient and suitable for mobile platform.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bayro-Corrochano, E., Zhang, Y.: The motor extended kalman filter: a geometric approach for rigid motion estimation. J. Math. Imaging Vis. 13(3), 205–228 (2000)

    Article  MathSciNet  Google Scholar 

  2. Bayrocorrochano, E., Reyeslozano, L., Zamoraesquivel, J.: Conformal geometric algebra for robotic vision. J. Math. Imaging Vis. 24(1), 55–81 (2006)

    Article  MathSciNet  Google Scholar 

  3. Bernal-Marin, M., Bayro-Corrochano, E.: Integration of hough transform of lines and planes in the framework of conformal geometric algebra for 2d and 3d robot vision. Pattern Recogn. Lett. 32(16), 2213–2223 (2011)

    Article  Google Scholar 

  4. Cabral, R., Furukawa, Y.: Piecewise planar and compact floorplan reconstruction from images. In: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR ’14, pp 628–635, Washington, DC, USA. IEEE Computer Society (2014)

  5. Choi, W., Chao, Y.W., Caroline, P., Silvio S.: Understanding indoor scenes using 3d geometric phrases. In: Computer Vision and Pattern Recognition, pp. 33–40 (2013)

  6. Dang, T.K., Worring, M.: A semi-interactive panorama based 3d reconstruction framework for indoor scenes. Comput. Vis. Image Underst. 115(11), 1516–1524 (2011)

    Article  Google Scholar 

  7. Farin, D., Effelsberg, W., de With, P.H.N.: Floor-plan reconstruction from panoramic images. In: Proceedings of the 15th ACM International Conference on Multimedia, MM ’07, pp. 823–826, New York, NY, USA. ACM (2007)

  8. Farin, D., De With, P.H.N.: Reconstructing virtual rooms from panoramic images. Symposium on Information Theory in the Benelux (2005)

  9. Flint, A., Murray, D., Reid, I.: Manhattan scene understanding using monocular, stereo, and 3d features. In: International Conference on Computer Vision, pp. 2228–2235 (2011)

  10. Furlan, A., Miller, S., Sorrenti, D.G., Li, F.F., Savarese, S.: Free your camera: 3d indoor scene understanding from arbitrary camera motion. In: BMVC 2013—British Machine Vision Conference (2013)

  11. Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Manhattan-world stereo. In: Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on pp. 1422–1429 (2009)

  12. Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Reconstructing building interiors from images. In: IEEE International Conference on Computer Vision, pp. 80–87 (2009)

  13. Gupta, A., Hebert, M., Kanade, T., Blei, D.M.: Estimating spatial layout of rooms using volumetric reasoning about objects and surfaces. Advances in Neural Information Processing Systems, pp. 1288–1296 (2010)

  14. Haeusler, R., Klette, R., Huang, F.: Monocular 3d reconstruction of objects based on cylindrical panoramas. In: Wada, T., Huang, F., Lin, S. (eds.), Advances in Image and Video Technology, pp. 60–70, Berlin, Heidelberg. Springer Berlin Heidelberg (2009)

    Chapter  Google Scholar 

  15. Hedau, V.: Recovering free space of indoor scenes from a single image. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR ’12, pp. 2807–2814, Washington, DC, USA. IEEE Computer Society (2012)

  16. Hedau, V., Hoiem, D., Forsyth, D.: Recovering the spatial layout of cluttered rooms. In: IEEE International Conference on Computer Vision, pp. 1849–1856 (2010)

  17. Hedau, V., Hoiem, D., Forsyth, D.: Thinking inside the box: using appearance models and context based on room geometry, volume 6316 LNCS of Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), pp. 224–237. Part 6 edition, 11 (2010)

    Chapter  Google Scholar 

  18. Isikdag, U., Zlatanova, S., Underwood, J.: A bim-oriented model for supporting indoor navigation requirements. Comput Environ Urban Syst 41(3), 112–123 (2013)

    Article  Google Scholar 

  19. Jo, S., Kwon, Y.-M., Ko, H.: Indoor environment modeling for interactive vr—based robot security service. In: Pan, Zhigeng., Cheok, Adrian., Haller, Michael., Lau, Rynson W. H., Saito, Hideo., Liang, Ronghua. editors, Advances in Artificial Reality and Tele-Existence, pp. 1253–1262, Berlin, Heidelberg. Springer Berlin Heidelberg (2006)

  20. Kermgard, B., Fried, D., Bowdish, J., Del Pero, L., Hartley, E., Barnard, K.: Bayesian geometric modeling of indoor scenes. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 2719–2726 (2012)

  21. Lee, D.C., Hebert, M., Kanade, T.: Geometric reasoning for single image structure recovery. In: Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on pp. 2136–2143 (2009)

  22. Luo, W., Hu, Y., Yu, Z., Yuan, L., Lü, G.: A hierarchical representation and computation scheme of arbitrary-dimensional geometrical primitives based on CGA. Adv. Appl. Clifford Algebras 27(3), 1977–1995 (2017). https://doi.org/10.1007/s00006-016-0697-3

    Article  MathSciNet  MATH  Google Scholar 

  23. Nakagawa, M., Yamamoto, T., Tanaka, S., Shiozaki, M., Ohhashi, T.: Topological 3d modeling using indoor mobile lidar data. ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. XL–4/W5(4), 13–18 (2015)

    Article  Google Scholar 

  24. Ozisik, N.D., Lopeznicolas, G., Guerrero, J.J.: Scene structure recovery from a single omnidirectional image. Iccv Workshops 28(5), 359–366 (2011)

    Google Scholar 

  25. Ramalingam, S., Brand, M.: Lifting 3d manhattan lines from a single image. In: IEEE International Conference on Computer Vision, pp. 497–504 (2013)

  26. Ramalingam, S., Pillai, J.K., Jain, A., Taguchi, Y.: Manhattan junction catalogue for spatial reasoning of indoor scenes. In: Proceedings / CVPR, IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 3065–3072, 06 (2013)

  27. Sankar, A., Seitz, S.: Capturing indoor scenes with smartphones. In: ACM Symposium on User Interface Software and Technology, pp. 403–412 (2012)

  28. Schwing, A.G.: Efficient structured prediction for 3d indoor scene understanding. In: Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), CVPR ’12, pp. 2815–2822, Washington, DC, USA. IEEE Computer Society (2012)

  29. Scopigno, R.: Mobile reconstruction and exploration of indoor structures exploiting omnidirectional images. In: SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications, p 1 (2016)

  30. Shum, H.Y.: A stereo reconstruction from mutiperspective panoramas. IEEE Trans. Pattern Anal. Mach. Intell. 26(1), 45–62 (2004)

    Article  MathSciNet  Google Scholar 

  31. Siemiatkowska, B., Harasymowicz-Boggio, B., Przybylski, M., Różańska-Walczuk, M., Wiśniowski, M., Kowalski, M.: Bim based indoor navigation system of hermes mobile robot. In: Padois, Vincent., Bidaud, Philippe., Khatib, Oussama. editors, Romansy 19—Robot Design, Dynamics and Control, pages 375–382, Vienna. Springer Vienna (2013)

    Chapter  Google Scholar 

  32. Sinha, S.N., Steedly, D., Szeliski, R., Agrawala, M., Pollefeys, M.: Interactive 3d architectural modeling from unordered photo collections. Int. Conf Comput Graph Interact. Tech. 27(5), 159 (2008)

    Google Scholar 

  33. Tang, F., Ren, A.: Gis-based 3d evacuation simulation for indoor fire. Build. Environ. 49(1), 193–202 (2012)

    Article  Google Scholar 

  34. Weiss C., Zell A.: Automatic generation of Indoor VR-models by a mobile robot with a laser range finder and a color camera. In: Levi P., Schanz M., Lafrenz R., Avrutin V. (eds.) Autonome mobile systeme 2005, pp. 107–113. Springer, Berlin, Heidelberg (2006). https://doi.org/10.1007/3-540-30292-1_14

  35. Wu, B., Zhang, S.: Integration of gis and bim for indoor geovisual analytics. Int. Arch. Photogramm. Remote Sens. XLI–B2, 455–458 (2016)

    Article  Google Scholar 

  36. Xu, D., Jin, P., Zhang, X., Du, J., Yue, L.: Extracting indoor spatial objects from cad models: a database approach. In: International Conference on Database Systems for Advanced Applications, pp. 273–279 (2015)

    Chapter  Google Scholar 

  37. Yang, H., Zhang, H.: Modeling room structure from indoor panorama. In: Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI ’14, pp. 47–55, New York, NY, USA. ACM (2014)

  38. Zhaoyuan, Y., Luo, W., Yuan, L., Yong, H., Zhu, A.X., Guonian, L.: Geometric algebra model for geometryoriented topological relation computation. Trans. GIS 20(2), 259–279 (2016)

    Article  Google Scholar 

  39. Zhaoyuan, Y., Wang, J., Luo, W., Yong, H., Yuan, L., Guonian, L.: A dynamic evacuation simulation framework based on geometric algebra. Comput. Environ. Urban Syst. 59, 208–219 (2016)

    Article  Google Scholar 

  40. Zhang, Y., Song, S., Tan, P., Xiao, J.: Panocontext: a whole-room 3d context model for panoramic scene understanding. In Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T (eds), Computer Vision—ECCV 2014, pp. 668–686, Cham. Springer International Publishing (2014)

    Google Scholar 

Download references

Acknowledgements

Funding for this research was provided by the Natural Science Foundation of China (Project No. 41625004) and the National key research and development program of China (Project No. 2017YFB0503500).

Author information

Authors and Affiliations

  1. Key Laboratory of Virtual Geographic Environment, Nanjing Normal University, Ministry of Education Nanjing, Jiangsu, CN, 210023, China

    Niantao Liu, Bingxian Lin, Linwang Yuan, Guonian Lv, Zhaoyuan Yu & Liangchen Zhou

  2. State Key Laboratory Cultivation Base of Geographical Environment Evolution Nanjing, Jiangsu, CN, 210023, China

    Niantao Liu, Bingxian Lin, Linwang Yuan, Guonian Lv, Zhaoyuan Yu & Liangchen Zhou

  3. Jiangsu Center for Collaborative Innovation in Geographical Information Resource Development and Application Nanjing, Jiangsu, CN, 210023, China

    Niantao Liu, Bingxian Lin, Linwang Yuan, Guonian Lv, Zhaoyuan Yu & Liangchen Zhou

Authors
  1. Niantao Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bingxian Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Linwang Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Guonian Lv
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Zhaoyuan Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Liangchen Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Liangchen Zhou.

Additional information

This article is part of the Topical Collection on Geometric Algebra for Computing, Graphics and Engineering edited by Yu Zhaoyuan, Dietmar Hildenbrand, Kit Ian Kou, Eckhard Hitzer.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, N., Lin, B., Yuan, L. et al. An Interactive Indoor 3D Reconstruction Method Based on Conformal Geometry Algebra. Adv. Appl. Clifford Algebras 28, 73 (2018). https://doi.org/10.1007/s00006-018-0880-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00006-018-0880-9

Mathematics Subject Classification

Keywords

Search

Navigation