Skip to main content
SpringerLink
Log in

Procedure-based component and architecture modeling from a single image

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

This paper advocates a new component-aware framework to reconstruct 3D architecture from a single image. Different from existing work, our motivation is to obtain a complete set of semantically correct 3D architectural components, which enables part reusability towards rapid model reproduction and facilitates model variation. The core of our system is a novel algorithm to adaptively segment repeated curved stripes (e.g., roof tiles, building floors) into individual elements, based on which 3D dimensions as well as architectural components are derived from a single image. Specially for Chinese architectures, we further devise an interactive method to identify outer columns based on user-specified inner columns. Finally, 3D components are generated and shape rules are derived, from which the buildings and their variants are constructed. Our new component-aware framework minimizes the use of data resource (i.e., one single image) and emphasizes component utility during rapid 3D architecture reproduction by advocating a component-aware approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30
Fig. 31

Similar content being viewed by others

References

  1. Zheng, Q., Sharf, A., Wan, G., Li, Y., Mitra, N.J., Cohen-Or, D., Chen, B.: Non-local scan consolidation for 3d urban scenes. ACM Trans. Graph. 29, 94:1–94:9 (2010)

  2. Poullis, C., You, S.: Photorealistic large-scale urban city model reconstruction. IEEE Trans. Vis. Comput. Graph. 15, 654–669 (2009)

    Article  Google Scholar 

  3. Xiao, J., Fang, T., Zhao, P., Lhuillier, M., Quan, L.: Image-based street-side city modeling. ACM Trans. Graph. 28(5), 1–12 (2009)

    Article  Google Scholar 

  4. Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1434–1441 (2010)

  5. Musialski, P., Wimmer, M., Wonka, P.: Interactive coherence-based façade modeling, Computer Graphics Forum (Proceedings of EUROGRAPHICS 2012) 31(2), 661–670 (2012)

  6. AlHalawani, S., Yang, Y.-L., Liu, H., Mitra, N.J.: Interactive facades analysis and synthesis of semi-regular facades. Comput. Graph. Forum 32(2), 215–224 (2013)

    Article  Google Scholar 

  7. Musialski, P., Wonka, P., Aliaga, D.G., Wimmer, M., van Gool, L., Purgathofer, W.: A survey of urban reconstruction. In: EUROGRAPHICS 2012 State of the Art Reports, Eurographics Association, pp. 146–177 (2012)

  8. Wonka, P., Wimmer, M., Sillion, F., Ribarsky, W.: Instant architecture. ACM Trans. Graph. 22(3), 669–677 (2003)

    Article  Google Scholar 

  9. Müller, P., Wonka, P., Haegler, S., Ulmer, A., Van Gool, L.: Procedural modeling of buildings. ACM Trans. Graph. 25(3), 614–623 (2006)

    Article  Google Scholar 

  10. Lipp, M., Wonka, P., Wimmer, M.: Interactive visual editing of grammars for procedural architecture. ACM Trans. Graph. 27(3), 1–10 (2008)

    Article  Google Scholar 

  11. Talton, J.O., Lou, Y., Lesser, S., Duke, J., Měch, R., Koltun, V.: Metropolis procedural modeling. ACM Trans. Graph. 30(2), 11:1–11:14 (2011)

  12. Hou, F., Qi, Y., Qin, H.: Drawing-based procedural modeling of chinese architectures. IEEE Trans. Vis. Comput. Graph. 18(1), 30–42 (2012)

    Article  Google Scholar 

  13. Kelly, T., Wonka, P.: Interactive architectural modeling with procedural extrusions. ACM Trans. Graph. 30, 14:1–14:15 (2011)

  14. Merrell, P., Manocha, D.: Model synthesis: a general procedural modeling algorithm. IEEE Trans. Vis. Comput. Graph. 17(6), 715–728 (2011)

    Article  Google Scholar 

  15. Bokeloh, M., Wand, M., Seidel, H.-P.: A connection between partial symmetry and inverse procedural modeling. ACM Trans. Graph. 29, 104:1–104:10 (2010)

  16. Goesele, M., Snavely, N., Curless, B., Hoppe, H., Seitz, S.M.: Multi-view stereo for community photo collections. In: ICCV, pp. 1–8 (2007)

  17. Agarwal, S., Snavely, N., Simon, I., Seitz, S., Szeliski, R.: Building rome in a day. In: IEEE International Conference on Computer Vision, pp. 72–79 (2009)

  18. Pollefeys, M., Nistér, D., Frahm, J.M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.J., Merrell, P., Salmi, C., Sinha, S., Talton, B., Wang, L., Yang, Q., Stewénius, H., Yang, R., Welch, G., Towles, H.: Detailed real-time urban 3d reconstruction from video. Int. J. Comput. Vis. 78, 143–167 (2008)

    Article  Google Scholar 

  19. Sinha, S.N., Steedly, D., Szeliski, R., Agrawala, M., Pollefeys, M.: Interactive 3d architectural modeling from unordered photo collections. ACM Trans. Graph. 27(5), 159:1–159:10 (2008)

  20. Xiao, J., Fang, T., Tan, P., Zhao, P., Ofek, E., Quan, L.: Image-based façade modeling. ACM Trans. Graph. 27(5), 161:1–161:10 (2008)

  21. Zhao, P., Fang, T., Xiao, J., Zhang, H., Zhao, Q., Quan, L.: Rectilinear parsing of architecture in urban environment. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 342–349 (2010)

  22. Vanegas, C., Aliaga, D., Beneš, B.: Building reconstruction using manhattan-world grammars. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 358–365 (2010)

  23. Ceylan, D., Mitra, N.J., Zheng, Y., Pauly, M.: Coupled structure-from-motion and 3d symmetry detection for urban facades. ACM Trans. Graph. 33(1), 2:1–2:15 (2014)

  24. Hong, W., Yang, A.Y., Huang, K., Ma, Y.: On symmetry and multiple-view geometry: structure, pose, and calibration from a single image. Int. J. Comput. Vis. 60, 241–265 (2004)

    Article  Google Scholar 

  25. Liebowitz, D., Criminisi, A., Zisserman, A.: Creating architectural models from images. In: Annual Conference of the European Association for Computer Graphics (Eurographics), vol. 18, pp. 39–50 (1999)

  26. Wilczkowiak, M., Sturm, P., Boyer, E.: Using geometric constraints through parallelepipeds for calibration and 3d modeling. IEEE Trans. Pattern Anal. Mach. Intell. 27(2), 194–207 (2005)

    Article  Google Scholar 

  27. Jiang, N., Tan, P., Cheong, L.-F.: Symmetric architecture modeling with a single image. ACM Trans. Graph. 28(5), 1–8 (2009)

    Article  Google Scholar 

  28. Wu, C., Frahm, J., Pollefeys, M.: Repetition-based dense single-view reconstruction. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3113–3120 (2011)

  29. Chen, X., Kang, S.B., Xu, Y.-Q., Dorsey, J., Shum, H.-Y.: Sketching reality: realistic interpretation of architectural designs. ACM Trans. Graph. 27(2), 1–15 (2008)

    Article  Google Scholar 

  30. Prasad, M., Fitzgibbon, A.: Single view reconstruction of curved surfaces. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 1345–1354 (2006)

  31. Zhang, Z., Liang, X., Ma, Y.: Unwrapping low-rank textures on generalized cylindrical surfaces. In: Proceedings of the 2011 International Conference on Computer Vision, IEEE Computer Society, Washington, DC, USA, pp. 1347–1354 (2011)

  32. Liu, Y., Hel-Or, H., Kaplan, C.S., Gool, L.J.V.: Computational symmetry in computer vision and computer graphics. Found. Trends Comput. Graph. Vis. 5(1–2), 1–195 (2010)

    MATH  Google Scholar 

  33. Mitra, N.J., Pauly, M., Wand, M., Ceylan, D.: Symmetry in 3d geometry: extraction and applications. Comput. Graph. Forum 32(6), 1–23 (2013)

    Article  Google Scholar 

  34. Müller, P., Zeng, G., Wonka, P., Van Gool, L.: Image-based procedural modeling of facades. ACM Trans. Graph. 26(3), 85 (2007)

    Article  Google Scholar 

  35. Wu, C., Frahm, J.-M., Pollefeys, M.: Detecting large repetitive structures with salient boundaries. In: Proceedings of the 11th European conference on Computer vision: Part II, ECCV’10, Springer, Berlin, Heidelberg, pp. 142–155 (2010)

  36. C.-H. Shen, S.-S. Huang, H. Fu, S.-M. Hu, Adaptive partitioning of urban facades, ACM Trans. Graph. 30 (6) (2011) 184:1–184:10

  37. Hartley, R.I., Zisserman, A.: Multiple view geometry in computer vision, 2nd Edn. Cambridge University Press. ISBN: 0521540518 (2004)

  38. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Trans. Graph. 22, 277–286 (2003)

    Article  Google Scholar 

Download references

Acknowledgments

The authors would like to thank the anonymous reviewers for their constructive comments that help improve this paper. This work is supported in part by National Natural Science Foundation of China (Grant No. 61300068, 61190120, 61190121, 61190125, 61300067, 61272348, 61202235, 61073078), National Science Foundation of USA (Grant No. IIS-0949467, IIS-1047715, and IIS-1049448), the National High-tech R&D Program of China (Grant No. 012AA011503), Postdoctoral Science Foundation of China (Grant No. 2013M530512), Ph.D. Program Foundation of Ministry of Education of China (Grant No. 20111102110018), National Key Technology R&D Program of China (Grant No. 2014BAK18B01).

Author information

Authors and Affiliations

  1. State Key Laboratory of Virtual Reality Technology and Systems, Beihang University, Beijing, China

    Fei Hou & Yue Qi

  2. School of Computer Engineering, Nanyang Technological University, Singapore, Singapore

    Fei Hou

  3. Department of Computer Science, New York University (SUNY Stony Brook), New York, USA

    Hong Qin

Authors
  1. Fei Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hong Qin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yue Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fei Hou.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 27647 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hou, F., Qin, H. & Qi, Y. Procedure-based component and architecture modeling from a single image. Vis Comput 32, 151–166 (2016). https://doi.org/10.1007/s00371-015-1061-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-015-1061-7

Keywords

Search

Navigation