Multimedia Tools and Applications

, Volume 76, Issue 10, pp 12757–12774 | Cite as

BUILDUP: interactive creation of urban scenes from large photo collections

Article

Abstract

We propose a system for creating images of urban scenes composed of the large structures typical in such environments. Our system provides the user with a precomputed library of image-based 3D objects, such as roads, sidewalks and buildings, obtained from a large collection of photographs. When the user picks the 3D location of a new object to insert, the system retrieves objects that have all the required properties (location, orientation and lighting). Then, the user interface guides the user to add more objects enabling non-experts to make a new composition in a fast and intuitive way. Unlike prior work, the entire image composition process is done in the 3D space of the scene, therefore inconsistent scale or perspective distortion does not arise, and occlusions are properly handled.

Keywords

Image databases 3D scene composition Picture generation 

Supplementary material

(MP4 17.6 MB)

(MP4 5.98 MB)

References

  1. 1.
    Agarwala A, Dontcheva M, Agrawala M, Drucker S, Colburn A, Curless B, Salesin D, Cohen M (2004) Interactive digital photomontage. ACM Trans Graph 23(3):294–302CrossRefGoogle Scholar
  2. 2.
    Bangor A, Kortum PT, Miller JT (2008) An empirical evaluation of the system usability scale. Int J Hum Comput Interact 24(6):574–594CrossRefGoogle Scholar
  3. 3.
    Branit B (2007) World builder. https://www.youtube.com/watch?v=QP3YywgRx5A
  4. 4.
    Brooke J (1996) SUS-A quick and dirty usability scale. Usability evaluation in industry. CRC PressGoogle Scholar
  5. 5.
    Chen T, Cheng MM, Tan P, Shamir A, Hu SM (2009) Sketch2photo: internet image montage. In: ACM SIGGRAPH Asia 2009 papers, vol 28, pp 124:1–124:10. ACM, New York, NY, USAGoogle Scholar
  6. 6.
    Diakopoulos N, Essa I, Jain R (2004) Content based image synthesis. In: Proc. of international conference on image and video retrieval, pp 299–307Google Scholar
  7. 7.
    Efros AA, Freeman WT (2001) Image quilting for texture synthesis and transfer. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, SIGGRAPH ’01, pp 341–346. ACM, New York, NY, USAGoogle Scholar
  8. 8.
    Eitz M, Richter R, Hildebrand K, Boubekeur T, Alexa M (2011) Photosketcher: interactive sketch-based image synthesis. IEEE Comput Graph ApplGoogle Scholar
  9. 9.
    Hays J, Efros AA (2007) Scene completion using millions of photographs. ACM Trans Graph 26(3)Google Scholar
  10. 10.
    Hu SM, Chen T, Xu K, Cheng MM, Martin RR (2013) Internet visual media processing: a survey with graphics and vision applications. Vis Comput 29(5):393–405CrossRefGoogle Scholar
  11. 11.
    Johnson M, Brostow GJ, Shotton J, Arandjelović O, Kwatra V, Cipolla R (2006) Semantic photo synthesis. Comput Graphics Forum 25(3):407–413CrossRefGoogle Scholar
  12. 12.
    Johnson MK, Dale K, Avidan S, Pfister H, Freeman WT, Matusik W (2011) Cg2real: Improving the realism of computer generated images using a large collection of photographs. IEEE Trans Vis Comput Graph 17(9):1273–1285CrossRefGoogle Scholar
  13. 13.
    Kwatra V, Schödl A, Essa I, Turk G, Bobick A (2003) Graphcut textures: image and video synthesis using graph cuts. In: ACM SIGGRAPH 2003 Papers, vol 22, pp 277–286. ACM, New York, NY, USAGoogle Scholar
  14. 14.
    Lalonde JF, Hoiem D, Efros AA, Rother C, Winn J, Criminisi A (2007) Photo clip art. In: ACM SIGGRAPH 2007 Papers, vol 26. ACM, New York, NY, USAGoogle Scholar
  15. 15.
    Pérez P, Gangnet M, Blake A (2003) Poisson image editing. ACM Trans Graph 22(3):313–318CrossRefGoogle Scholar
  16. 16.
    Reinhard E, Efros AA, Kautz J, Seidel HP (2013) On visual realism of synthesized imagery. Proc IEEE 101(9):1998–2007CrossRefGoogle Scholar
  17. 17.
    Russell BC, Torralba A (2009) Building a database of 3d scenes from user annotations. In: IEEE Conference on computer vision and pattern recognition (CVPR), pp 2711–2718Google Scholar
  18. 18.
    Russell BC, Torralba A, Murphy KP, Freeman WT (2008) Labelme: a database and web-based tool for image annotation. Int J Comput Vis 77(1-3):157–173CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.Institute of New Imaging TechnologiesUniversitat Jaume ICastellonSpain
  2. 2.Universidad de ZaragozaZaragozaSpain
  3. 3.University of California at BerkeleyBerkeleyUSA

Personalised recommendations