Advertisement

Photo Uncrop

  • Qi Shan
  • Brian Curless
  • Yasutaka Furukawa
  • Carlos Hernandez
  • Steven M. Seitz
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8694)

Abstract

We address the problem of extending the field of view of a photo—an operation we call uncrop. Given a reference photograph to be uncropped, our approach selects, reprojects, and composites a subset of Internet imagery taken near the reference into a larger image around the reference using the underlying scene geometry. The proposed Markov Random Field based approach is capable of handling large Internet photo collections with arbitrary viewpoints, dramatic appearance variation, and complicated scene layout. We show results that are visually compelling on a wide range of real-world landmarks.

Keywords

Computational photography image based rendering 

References

  1. 1.
  2. 2.
    Agarwala, A., Agrawala, M., Cohen, M., Salesin, D., Szeliski, R.: Photographing long scenes with multi-viewpoint panoramas. SIGGRAPH (2006)Google Scholar
  3. 3.
    Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., Cohen, M.: Interactive digital photomontage. SIGGRAPH (2011)Google Scholar
  4. 4.
    Apple: iPhone 5 Specifications, http://support.apple.com/kb/sp655
  5. 5.
    Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: PatchMatch: A randomized correspondence algorithm for structural image editing. SIGGRAPH 28(3) (2009)Google Scholar
  6. 6.
    Delong, A., Osokin, A., Isack, H.N., Boykov, Y.: Fast approximate energy minimization with label costs. IJCV 96(1), 1–27 (2012)CrossRefzbMATHMathSciNetGoogle Scholar
  7. 7.
    Fay, D., Fay, J., Hoppe, H., Poulain, C.: Terapixel, http://research.microsoft.com/en-us/projects/terapixel/
  8. 8.
    Fuhrmann, S., Goesele, M.: Fusion of depth maps with multiple scales. SIGGRAPH Asia (2011)Google Scholar
  9. 9.
    Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: CVPR (2010)Google Scholar
  10. 10.
    Garg, R., Seitz, S.M.: Dynamic mosaics. 3DimPVT (2012)Google Scholar
  11. 11.
    Hays, J., Efros, A.A.: Scene completion using millions of photographs. SIGGRAPH 26(3) (2007)Google Scholar
  12. 12.
    He, K., Sun, J., Tang, X.: Guided image filtering. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part I. LNCS, vol. 6311, pp. 1–14. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  13. 13.
    Hertzmann, A., Jacobs, C.E., Oliver, N., Curless, B., Salesin, D.H.: Image analogies. SIGGRAPH (2001)Google Scholar
  14. 14.
    Jancosek, M., Pajdla, T.: Multi-view reconstruction preserving weakly-supported surfaces. In: CVPR (2011)Google Scholar
  15. 15.
    Kaneva, B., Sivic, J., Torralba, A., Avidan, S., Freeman, W.T.: Infinite images: Creating and exploring a large photorealistic virtual space. In: Proceedings of the IEEE (2010)Google Scholar
  16. 16.
    Kopf, J., Uyttendaele, M., Deussen, O., Cohen, M.F.: Capturing and viewing gigapixel images. SIGGRAPH 26(43) (2007)Google Scholar
  17. 17.
    Microsoft: Photosynth, http://photosynth.net/preview
  18. 18.
    Nomura, Y., Zhang, L., Nayar, S.: Scene collages and flexible camera arrays. In: Eurographics Symposium on Rendering (2007)Google Scholar
  19. 19.
    Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: ICCV (2009)Google Scholar
  20. 20.
    Rav-Acha, A., Engel, G., Peleg, S.: Minimal aspect distortion (MAD) mosaicing of long scenes. IJCV 78(2-3), 187–206 (2008)CrossRefGoogle Scholar
  21. 21.
    Richardt, C., Pritch, Y., Zimmer, H., Sorkine-Hornung, A.: Megastereo: Constructing high resolution stereo panoramas. In: CVPR (2013)Google Scholar
  22. 22.
    Shan, Q., Adams, R., Curless, B., Furukawa, Y., Seitz, S.M.: The visual Turing test for scene reconstruction. In: Joint 3DIM/3DPVT Conference (3DV) (2013)Google Scholar
  23. 23.
    Shum, H.Y., Szeliski, R.: Stereo reconstruction from multiperspective panoramas. In: ICCV (1999)Google Scholar
  24. 24.
    Whyte, O., Sivic, J., Zisserman, A.: Get out of my picture! internet-based inpainting. In: Proceedings of the 20th British Machine Vision Conference, London (2009)Google Scholar
  25. 25.
    Wu, C.: VisualSFM: A visual structure from motion system, http://ccwu.me/vsfm/
  26. 26.
    Zelnik-Manor, L., Peters, G., Perona, P.: Squaring the circle in panoramas. In: ICCV (2005)Google Scholar
  27. 27.
    Zhang, C., Gao, J., Wang, O., Georgel, P., Yang, R., Davis, J., Frahm, J.M., Pollefeys, M.: Personal photo enhancement using internet photo collections. TVCG (2014)Google Scholar
  28. 28.
    Zhang, Y., Xiao, J., Hays, J., Tan, P.: Framebreak: Dramatic image extrapolation by guided shift-maps. In: CVPR (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Qi Shan
    • 1
  • Brian Curless
    • 1
  • Yasutaka Furukawa
    • 2
  • Carlos Hernandez
    • 3
  • Steven M. Seitz
    • 1
    • 3
  1. 1.University of WashingtonSeattleUSA
  2. 2.Washington University in St. LouisSt. LouisUSA
  3. 3.Google Inc.Mountain ViewUSA

Personalised recommendations