Image-Based 4-d Reconstruction Using 3-d Change Detection

  • Ali Osman Ulusoy
  • Joseph L. Mundy
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8691)


This paper describes an approach to reconstruct the complete history of a 3-d scene over time from imagery. The proposed approach avoids rebuilding 3-d models of the scene at each time instant. Instead, the approach employs an initial 3-d model which is continuously updated with changes in the environment to form a full 4-d representation. This updating scheme is enabled by a novel algorithm that infers 3-d changes with respect to the model at one time step from images taken at a subsequent time step. This algorithm can effectively detect changes even when the illumination conditions between image collections are significantly different. The performance of the proposed framework is demonstrated on four challenging datasets in terms of 4-d modeling accuracy as well as quantitative evaluation of 3-d change detection.


Change Detection Illumination Condition Entire Scene Urban Scene Initial Time Step 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Taneja, A., Ballan, L., Pollefeys, M.: City-Scale Change Detection in Cadastral 3D Models using Images. In: CVPR (2013)Google Scholar
  2. 2.
    Schindler, G., Dellaert, F.: Probabilistic temporal inference on reconstructed 3D scenes. In: CVPR (June 2010)Google Scholar
  3. 3.
    Golparvar-Fard, M., Pena-Mora, F., Savarese, S.: Monitoring changes of 3D building elements from unordered photo collections. In: Proc. IEEE Workshop on Computer Vision for Remote Sensing of the Environment (in conjunction with ICCV 2011) (2011)Google Scholar
  4. 4.
    Sakurada, K., Takayuki, O., Deguchi, K.: Detecting Changes in 3D Structure of a Scene from Multi-view Images Captured by a Vehicle-mounted Camera. In: CVPR (2013)Google Scholar
  5. 5.
    Pons, J.P., Labatut, P., Vu, H.H., Keriven, R.: High Accuracy and Visibility-Consistent Dense Multiview Stereo. PAMI (2012)Google Scholar
  6. 6.
    Tola, E., Strecha, C., Fua, P.: Efficient large-scale multi-view stereo for ultra high-resolution image sets. Machine Vision and Applications 27(5), 1–18 (2011)Google Scholar
  7. 7.
    Restrepo, I.M.: Characterization of Probabilistic Volumetric Models for 3-d Computer Vision. PhD thesis, Brown University (2013)Google Scholar
  8. 8.
    Taneja, A., Ballan, L., Pollefeys, M.: Image based detection of geometric changes in urban environments. In: ICCV (November 2011)Google Scholar
  9. 9.
    Pollard, T., Mundy, J.L.: Change Detection in a 3-d World. In: CVPR (June 2007)Google Scholar
  10. 10.
    Bonet, J.D., Viola, P.: Poxels: Probabilistic voxelized volume reconstruction. In: ICCV (1999)Google Scholar
  11. 11.
    Broadhurst, A., Drummond, T.W., Cipolla, R.: A Probabilistic Framework for Space Carving. In: ICCV (2001)Google Scholar
  12. 12.
    Pollard, T.B.: Comprehensive 3-d Change Detection Using Volumetric Appearance Modeling. PhD thesis, Brown University (2009)Google Scholar
  13. 13.
    Ivanov, Y., Bobick, A., Liu, J.: Fast lighting independent background subtraction. IJCV, 1–14 (2000)Google Scholar
  14. 14.
    Košecka, J.: Detecting changes in images of street scenes. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part IV. LNCS, vol. 7727, pp. 590–601. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  15. 15.
    Taneja, A., Ballan, L., Pollefeys, M.: Modeling dynamic scenes recorded with freely moving cameras. In: Kimmel, R., Klette, R., Sugimoto, A. (eds.) ACCV 2010, Part III. LNCS, vol. 6494, pp. 613–626. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  16. 16.
    Franco, J.S., Boyer, E.: Fusion of multiview silhouette cues using a space occupancy grid. In: ICCV (2005)Google Scholar
  17. 17.
    Ulusoy, A.O., Biris, O., Mundy, J.L.: Dynamic Probabilistic Volumetric Models. In: ICCV (2013)Google Scholar
  18. 18.
    Stauffer, C., Grimson, W.: Adaptive background mixture models for real-time tracking. In: CVPR (1998)Google Scholar
  19. 19.
    Wu, C.: Towards Linear-time Incremental Structure from Motion. 3DV (June 2013)Google Scholar
  20. 20.
    Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. PAMI (August 2010)Google Scholar
  21. 21.
    Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. Eurographics (2006)Google Scholar
  22. 22.
    Snavely, N., Seitz, S.M., Szeliski, R.: Modeling the World from Internet Photo Collections. IJCV (December 2007)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Ali Osman Ulusoy
    • 1
  • Joseph L. Mundy
    • 1
  1. 1.School of EngineeringBrown UniversityUSA

Personalised recommendations