Abstract
The task of segmenting out the foreground from a group of topically related images lends itself to a number of interesting applications. One such application is creating a photo collage. We can imagine a scenario where a user captures a set of photographs of an object of interest, and would like to segment the object out from the cluttered background to make a collage out of the cutouts. An extension to this would include overlaying the foreground cutouts on a novel background without the need for the traditional green room studio setting. As we show in this chapter, interactive co-segmentation allows for an easy way to achieve these using simple strokes even in the presence of cluttered backgrounds. Moreover, recent work has shown that interactive co-segmentation can be extended to image based modeling applications, specifically obtaining a 3D model of an object of interest just from a collection of images of this object. Finally, we show that interactive co-segmentation can be extended beyond object co-segmentation – the same techniques can be applied to 3D surfaces in a scene to obtain a dense piecewise planar model of the scene captured from multiple viewpoints.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Y. Chen and G. Medioni. Object modelling by registration of multiple range images. Image
Z. Chen, H.-L. Chou, and W.-C. Chen. A performance controllable octree construction method. In ICPR, pages 1–4, 2008.
B. Curless and M. Levoy. A volumetric method for building complex models from range images. In SIGGRAPH ’96: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pages 303–312. ACM, 1996.
P. Debevec, C. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In SIGGRAPH, pages 11–20, 1996.
Y.-H. Fang, H.-L. Chou, and Z. Chen. 3d shape recovery of complex objects from multiple silhouette images. Pattern Recogn. Lett., 24(9-10):1279–1293, 2003.
A. W. Fitzgibbon, G. Cross, and A. Zisserman. Automatic 3d model construction for turntable sequences. In Proceedings of SMILE Workshop on Structure from Multiple Images in Large Scale Environments, volume 1506, pages 154–170, 1998.
K. Forbes, F. Nicolls, G. de Jager, and A. Voigt. Shape-from-silhouette with two mirrors and an uncalibrated camera. In ECCV, pages 165–178, 2006.
J.-S. Franco and E. Boyer. Exact polyhedral visual hulls. In BMVC, volume 1, pages 329–338, 2003.
Y. Furukawa, B. Curless, S. Seitz, and R. Szeliski. Reconstructing building interiors from images. In ICCV, 2009.
Y. Furukawa and J. Ponce. Accurate, dense, and robust multi-view stereopsis. PAMI, 32:1362– 1376, 2010.
D. Gallup, J. Frahm, and M. Pollefeys. Piecewise planar and non-planar stereo for urban scene reconstruction. In CVPR, 2010.
A. Hengel, A. R. Dick, T. ThormŁhlen, B.Ward, and P. H. S. Torr. Videotrace: rapid interactive scene modelling from video. ACM Trans. Graph., 26(3):86, 2007.
A. Kowdle, D. Batra,W.-C. Chen, and T. Chen. Model: Interactive co-segmentation for object of interest 3d modeling. In Workshop on Reconstruction and Modeling of Large-Scale 3D
Virtual Environments at European Conference on Computer Vision, 2010.
A. Kowdle, Y. Chang, D. Batra, and T. Chen. Scribble based interactive 3d reconstruction via scene cosegmentation. In ICIP, 2011.
F. Lafarge, R. Keriven, M. Br´edif, and V. Hiep. Hybrid multi-view reconstruction by jumpdiffusion. In CVPR, 2010.
M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk. The digital michelangelo project: 3d scanning of large statues. In Siggraph, pages 131–144, 2000.Vision Comput., 10(3):145–155, 1992.
M. Pollefeys, L. Van Gool, M. Vergauwen, F. Verbiest, K. Cornelis, J. Tops, and R. Koch. Visual modeling with a hand-held camera. IJCV, V59(3):207–232, 2004.
S. M. Seitz, B. Curless, J. Diebel, D. Scharstein, and R. Szeliski. A comparison and evaluation of multi-view stereo reconstruction algorithms. In CVPR, volume 1, pages 519–528, 2006.
S. Sinha, D. Steedly, and R. Szeliski. Piecewise planar stereo for image-based rendering. In ICCV, 2009.
S. Sinha, D. Steedly, R. Szeliski, M. Agrawala, and M. Pollefeys. Interactive 3d architectural modeling from unordered photo collections. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2008), 2008.
N. Snavely, S. Seitz, and R. Szeliski. Photo tourism: Exploring photo collections in 3d. In SIGGRAPH, pages 835–846, 2006.
J. Starck and A. Hilton. Surface capture for performance-based animation. IEEE Computer Graphics and Applications, 27(3):21–31, 2007.
R. Szeliski. Rapid octree construction from image sequences. CVGIP: Image Understanding, 58(1):23–32, 1993.
D. Vlasic, I. Baran, W. Matusik, and J. Popovi´c. Articulated mesh animation from multi-view silhouettes. In SIGGRAPH, pages 1–9. ACM, 2008.
L. Zhang, B. Curless, and S. M. Seitz. Rapid shape acquisition using color structured light and multi-pass dynamic programming. 3DPVT, page 24, 2002.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
Batra, D., Kowdle, A., Parikh, D., Luo, J., Chen, T. (2011). Applications. In: Interactive Co-segmentation of Objects in Image Collections. SpringerBriefs in Computer Science. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-1915-0_3
Download citation
DOI: https://doi.org/10.1007/978-1-4614-1915-0_3
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-1914-3
Online ISBN: 978-1-4614-1915-0
eBook Packages: Computer ScienceComputer Science (R0)