Abstract
We present a dynamic pushbroom stereo geometry model for both 3D reconstruction and moving target extraction in applications such as aerial surveillance and cargo inspection. In a dynamic pushbroom camera model, a “line scan camera” scans across the scene. Both the scanning sensor and the objects in the scene are moving, and thus the image generated is a “moving picture” with one axis being space and the other being time. We study the geometry under a linear motion model for both the sensor and the object, and we investigate the advantages of using two such scanning systems to construct a dynamic pushbroom stereo vision system for 3D reconstruction and moving target extraction. Two real examples are given using the proposed models. In the first application, a fast and practical calibration procedure and an interactive 3D estimation method are provided for 3D cargo inspection with dual gamma-ray (or X-ray) scanning systems. In the second application, dynamic pushbroom stereo mosaics are generated by using a single camera mounted on an airplane, and a unified segmentation-based stereo matching algorithm is proposed to extract both 3D structures and moving targets from urban scenes. Experimental results are given.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J. Chai and H.–Y. Shum, 2000. Parallel projections for stereo reconstruction. In Proc. CVPR’00: II 493-500.
D. Comanicu and P. Meer, 2002. Mean shift: a robust approach toward feature space analysis. IEEE Trans. PAMI, May 2002.
P. Dickson, J. Li, Z. Zhu, A. Hanson, E. Riseman, H. Sabrin, H. Schultz, and G. Whitten, Mosaic generation for under-vehicle inspection. IEEE Workshop on Applications of Computer Vision, Orlando, Florida, Dec 3-4, 2002.
A. Fusiello,. V. Roberto, and E. Trucco, 1997. Efficient stereo with multiple windowing, In IEEE CVPR: 858-863
R. Gupta and R. Hartley, 1997. Linear pushbroom cameras, IEEE Trans PAMI, 19(10), Sep. 1997: 963-975
R. Gupta, A. Noble, R. Hartley, J. Mundy, A. Schmitz, 1995. Camera calibration for 2.5-D X-ray metrology. In Proc. ICIP’95, Vol. 3, Oct 23 - 26, 1995 Washington D.C.
W. Hardin, Cargo Inspection: Imaging Solutions Wait for Government's Call, Machine Vision Online, Dec 2002.
W. Hardin, US Seaports: Finding the Needle in Hundreds of Haystacks, Machine Vision Online, June 2004.
Hitachi, Cargo container X-ray inspection systems, Hitachi Review, 53(1) June 2004: 97-102. http://www.hitachi.com/rev/field/industriasystems/2006638_12876.html
T. Kanade and M. Okutomi, 1991. A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment, In Proc. IEEE ICRA’91, Vol. 2: 1088-1095
Q. Ke and T. Kanade, A subspace approach to layer extraction, In Proc. IEEE CVPR’01, 2001.
R. Klette, G. Gimel'farb, R. Reulke, Wide-angle image acquisition, analysis and visualization. Proc. 14th Internat. Conf. Vision Interface (VI'2001), Ottawa, Canada, June 2001, 114-125.
A. Koschan, D. Page, J.-C. Ng, M. Abidi, D. Gorsich, and G. Gerhart, SAFER under vehicle inspection through video mosaic building,” International Journal of Industrial Robot, September 2004, 31(7): 435-442.
C. Mayntz, T. Aach, D. Kunz, and J-M. Frahm, Motion blur in fluoroscopy: effects, identification, and restoration, SPIE Medical Imaging 2000, San Diego, CA.
A. Noble, R. Hartley, J. Mundy, and J. Farley. X-Ray Metrology for Quality Assurance, In Proc IEEE ICRA’94, vol 2, pp 1113-1119.
V. J. Orphan, R. Richardson, and D. W. Bowlin, 2002. VACISTM – a safe, reliable and cost- effective cargo inspection technology, Port Technology International, p. 61-65. www.porttechnology.org/journals/ed16/section02.shtml
S. Peleg, M. Ben-Ezra, and Y. Pritch, 2001. Omnistereo: panoramic stereo imaging, IEEE Trans. PAMI, 23(3): 279-290.
H.-Y. Shum and R. Szeliski, 1999. Stereo reconstruction from multiperspective panoramas. InProc. ICCV’99: 14-21.
H. Tao, H. S. Sawhney, and R. Kumar, 2001. A global matching framework for stereo computation, In Proc. ICCV’01.
B. Triggs, P. McLauchlan, R. Hartley, and A. Fitzgibbon, Bundle Adjustment – A Modern Synthesis, In Vision Algorithms: Theory and Practice, Lecture Notes in Computer Science, vol 1883, pp 298–372, 2000, eds. B. Triggs, A. Zisserman and R. Szeliski”, Springer-Verlag.
J. Xiao and M. Shah, 2004. Motion layer extraction in the presence of occlusion using graph cut, In Proc. CVPR’04.
J. Y. Zheng and S. Tsuji, Panoramic representation for route recognition by a mobile robot. International Journal of Computer Vision, 9(1), 1992: 55-76.
Y. Zhou and H. Tao, 2003. A background layer model for object tracking through occlusion,” Proc. ICCV’03: 1079-1085.
Z. Zhu and A. R. Hanson, LAMP: 3D Layered, Adaptive-resolution and Multi-perspective Panorama – a New Scene Representation, Computer Vision and Image Understanding, 96(3), Dec 2004, pp 294-326.
Z. Zhu, E. M. Riseman, and A. R. Hanson, 2001. Parallel-perspective stereo mosaics. In Proc. ICCV’01, vol I: 345-352.
Z. Zhu, E. M. Riseman, and A. R. Hanson, Generalized Parallel-Perspective Stereo Mosaics from Airborne Videos, IEEE Trans PAMI, 26(1), Feb 2004, pp. 226-237.
Z. Zhu, L. Zhao, and J. Lei, 3D Measurements in Cargo Inspection with a Gamma-Ray Linear Pushbroom Stereo System, IEEE Workshop on Advanced 3D Imaging for Safety and Security, June 25, 2005, San Diego, CA, USA.
Z. Zhu, H. Tang, B. Shen, and G. Wolberg, 3D and Moving Target Extraction from Dynamic Pushbroom Stereo Mosaics, IEEE Workshop on Advanced 3D Imaging for Safety and Security, June 25, 2005, San Diego, CA, USA.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2007 Springer
About this chapter
Cite this chapter
Zhu, Z., Wolberg, G., Layne, J. (2007). Dynamic Pushbroom Stereo Vision. In: Koschan, A., Pollefeys, M., Abidi, M. (eds) 3D Imaging for Safety and Security. Computational Imaging and Vision, vol 35. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-6182-0_8
Download citation
DOI: https://doi.org/10.1007/978-1-4020-6182-0_8
Publisher Name: Springer, Dordrecht
Print ISBN: 978-1-4020-6181-3
Online ISBN: 978-1-4020-6182-0
eBook Packages: Computer ScienceComputer Science (R0)