Abstract
With the sophistication of artificial vision systems, the need to endanger human lives for many hazardous activities is increasingly proving to be avoidable. From aerial reconnaissance missions to space exploration, many projects stand to benefit, in particular, from the sophistication in techniques to precisely find world positions of objects present in video data. Unfortunately, mechanical automation of such a task is complicated by the narrow fields of view of video data and the inaccuracy of mechanical information available describing the position of the camera in the world. Instead, computer vision techniques can be used to successfully align any given video frame with pre-calibrated reference imagery. After alignment, a video frame inherits pixel-wise calibration and as a consequence objects in the frame are exactly placed in the world. This ability to accurately position objects like buildings, roads, landing sites and spatial landmarks in general, facilitates precise automation of actions that previously required human intervention. The core challenge then is to develop techniques to autonomously align video sequences to pre-calibrated reference imagery.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
J.K. Wani, “Probability and Statistical Inference”, Appleton-Century-Crofts, New York, 1971.
J. P. Golden, “Terrain Contour Matching (TERCOM): A cruise missile guidance aid”, Proc. Image Processing Missile Guidance, vol. 238, pp. 10–18, 1980.
B. Horn, B. Schunk, “Determining Optical Flow”, Artificial Intelligence, vol. 17, pp. 185–203, 1981.
B. Lucas and T. Kanade. “An Iterative image registration technique with an application to stereo vision”, Proceedings of the 7th International Joint Conference on Artificial Intelligence, pp. 674–679,1981.
C. Baird and M. Abramson, “A comparison of several digital mapaided navigation techniques”, Proc. IEEE Position Location and Navigation Symposium, pp. 294–300, 1984.
P. Curran, “Principles of Remote Sensing”, Longman Group Limited, 1985.
S. J. Merhav, Y. Bresler, “On-line Vehicle Motion Estimation from Visual Terrain Information Part I: Recursive Image Registration”, IEEE Trans. Aerospace and Electronic System, 22(5), pp. 583–587, 1986.
Y. Bresler, S. J. Merhav, “On-line Vehicle Motion Estimation from Visual Terrain Information Part II: Ground Velocity and Position Estimation”, IEEE Trans. Aerospace and Electronic System, 22(5), pp. 588–603, 1986.
D.H. Field, “Relations between the statistics of natural images and the response properties of cortical cells”, JOS A, vol 4, pp. 2379–2394, 1987.
B. Kamgar-Parsi, J. Jones, A. Rosenfeld, “Registration of multiple overlapping range images: scenes without distinctive features”, Computer Vision and Pattern Recognition, pp. 282–290, 1989.
P. Anandan, “A computational framework and an algorithm for the measurement of visual motion”, International Journal of Computer Vision, vol.2, pp. 283–310, 1989.
J. Foley, A. van Dam, S. Feiner, J. Highes, “Computer Graphics, Principles and Practices”, Addison-Wesley, 1990.
J. Rodriquez, J. Aggarwal, “Matching Aerial Images to 3D terrain maps”, IEEE PAMI, 12(12), pp. 1138–1149, 1990.
J. Bergen, P. Anandan, K. Hanna, R. Hingorani, “Hierarchical model-based motion estimation”, Proc. European Conference on Computer Vision, pp. 237–252, 1992.
L. Brown, “A Survey of Image Registration Techniques”, ACM Computing Surveys, 24(4), pp. 325–376, 1992.
Q. Zheng., R. Chellappa. “A computational vision approach to image registration”, IEEE Transactions on Image Processing, 2(3), pp. 311–326, 1993.
R. Szeliski, “Image mosaicing for tele-reality applications”, IEEE Workshop on Applications of Computer Vision, pp. 44–53, 1994.
D.-G. Sim, S.-Y. Jeong, R.-H. Park, R.-C. Kim, S. Lee, I. Kim, “Navigation parameter estimation from sequential aerial images”. Proc. International Conference on Image Processing, vol.2, pp. 629–632, 1996.
S. Manna nd RW. Picard, “Video orbits of the projective group a simple approach to featureless estimation of parameters”, IEEE Transactions on Image Processing, 6(9), pp. 1281 –1295, 1997.
P. Viola and W. M. Wells, “Alignment by maximization of mutual information.”, International Journal of Computer Vision, 24(2) pp. 134–154, 1997.
R. Szeliski, H. Shum, “Creating Full View Panoramic Image Mosaics and Environment Maps”, Computer Graphics Proceedings, SIGGRAPH, pp. 252–258, 1997.
R. Kumar, H. Sawhney, J. Asmuth, A. Pope, S. Hsu, “Registration of video to geo-referenced imagery”, Fourteenth International Conference on Pattern Recognition, vol. 2. pp.1393–1400, 1998.
M. Irani, P. Anandan, “Robust Multi-Sensor Image Alignment”, International Conference on Computer Vision, 1998.
J. Nocedal, S. Wright, “Numerical Optimization”, Springer-Verlag, 1999.
K. Hanna, H. Sawhney, R. Kumar, Y. Guo, S. Samarasekara, “Annotation of video by alignment to reference imagery”, IEEE International Conference on Multimedia Computing and Systems, vol.1, pp. 38 – 43, 1999.
V. Govindu and C. Shekar, “Alignment Using Distributions of Local Geometric Properties”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(10), pp. 1031–1043, 1999.
R. Cannata, M. Shah, S. Blask, J. Van Workum, “Autonomous Video Registration Using Sensor Model Parameter Adjustments”, Applied Imagery Pattern Recognition Workshop, 2000.
J. Le Moigne, N. Netanyahu, J. Masek, D. Mount, S. Goward, M. Honzak, “Geo-registration of Landsat Data by robust matching of wavelet features”, Proc. Geoscience and Remote Sensing Symposium, IGARSS, vol.4, pp. 1610–1612, 2000.
R. Wildes, D. Hirvonen, S. Hsu, R. Kumar, W. Lehman, B. Matei, W.-Y. Zhao “Video Registration: Algorithm and quantitative evaluation”, Proc. International Conference on Computer Vision, Vol. 2, pp. 343 –350, 2001.
S. Hsu, “Geocoded terrestrial mosaics using pose sensors and video registration”, Computer Vision and Pattern Recognition, 2001. vol. 1, pp. 834 –841, 2001.
D. Sim and R. Park, “Localization based on the gradient information for DEM Matching”, Proc. Transactions on Image Processing, 11(1), pp. 52–55, 2002.
D-G. Sim, R-H Park, R-C. Kim, S. U. Lee, I-C. Kim, “Integrated Position Estimation Using Aerial Image Sequences”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1), pp. 1–18, 2002.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer Science+Business Media New York
About this chapter
Cite this chapter
Sheikh, Y., Khan, S., Shah, M., Cannata, R. (2003). Geodetic Alignment of Aerial Video Frames. In: Shah, M., Kumar, R. (eds) Video Registration. The International Series in Video Computing, vol 5. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-0459-7_7
Download citation
DOI: https://doi.org/10.1007/978-1-4615-0459-7_7
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-5087-3
Online ISBN: 978-1-4615-0459-7
eBook Packages: Springer Book Archive