Abstract
The subject of motion has been the center of interdisciplinary studies since the time when Zeno posed his paradox circa 500BC. However, computer vision, the use of a camera and a computer to recognize objects, people and/or events automatically, is a relatively young field of research. Its development began in the early 1960s; however, it has matured fairly quickly. Today, it is contributing to the solutions of some of the most serious societal problems. Motion analysis of a sequence of images is an important part of computer vision. This chapter briefly presents the contributions to motion analysis from other fields followed by the computer vision-based analysis of motion from a sequence of images. Analysis and understanding of images based on both feature tracking and optical flow estimation are presented. Early works focused on the computation of structure from motion of objects from a sequence of images via point features. This was followed by the computation of optical flow to characterize motion. Applications today focus on the monitoring of traffic, providing guidance to a motorist in terms of his/her position relative to traffic lanes and traffic ahead, and inspection of complicated three-dimensional industrial parts, to mention a few. Research focus has shifted from inanimate objects to people, for example monitoring people and their activities in public places or monitoring activities from an unmanned aerial vehicle. These applications are dominating the research scene through the belief that computer vision/motion analysis can contribute to the solution of societal surveillance and biometric problems. The chapter ends with a discussion of the future directions of research in motion analysis and possible applications.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The interested reader may note that the first physiological model of motion detection based on the “Autocorrelation, a principle for evaluation of sensory information by nervous system” by Reichardt W. (1961) is presented at the website: http://en.wikipedia.org/wiki/Motion_perception.
- 2.
The methods for solving nonlinear equations have progressed significantly, as well as the available computing power, so that now there is a software package, the EOS Systems Photomodeler [13], which uses two views of six points to generate a structure. The software package first appeared on the market in 1999, indicating the long interval between an idea and a product.
- 3.
Professor Takeo Kanade once remarked to the author at a conference that the complexity of the Roach and Aggarwal [32] solution to the feature-tracking problem contributed to the Lucas and Kanade [25] simple solution. Further, the Lucas and Kanade solution is probably his most contributive paper among all his contributions to date.
References
Addams, R.: An account of a peculiar optical phenomenon seen after having looked at a moving body, etc. Lond. Edinb. Philos. Mag. J. Sci., 3rd Ser 5, 373–374 (1834)
Adelson, E.H., Bergen, J.R.: Spatiotemporal energy model for the perception of motion. J. Opt. Soc. Am. A 2, 284–299 (1985)
Aggarwal, J.K., Cai, Q.: Human motion analysis: a review. Comput. Vis. Image Underst. 73(3), 428–440 (1999)
Aggarwal, J.K., Duda, R.O.: Computer analysis of moving polygon images. IEEE Trans. Comput. 24(10), 966–976 (1975)
Aggarwal, J.K., Mitiche, A.: Structure and motion from images: fact and fiction. In: Proceedings of the Third Workshop on Computer Vision: Representation and Control, Bellaire, MI (1985)
Aggarwal, J.K., Ryoo, M.S.: Human activity analysis: a review. ACM Comput. Surv. (2010, to appear)
Badler, N.I., Aggarwal, J.K.: Abstract of the Workshop on Computer Analysis of Time-Varying Imagery, Philadelphia, PA (1979)
Cai, Q., Aggarwal, J.K.: Tracking human motion in structured environments using a distributed camera system. IEEE Trans. Pattern Anal. Mach. Intell. 21(12), 1241–1247 (1999)
Campbell, L.W., Bobick, A.F.: Recognition of human body motion using phase space constraints. In: IEEE Int. Conference on Computer Vision (ICCV), pp. 624–630 (1995)
Cedras, C., Shah, M.: A motion-based recognition: a survey. Image Vis. Comput. 13(2), 129–155 (1995)
Deriche, R., Kornprobst, P., Aubert, G.: Optical-flow estimation while preserving its discontinuities: a variational approach. In: Proceedings Second Asian Conference on Computer Vision. Lecture Notes in Computer Science, vol. 1035, pp. 71–80 (1995)
Derrington, A.M., Allen, H.A., Delicato, L.S.: Visual mechanisms of motion analysis and motion perception. Annu. Rev. Psychol. 55, 181–205 (2004)
Eos Systems, Inc. Photomodeler, http://www.photomodeler.com/
Fleet, D.J., Weiss, Y.: Optical flow estimation. In: Paragios, et al. (eds.) Handbook of Mathematical Models in Computer Vision. Springer, Berlin (2006)
Gao, C., Hua, H., Ahuja, N.: A hemispherical imaging camera. Comput. Vis. Image Underst. 114(2), 168–178 (2010)
Gavrila, D.: The visual analysis of human movement: a survey. Comput. Vis. Image Underst. 73(1), 82–98 (1999)
Gavrila, D., Davis, L.: Towards 3-D model-based tracking and recognition of human movement. In: Bichsel, M. (ed.) International Workshop on Face and Gesture Recognition, pp. 272–277 (1995)
Haritaoglu, I., Davis, L.: Hydra: multiple detection and tracking silhouettes. In: IEEE Workshop on Visual Surveillance, Fort Collins, CO, pp. 6–13 (1999)
Haritaoglu, I., Harwood, D., Davis, L.: W4: who, when, where, what: a real system for detecting and tracking people. In: Third Int. Conf. on Automatic Face and Gesture Recognition, Nara, Japan, pp. 222–227 (1998)
Horn, B.K.P.: Robot Vision. MIT Press, Cambridge (1986)
Horn, B.K.P., Schunck, B.G.: Determining optical flow. Artif. Intell. 17, 185–203 (1981)
Huang, T.S.: Image Sequence Processing and Dynamic Scene Analysis. NATO ASI Series. Springer, Berlin (1983)
Johansson, G.: Visual motion perception. Sci. Am. 232(6), 76–88 (1975)
Krishnan, G., Nayar, S.K.: Cata-fisheye camera for panoramic imaging. In: IEEE Workshop on Application of Computer Vision (WACV) (2008)
Lucas, B.D., Kanade, T.: An iterative image registration technique with application to stereo vision. In: Proceedings of 7th International Joint Conference on Artificial Intelligence (1981)
Martin, W.N., Aggarwal, J.K. (eds.): Motion Understanding: Robot and Human Vision. Kluwer Academic, Dordrecht (1988)
Math Pages Website (http://www.mathpages.com/rr/s3-07/3-07.htm), Reflections on relativity—Zeno and the paradox of motion
Mumford, D.S.: Boundary detection by minimizing functionals. In: Proceedings of CVPR (1985)
Ogale, A.S., Aloimonos, Y.: A roadmap to the integration of early visual modules. Int. J. Comput. Vis. 72(1), 9–25 (2007). Special Issue on Early Cognitive Vision
Oliver, N., Rosario, B., Pentland, A.: A Bayesian computer vision system for modeling human interactions. In: Proceedings of International Conference on Vision Systems 99, Gran Canaria, Spain, pp. 255–272 (1999)
Park, S., Aggarwal, J.K.: A hierarchical Bayesian network for event recognition of human actions and interactions. Multimed. Syst. 10(2), 164–179 (2004)
Roach, J.W., Aggarwal, J.K.: Determining the movement of objects from a sequence of images. IEEE Trans. Pattern Anal. Mach. Intell. 2(6), 554–562 (1980)
Russell, B.: The problem of infinity considered historically. In: Salmon, W.C. (ed.) Zeno’s Paradoxes, p. 51. Bobbs-Merrill, Indianapolis (1970)
Ryoo, M.S., Aggarwal, J.K.: Semantic representation and recognition of continued and recursive human activities. Int. J. Comput. Vis. 82, 1–24 (2009)
Starner, T., Pentland, A.: Real-time American sign language recognition from video using hidden Markov models. In: International Symposium on Computer Vision, p. 265 (1995)
Tomasi, C., Kanade, T.: Detection and tracking of point feature shape and motion from image streams: a factorization method—part 3. Technical Report CMU-CS91-132 (1991)
Turga, P., Chellappa, R., Subrahmanian, V.S., Udren, O.: Machine recognition of human activities: a survey. IEEE Trans. Circuits Syst. Video Technol. 18(11), 1473–1488 (2008)
Ullman, S.: The Interpretation of Visual Motion. MIT Press, Cambridge (1979)
Ullman, S.: The interpretation of structure from motion. Proc. R. Soc. Lond. B 203, 405–426 (1979)
Vazquez, C., Mitiche, A., Langaniere, R.: Joint segmentation and parametric estimation of image motion by basis function representation and level set evolution. IEEE Trans. Pattern Anal. Mach. Intell. 28(5), 782–793 (2006)
Wallach, H., O’Connell, D.C.: The kinetic depth effect. J. Exp. Psychol. 45(4), 205–217 (1953)
Watson, A.B., Ahumada, A.J.: Model of human visual-motion sensing. J. Opt. Soc. Am. A 2(2), 322–342 (1985)
Webb, J.A., Aggarwal, J.K.: Structure from motion of rigid and jointed objects. Artif. Intell. 19, 107–130 (1982)
Yamato, J., Ohya, J., Ishii, K.: Recognizing human action in time-sequential images using hidden Markov model. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 379–385 (1992)
Zeki, S.: The visual image in mind and brain. Sci. Am. 69–76 (1992)
Acknowledgements
It is a pleasure to acknowledge the help and comments of Dr. Michael Ryoo, Professors Bill Geisler and Amar Mitiche and Mr. Birgi Tamersoy and Mr. Chia-Chih Chen. Also, my sincere thanks go to Ms. Selina Keilani for editing the manuscript. The research was supported in part by Texas Higher Education Coordinating Board award # 003658-0140-2007.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag London Limited
About this chapter
Cite this chapter
Aggarwal, J.K. (2011). Motion Analysis: Past, Present and Future. In: Bhanu, B., Ravishankar, C., Roy-Chowdhury, A., Aghajan, H., Terzopoulos, D. (eds) Distributed Video Sensor Networks. Springer, London. https://doi.org/10.1007/978-0-85729-127-1_2
Download citation
DOI: https://doi.org/10.1007/978-0-85729-127-1_2
Publisher Name: Springer, London
Print ISBN: 978-0-85729-126-4
Online ISBN: 978-0-85729-127-1
eBook Packages: Computer ScienceComputer Science (R0)