Abstract
Who has not watched ripples spread across a pool and known water thereby? Or seen leaves shimmer their silver backs in a summer breeze and known a tree? Who has not known the butterfly by her fluttering? Or seen a distant figure walking and known there goes a man? The motion recognition ability of the human visual system is remarkable. People are able to distinguish both highly structured motions, such as those produced by walking, running, swimming or flying birds, and more statistical patterns such as those due to blowing snow, flowing water or fluttering leaves. We have demonstrated similar recognition capabilities in an automated machine vision system using efficient low-level techniques that can be implemented in real-time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
M. Allmen and C.R. Dyer. Cyclic motion detection using spatiotemporal surface and curves. In Proc. Int. Conf. on Pattern Recognition, pages 365–370, 1990.
C. H. Anderson, P. J. Burt, and G. S. van der Wal. Change detection and tracking using pyramid transform techniques. In Proc. SPIE Conference on Intelligent Robotsand Computer Vision, pages 300–305, 1985.
N.I. Badler. Temporal Scene Analysis: Conceptual Descriptions of Object Movements. PhD thesis, Univ of Toronto, 1975.
J. Crane. Imaginal behaviour of trinidad butterfly. Zoologica, 40: 167–196, 1955.
J.E. Cutting. Six tenets for event perception. Cognition, pages 71–78, 1981.
Virginia R. de Sa. Unsupervised Classification Learning from Cross-Modality Structure in the Environment. PhD thesis, Computer Science Department, Univ of Rochester, 1994.
J.P. Ewart. Neuroethology of releasing mechanisms: Prey-catching in toads. Behavioral and Brian Sciences, 10: 337–405, 1987.
J.E. Feldman. Time, space and form in vision. Technical Report 244, University of Rochester, Computer Science Department, 1988.
K.E. Finn and A.A. Montgomery. Automatic optically-based recognition of speech. Pattern Recognition Letters, 8: 159–164, 1988.
N.H. Goddard. Representing and recognizing event sequences. In Proc. AAAI Workshop on Neural Architectures for Computer Vision, 1989.
K. Gould and M. Shah. The trajectory primal sketch: A multi-scale scheme for representing motion characterestics. In IEEE Conf. Computer Vision and Pattern Recognition, pages 79–85, 1989.
K. Gould, K. Rangarajan, and M.A. Shah. Detection and representation of events in motion trajectories. In Gonzalez and Mandavieh, editors, Advances in Image Processing and Analysis. SPIE Optical Engineering Press, 1992.
D.D. Hoffman and B.E. Flinchbuagh. The interpretation of biological motion. Biological Cybernatics, pages195–204, 1982.
G. Johansson. Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14: 201–211, 1973.
R.C. Nelson. Qualitative detection of motion by a moving observer. In Proc. of IEEE CVPR, pages173–178, 1991.
J. O’Rourke and N.I. Badler. Model-based image analysis of human motion using constraint propagation. PAMI, 3 (4): 522–537, 1980.
A. Pentland and K. Mase. Lip reading: Automatic visual recognition of spoken words. Technical Report 117, M.I.T. Media Lab Vision Science, 1989.
E.D. Petajan, B. Bischoff, and N.M. Brooke. An improved automatic lipreading system to enhance speech recognition. In SIGCHI’88: Human Factors in Computing Systems, pages 19–25, 1988.
R. Polana and R.C. Nelson. Detecting activities. Journal of Visual Communication and Image Representation, 5 (2): 172–180, 1994.
R.F. Rashid. Lights: A System for Interpretation of Moving Light Displays. PhD thesis, Computer Science Dept, University of Rochester, 1980.
J.R. Rhyne and C.G. Wolf. Gestural interfaces for information processing applications. Technical Report 12179, IBM Research Report, 1986.
S.M. Seitz and C.R. Dyer. Affine invariant detection of periodic motion. In Proceedings of CVPR 1994.
R.H. Smythe. Vision in the Animal World. St. Martin’s Press, NY, 1975.
Marcin Olaf Szummer. Temporal Texture Modeling. PhD thesis, Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, 1995.
N. Tinbergen. The Study of Instinct. Oxford: Clarendon Press, 1951.
Tsai, Ping-Sing, Keiter, K., Kasparis, T., and Shah, M. Cyclic motion detection. Pattern Recognition 27(12), 1994.
K. ‘Frisch von’. Bees: Their Vision, Taste, Smell and Language. Moscow,IL, 1955.
E. Wolf and G. Zerrahn-Wolf. Flicker and the reactions of bees to flowers. Journalof Gen. Physiol., 20: 511–518, 1936.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1997 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Polana, R., Nelson, R. (1997). Temporal Texture and Activity Recognition. In: Shah, M., Jain, R. (eds) Motion-Based Recognition. Computational Imaging and Vision, vol 9. Springer, Dordrecht. https://doi.org/10.1007/978-94-015-8935-2_5
Download citation
DOI: https://doi.org/10.1007/978-94-015-8935-2_5
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-4870-7
Online ISBN: 978-94-015-8935-2
eBook Packages: Springer Book Archive