Skip to main content
Log in

Real-time model-based tracking combining spatial and temporal features

  • Published:
Journal of Intelligent and Robotic Systems Aims and scope Submit manuscript

Abstract

This paper describes a method for tracking moving image features by combining spatial and temporal edge information with model-based feature information. The algorithm updates the two-dimensional position of object features by correlating predicted model features with current image data. The results of the correlation process are used to compute an updated model. The algorithm makes use of a high temporal sampling rate with respect to spatial changes of the image features and operates in a real-time multi-processing environment. Preliminary results demonstrate successful tracking for image feature velocities between 1.1 and 4.5 pixels every image frame.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. AdelsonE.H. and BergenJ.R., 1985, Spatio-temporal energy models for the perception of motion, J. Optical Soc. Amer. A 2, 284–299.

    Google Scholar 

  2. Albus, James S. and Tsai-Hong Hong, 1990, Motion, depth, and image flow, IEEE Robotics and Conference, Cincinnati, OH. May 13–18.

  3. Albus, J.S., McCain, H.G. and Lumia, R., 1987, NASA/NBS standard reference model for telerobot control system architecture (NASREM), NIST Technical Note 1235, Gaithersburg, MD.

  4. Allen, Peter K., 1989, Real-time motion tracking using spatio-temporal filters, Proc. DARPA Image Understanding Workshop, Palo Alto, TX, May 23–26.

  5. Aspex, Inc., 1987, PIPE — An introduction to the PIPE system, New York.

  6. BollesRobert C., BakerH. Harlyn and MarimontDavid H., 1987, Epipolar-plane image anlaysis: An approach to determining structure from motion, Internat. J. Computer Vision 1, 7–55.

    Google Scholar 

  7. Chaconas, K. and Nashman, M., 1989, Visual perception processing in a hierarchical control system, NIST Technical Note 1260, Gaithersburg, MD.

  8. Chaconas, K., 1990, Range from triangulation using an inverse perspective method to determine relative camera pose, NIST Internal Report 4385, Gaithersburg, MD.

  9. Crowley, James L., Stelmaszyk Patrick and Discours Christopher, 1988, Measuring image flow by tracking edge-lines, Proc. 2nd Internat. Conference on Computer Vision, pp 658–664.

  10. Fiala, J., 1988, Manipulator servo level task decomposition, NIST Technical Note 1255, Gaithersburg, MD.

  11. Fiala, J., 1989, Note on NASREM implementation, NIST Internal Report 89-4215, Gaithersburg, MD, December.

  12. Gennery, Donald B., 1982, Tracking known three-dimensional objects, Proc. National Conference on Artificial Intelligence, Pittsburg, PA, August 18–20, pp 13–17.

  13. HornB.K.P. and SchunkB., 1983, Determining optical flow, Artificial Intelligence 17, 185–203.

    Google Scholar 

  14. JenkinM. and TsotsosJ.K., 1986, Applying temporal constraints to the dynamic stereo problem, CVGIP 33, 16–32.

    Google Scholar 

  15. KelmarL., 1989, Manipulator servo level world modelling, NIST Technical Note 1258, NIST, Gaithersburg, MD.

    Google Scholar 

  16. Lumia, R., Fiala, J. and Wavering, A., The NASREM robot control system and testbed, 2nd Internat. Symp. Robotics & Automated Manufacturing, Albuquerque, NM.

  17. MontgomeryD.C., JohnsonL.A. and GardinerJ.S., 1990, Forecasting and Time Series Analysis, 2nd edn, McGraw-Hill, New York.

    Google Scholar 

  18. Spetsakis, Minas E. and Aloimonos, John, 1987, Closed form solution to the structure from motion problem from line correspondences, Proc. National Conference on Artificial Intelligence, pp 738–743.

  19. ThompsonD.W. and MundyJ.L., 1988, Model-based motion analysis-motion from motion, Robotics Research: The Fourth International Symposium (eds. R.C.Bolles and B.Roth), MIT Press, Cambridge, Mass, pp 229–235.

    Google Scholar 

  20. VergheseGilbert and DyerCharles R., 1988, Real-time model-based tracking of three-dimensional object, Computer Sciences Technical Report #806, University of Wisconsin-Madison.

    Google Scholar 

  21. WaveringA., 1988, Manipulator primitive level task decomposition, NIST Technical Note 1256, NIST, Gaithersburg, MD.

    Google Scholar 

  22. Waxman, Allen M. and Wohn Kwangyoen, 1986, Image flow theory: A framework for 3-D inference from time-varying imagery, LSR-TR-1, Boston University.

  23. Waxman, Allen M., Wu, Jian and Bergholm, F., 1988, Convected activation profiles: receptive fields for real-time measurement of short-range visual motion, Internat. Conference on Computer Vision.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Roberts, K., Nashman, M. Real-time model-based tracking combining spatial and temporal features. Journal of Intelligent and Robotic Systems 5, 25–38 (1992). https://doi.org/10.1007/BF00357128

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00357128

Key words

Navigation