Performance of Lookahead Control Policies in the Face of Abstractions and Approximations

  • Ilya Levner
  • 1Vadim Bulitko
  • Omid Madani
  • Russell Greiner
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2371)


This paper explores the formulation of image interpretation as a Markov Decision Process (MDP) problem, highlighting the important assumptions in the MDP formulation. Furthermore state abstraction, value function and action approximations as well as lookahead search are presented as necessary solution methodologies. We view the task of image interpretation as a dynamic control problem where the optimal vision operator is selected responsively based on the problem solving state at hand. The control policy, therefore, maps problem-solving states to operators in an attempt to minimize the total problem-solving time while reliably interpreting the image. Real world domains, like that of image interpretation, usually have incredibly large state spaces which require methods of abstraction in order to be manageable by today’s information processing systems. In addition an optimal value function (V*) used to evaluate state quality is also generally unavailable requiring approximations to be used in conjunction with state abstraction. Therefore, the performance of the system is directly related to the types of abstractions and approximations present.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [Bulitko et al. 2000]
    Bulitko, V., Caelli, T., McNabb, D. 2000. Forestry Information Management System (FIMS): An Introduction. Technical Report. University of Alberta.Google Scholar
  2. [Draper et al. 2000]
    Draper, B., Bins, J., Baek, K. 2000. ADORE: Adaptive Object Recognition, Videre, 1(4):86–99.Google Scholar
  3. [Good 1971]
    Good, I.J. 1971. Twenty-seven Principles of Rationality. In Foundations of Statistical Inference, Godambe V.P., Sprott, D.A. (editors), Holt, Rinehart and Winston, Toronton.Google Scholar
  4. [Gougeon 1993]
    Gougeon, F.A. 1993. Individual Tree Identification from High Resolution MEIS Images, In Proceedings of the International Forum on Airborne Multispectral Scanning for Forestry and Mapping, Leckie, D.G., and Gillis, M.D. (editors), pp. 117–128.Google Scholar
  5. [Hsu et al. 1995]
    Hsu, F.H., Campbell, M.S., Hoane, A.J.J. 1995. Deep Blue System Overview. Proceedings of the 9th ACM Int. Conf. on Supercomputing, pp. 240–244.Google Scholar
  6. [Korf 1990]
    Korf, R.E. 1990. Real-time heuristic search. Artificial Intelligence, Vol. 42, No. 2–3, pp. 189–211.CrossRefMATHGoogle Scholar
  7. [Larsen, Rudemo 1997]
    Larsen, M. and Rudemo, M. 1997. Using ray-traced templates to find individual trees in aerial photos. In Proceedings of the 10th Scandinavian Conference on Image Analysis, volume 2, pages 1007–1014.Google Scholar
  8. [Newborn 1997]
    Newborn, M. 1997. Kasparov vs. Deep Blue: Computer Chess Comes Out of Age. Springer-Verlag.Google Scholar
  9. [Pollock 1994]
    Pollock, R.J. 1994. A Model-based Approach to Automatically Locating Tree Crowns in High Spatial Resolution Images. Image and Signal Processing for Remote Sensing. Jacky Desachy, editor.Google Scholar
  10. [Schaeffer et al. 1992]
    Schaeffer, J., Culberson, J., Treloar, N., Knight, B., Lu, P., Szafron, D. 1992. A World Championship Caliber Checkers Program. Artificial Intelligence, Volume 53, Number 2–3, pages 273–290.CrossRefGoogle Scholar
  11. [Sutton, Barto 2000]
    Sutton, R.S., Barto, A.G., 2000. Reinforcement Learning: An Introduction. MIT Press.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Ilya Levner
    • 1
  • 1Vadim Bulitko
  • Omid Madani
    • 1
  • Russell Greiner
    • 1
  1. 1.University of AlbertaEdmontonCanada

Personalised recommendations