Discounted Reward Criterion

Abstract

We begin in Section 2.2 by giving conditions under which υ* satisfies the Dynamic Programming Equation (Theorem 2.2), and in Section 2.3 we relate asymptotic discount optimality to a function that measures the “discrepancy” between an optimal action in state x and any other action α ∈ A(x). (Recall that A(x) denotes the set of admissible controls in state x; see Section 1.2.)