1. Preface

   EditorialNotes Pages: VII - VII

2. Non-randomized strategies in stochastic decision processes

   • Eugene A. Feinberg

   Borel State Space Pages: 315 - 332

3. Infinite horizon programs; convergence of approximate solutions

   • Sjur D. Flåm
   • Alain Fougères

   Borel State Space Pages: 333 - 350

4. Turnpike properties for a class of piecewise deterministic systems arising in manufacturing flow control

   • A. Haurie
   • Ch. Van Delft

   Borel State Space Pages: 351 - 373

5. Average cost Markov decision processes under the hypothesis of Doeblin

   • Masami Kurano

   Borel State Space Pages: 375 - 385

6. A theory of rolling horizon decision making

   • Suresh Sethi
   • Gerhard Sorger

   Borel State Space Pages: 387 - 415

7. On an extremal property of Markov chains and sufficiency of Markov strategies in Markov decision processes with the Dubins-Savage criterion

   • I. M. Sonin

   Borel State Space Pages: 417 - 426

8. A remark on control of partially observed Markov chains

   • Vivek S. Borkar

   Partially Observable Markov Decision Processes Pages: 429 - 438

9. On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes

   • Emmanuel Fernández-Gaucherand
   • Aristotle Arapostathis
   • Steven I. Marcus

   Partially Observable Markov Decision Processes Pages: 439 - 469

10. On the computation of the optimal cost function for discrete time Markov models with partial observations

    • Enrique L. Sernik
    • Steven I. Marcus

    Partially Observable Markov Decision Processes Pages: 471 - 511

11. On truncations and perturbations of Markov decision problems with an application to queueing network overflow control

    • Nico M. Van Dijk

    Computational Issues Pages: 515 - 535

12. Competing Markov decision processes

    • K. D. Glazebrook

    Computational Issues Pages: 537 - 563

13. Increasing Lipschitz continuous maximizers of some dynamic programs

    • K. Hinderer

    Computational Issues Pages: 565 - 585

14. Scheduling jobs on heterogeneous processors

    • Rhonda Righter
    • Susan XU

    Computational Issues Pages: 587 - 601

15. Block-scaling of value-iteration for discounted Markov renewal programming

    • Paul J. Schweitzer

    Computational Issues Pages: 603 - 630

16. Replacement process decomposition for discounted Markov renewal programming

    • P. J. Schweitzer
    • U. Sumita
    • K. Ohno

    Computational Issues Pages: 631 - 645