Markov Decision Processes in Practice

Editors:

ISBN: 978-3-319-47764-0 (Print) 978-3-319-47766-4 (Online)

Table of contents (21 chapters)

previous Page of 2
  1. Front Matter

    Pages i-xxxii

  2. General Theory

    1. Front Matter

      Pages 1-1

    2. No Access

      Chapter

      Pages 3-32

      One-Step Improvement Ideas and Computational Aspects

    3. No Access

      Chapter

      Pages 33-62

      Value Function Approximation in Complex Queueing Systems

    4. No Access

      Chapter

      Pages 63-101

      Approximate Dynamic Programming by Practical Examples

    5. No Access

      Chapter

      Pages 103-129

      Server Optimization of Infinite Queueing Systems

    6. No Access

      Chapter

      Pages 131-186

      Structures of Optimal Policies in MDPs with Unbounded Jumps: The State of Our Art

  3. Healthcare

    1. Front Matter

      Pages 187-187

    2. No Access

      Chapter

      Pages 189-222

      Markov Decision Processes for Screening and Treatment of Chronic Diseases

    3. No Access

      Chapter

      Pages 223-244

      Stratified Breast Cancer Follow-Up Using a Partially Observable MDP

    4. No Access

      Chapter

      Pages 245-268

      Advance Patient Appointment Scheduling

    5. No Access

      Chapter

      Pages 269-291

      Optimal Ambulance Dispatching

    6. No Access

      Chapter

      Pages 293-317

      Blood Platelet Inventory Management

  4. Transportation

    1. Front Matter

      Pages 319-319

    2. No Access

      Chapter

      Pages 321-335

      Stochastic Dynamic Programming for Noise Load Management

    3. No Access

      Chapter

      Pages 337-370

      Allocation in a Vertical Rotary Car Park

    4. No Access

      Chapter

      Pages 371-386

      Dynamic Control of Traffic Lights

    5. No Access

      Chapter

      Pages 387-404

      Smart Charging of Electric Vehicles

  5. Production

    1. Front Matter

      Pages 405-405

    2. No Access

      Chapter

      Pages 407-423

      Analysis of a Stochastic Lot Scheduling Problem with Strict Due-Dates

    3. No Access

      Chapter

      Pages 425-438

      Optimal Fishery Policies

    4. No Access

      Chapter

      Pages 439-459

      Near-Optimal Switching Strategies for a Tandem Queue

  6. Communications

    1. Front Matter

      Pages 461-461

    2. No Access

      Chapter

      Pages 463-485

      Wireless Channel Selection with Restless Bandits

    3. No Access

      Chapter

      Pages 487-503

      Flexible Staffing for Call Centers with Non-stationary Arrival Rates

    4. No Access

      Chapter

      Pages 505-519

      MDP for Query-Based Wireless Sensor Networks

previous Page of 2