Advance Patient Appointment Scheduling

  • Antoine SauréEmail author
  • Martin L. Puterman
Part of the International Series in Operations Research & Management Science book series (ISOR, volume 248)


This chapter describes the use of the linear programming approach to approximate dynamic programming as a means of solving advance patient appointment scheduling problems, which are problems typically intractable using standard solution techniques. Starting from the linear programming approach to discounted infinite-horizon Markov decision processes, and employing an affine value function approximation in the state variables, the method described in this chapter provides a systematic way of identifying effective booking guidelines for advance patient appointment scheduling problems. Two applications found in the literature allow us to show how these guidelines could be used in practice to significantly increase service levels for medical appointments, measured as the percentage of patients booked within medically acceptable wait times, and thus to decrease the potential impact of delays on patients’ health.


Column Generation Decision Epoch Appointment Slot Markov Decision Process Model Myopic Policy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    D. Adelman, D. Klabjan, Computing near-optimal policies in generalized joint replenishment. INFORMS J. Comput. 24 (1), 148–164 (2012)CrossRefGoogle Scholar
  2. 2.
    D. Adelman, A. Mersereau, Relaxations of weakly coupled stochastic dynamic programs. Oper. Res. 56 (3), 712–727 (2008)CrossRefGoogle Scholar
  3. 3.
    M. Begen, M. Queyranne, Appointment scheduling with discrete random durations. Math. Oper. Res. 36 (2), 240–257 (2011)CrossRefGoogle Scholar
  4. 4.
    M. Begen, J. Patrick, A. Sauré, Dynamic multi-priority, multi-class patient scheduling with stochastic service times. Working Paper (2016)Google Scholar
  5. 5.
    W. Ben-Ameur, J. Neto, Acceleration of cutting-plane and column generation algorithms: applications to network design. Networks 49 (1), 3–17 (2007)CrossRefGoogle Scholar
  6. 6.
    D. Bertsekas, J. Tsitsiklis, Neuro-Dynamic Programming (Athena Scientific, Belmont, MA, 1996)Google Scholar
  7. 7.
    B. Cardoen, E. Demeulemeester, J. Belien, Operating room planning and scheduling: a literature review. Eur. J. Oper. Res. 201 (3), 921–932 (2010)CrossRefGoogle Scholar
  8. 8.
    T. Cayirli, E. Veral, Outpatient scheduling in health care: A review of literature. Prod. Oper. Manag. 12 (4), 519–549 (2003)CrossRefGoogle Scholar
  9. 9.
    D. de Farias, B. Van Roy, The linear programming approach to approximate dynamic programming. Oper. Res. 51 (6), 850–865 (2003)CrossRefGoogle Scholar
  10. 10.
    D. de Farias, B. Van Roy, On constraint sampling in the linear programming approach to approximate dynamic programming. Math. Oper. Res. 29 (3), 462–478 (2004)CrossRefGoogle Scholar
  11. 11.
    F. d’Epenoux, A probabilistic production and inventory problem. Manag. Sci. 10 (1), 98–108 (1963)CrossRefGoogle Scholar
  12. 12.
    C. Derman, Finite State Markovian Decision Processes (Academic Press, Inc., Orlando, FL, 1970)Google Scholar
  13. 13.
    V. Desai, V. Farias, C. Moallemi, A smoothed approximate linear program. Adv. Neural Inf. Process. Syst. 22, 459–467 (2009)Google Scholar
  14. 14.
    A. Erdelyi, H. Topaloglu, Computing protection level policies for dynamic capacity allocation problems by using stochastic approximation methods. IIE Trans. 41, 498–510 (2009)CrossRefGoogle Scholar
  15. 15.
    Y. Gocgun, M. Puterman, Dynamic scheduling with due dates and time windows: an application to chemotherapy patient appointment booking. Health Care Manag. Sci. 17 (1),60–76 (2014)CrossRefGoogle Scholar
  16. 16.
    D. Gupta, B. Denton, Appointment scheduling in health care: challenges and opportunities. IIE Trans. 40 (9), 800–819 (2008)CrossRefGoogle Scholar
  17. 17.
    L. Kallenberg, Linear Programming and Finite Markovian Control Problems (Mathematisch Centrum, Amsterdam, 1983)Google Scholar
  18. 18.
    M. Lübbecke, J. Desrosiers, Selected topics in column generation. Oper. Res. 53 (6), 1007–1023 (2005)CrossRefGoogle Scholar
  19. 19.
    J. Magerlein, J. Martin, Surgical demand scheduling: a review. Health Serv. Res. 13 (4), 418–433 (1978)Google Scholar
  20. 20.
    S. Mondschein, G. Weintraub, Appointment policies in service operations: a critical analysis of the economic framework. Prod. Oper. Manag. 12 (2), 266–286 (2003)CrossRefGoogle Scholar
  21. 21.
    J. Patrick, M. Puterman, M. Queyranne, Dynamic multipriority patient scheduling for a diagnostic resource. Oper. Res. 56 (6), 1507–1525 (2008)CrossRefGoogle Scholar
  22. 22.
    W. Powell, Approximate Dynamic Programming: Solving the Curses of Dimensionality (Wiley-Interscience, Hoboken, NJ, 2011)CrossRefGoogle Scholar
  23. 23.
    A. Sauré, Approximate Dynamic Programming Methods for Advance Patient Scheduling. PhD thesis, The University of British Columbia, 2012Google Scholar
  24. 24.
    A. Sauré, J. Patrick, S. Tyldesley, M. Puterman, Dynamic multi-appointment patient scheduling for radiation therapy. Eur. J. Oper. Res. 223 (2), 573–584 (2012)CrossRefGoogle Scholar
  25. 25.
    A. Sauré, J. Patrick, M.L. Puterman, Simulation-based approximate policy iteration with generalized logistic functions. INFORMS J. Comput. 27 (3), 579–595 (2015)CrossRefGoogle Scholar
  26. 26.
    H. Schütz, R. Kolisch, Approximate dynamic programming for capacity allocation in the service industry. Eur. J. Oper. Res. 218 (1), 239–250 (2012)CrossRefGoogle Scholar
  27. 27.
    P. Schweitzer, A. Seidmann, Generalized polynomial approximations in Markovian decision processes. J. Math. Anal. Appl. 110 (2), 568–582 (1985)CrossRefGoogle Scholar
  28. 28.
    R. Sutton, A. Barto, Reinforcement Learning: An Introduction (MIT Press, Cambridge, MA, 1998)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Telfer School of ManagementUniversity of OttawaOttawaCanada
  2. 2.Sauder School of BusinessUniversity of British ColumbiaVancouverCanada

Personalised recommendations