Markov decision process model for patient admission decision at an emergency department under a surge demand
- 174 Downloads
We study an admission control problem for patients arriving at an emergency department in the aftermath of a mass casualty incident. A finite horizon Markov decision process (MDP) model is formulated to determine patient admission decisions. In particular, our model considers the time-dependent arrival of patients and time-dependent reward function. We also consider a policy restriction that immediate-patients should be admitted as long as there is available beds. The MDP model has a continuous state space, and we solve the model by using a state discretization technique and obtain numerical solutions. Structural properties of an optimal policy are reviewed, and the structures observed in the numerical solutions are explained accordingly. Experimental results with virtual patient arrival scenarios demonstrates the performance and advantage of optimal policies obtained from the MDP model.
KeywordsDisaster response Emergency department Admission control Mass casualty incident Markov decision process Optimal policy
This research was supported by a Grant ‘research and development of modeling and simulating the rescues, the transfer, and the treatment of disaster victims’ (nema-md-2013-36) from the Man-made Disaster Prevention Research Center, National Emergency Management Agency of Korea.
- Christ M, Grossmann F, Winter D, Bingisser R, Platz E (2010) Modern triage in the emergency. Deutsch Ärztebl Int 107(50):892–898Google Scholar
- Institute of Medicine of the National Academies (2005) Hospital-based emergency care: at the breaking point. The National Academies Press, WashingtonGoogle Scholar
- Korea National Emergency Medical Center (2007) Development of the guidelines for inter-hospital transfer. Ewha Womans Univ., Korea National Emergency Medical Center, SeoulGoogle Scholar
- Mills AF, Argon NT, Ziya S (2013) Resource-based patient prioritization in mass-casualty incidents. Manuf Serv Oper Manag 15(3):361–377Google Scholar
- Niska RW, Burt CW (2005) Bioterrorism and mass preparedness in hospitals: United States, 2003. Adv Data 364:1–14Google Scholar
- Xu K, Chan CW (2016) Using future information to reduce waiting times in the emergency department via diversion. Manuf Serv Oper Manag 18(3):314–331Google Scholar