Skip to main content
SpringerLink
Log in

Simulation Modelling in Healthcare: An Umbrella Review of Systematic Literature Reviews

  • Review Article
  • Published:
PharmacoEconomics Aims and scope Submit manuscript

Abstract

Background

Numerous studies examine simulation modelling in healthcare. These studies present a bewildering array of simulation techniques and applications, making it challenging to characterise the literature.

Objective

The aim of this paper is to provide an overview of the level of activity of simulation modelling in healthcare and the key themes.

Methods

We performed an umbrella review of systematic literature reviews of simulation modelling in healthcare. Searches were conducted of academic databases (JSTOR, Scopus, PubMed, IEEE, SAGE, ACM, Wiley Online Library, ScienceDirect) and grey literature sources, enhanced by citation searches. The articles were included if they performed a systematic review of simulation modelling techniques in healthcare. After quality assessment of all included articles, data were extracted on numbers of studies included in each review, types of applications, techniques used for simulation modelling, data sources and simulation software.

Results

The search strategy yielded a total of 117 potential articles. Following sifting, 37 heterogeneous reviews were included. Most reviews achieved moderate quality rating on a modified AMSTAR (A Measurement Tool used to Assess systematic Reviews) checklist. All the review articles described the types of applications used for simulation modelling; 15 reviews described techniques used for simulation modelling; three reviews described data sources used for simulation modelling; and six reviews described software used for simulation modelling. The remaining reviews either did not report or did not provide enough detail for the data to be extracted.

Conclusion

Simulation modelling techniques have been used for a wide range of applications in healthcare, with a variety of software tools and data sources. The number of reviews published in recent years suggest an increased interest in simulation modelling in healthcare.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

References

  1. Grant M, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26(2):91–108.

    Article  PubMed  Google Scholar 

  2. Mahdavi M, Malmström T, Van De Klundert J, Elkhuizen S, Vissers J. Generic operational models in health service operations management: a systematic review. Socioecon Plann Sci. 2013;47(4):271–80.

    Article  Google Scholar 

  3. Aromataris E, Fernandez R, Godfrey C, Holl C, Khalil H, Tungpunkom P. Methodology for JBI umbrella reviews. Adelaide: Joanna Brigs Institute; 2013. p. 2. http://joannabriggs.org/assets/docs/sumari/ReviewersManual-Methodology-JBI_Umbrella%20Reviews-2014.pdf. Accessed 8 Nov 2014.

  4. Holly C, Salmond S, Saimbert M. Comprehensive systematic review for advanced nursing practice. New York: Springer; 2012. p. 86.

    Google Scholar 

  5. Shea B, Grimshaw J, Wells G, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7(1):10.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Wegewitz U, Weikert B, Fishta A, Jacobs A, Pieper D. Resuming the discussion of AMSTAR: what can (should) be made better? BMC Med Res Methodol. 2016;16(1):111.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Klein R, Dittus R, Roberts S, Wilson J. Simulation modeling and health-care decision making. Med Decis Making. 1993;13(4):347–54.

    Article  CAS  PubMed  Google Scholar 

  8. Fone D, Hollinghurst S, Temple M, Round A, Lester N, Weightman A, et al. Systematic review of the use and value of computer simulation modelling in population health and health care delivery. J Public Health Med. 2003;25(4):325–35.

    Article  PubMed  Google Scholar 

  9. White K. A survey of data resources for simulating patient flows in healthcare delivery systems. In: Proceedings of the winter simulation conference. IEEE; 2005. p. 926–34. http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=1574341. Accessed 31 Dec 2014.

  10. Hoot N, Aronsky D. Systematic review of emergency department crowding: causes, effects, and solutions. Ann Emerg Med. 2008;52(2):126–136.e1.

    Article  PubMed  Google Scholar 

  11. Sobolev B, Sanchez V, Vasilakis C. Systematic review of the use of computer simulation modeling of patient flow in surgical care. J Med Syst. 2009;35(1):1–16.

    Article  PubMed  Google Scholar 

  12. Jack E, Powers T. A review and synthesis of demand management, capacity management and performance in health-care services. Int J Manag Rev. 2009;11(2):149–74.

    Article  Google Scholar 

  13. Brailsford S, Harper P, Patel B, Pitt M. An analysis of the academic literature on simulation and modelling in health care. J Simul. 2009;3(3):130–40.

    Article  Google Scholar 

  14. Mielczarek B, Uzialko-Mydlikowska J. Application of computer simulation modeling in the health care sector: a survey. Simulation. 2010;88(2):197–216.

    Article  Google Scholar 

  15. Paul S, Reddy M, DeFlitch C. A systematic review of simulation studies investigating emergency department overcrowding. Simulation. 2010;86(8–9):559–71.

    Article  Google Scholar 

  16. Mustafee N, Katsaliaki K, Taylor S. Profiling literature in healthcare simulation. Simulation. 2010;86(8–9):543–58.

    Article  Google Scholar 

  17. Cardoen B, Demeulemeester E, Belien J. Operating room planning and scheduling: a literature review. Eur J Oper Res. 2010;201(3):921–32.

    Article  Google Scholar 

  18. Katsaliaki K, Mustafee N. Applications of simulation within the healthcare context. J Oper Res Soc. 2010;62(8):1431–51.

    Article  Google Scholar 

  19. Guerriero F, Guido R. Operational research in the management of the operating theatre: a survey. Health Care Manag Sci. 2010;14(1):89–114.

    Article  PubMed  Google Scholar 

  20. Günal M, Pidd M. Discrete event simulation for performance modelling in health care: a review of the literature. J Simulat. 2010;4(1):42–51.

    Article  Google Scholar 

  21. Van Sambeek J, Cornelissen F, Bakker P, Krabbendam J. Models as instruments for optimizing hospital processes: a systematic review. Int J Health Care Qual Assur. 2010;23(4):356–77.

    Article  PubMed  Google Scholar 

  22. Fakhimi M, Mustafee N. Application of Operations Research within the UK Healthcare Context. Operational Research Society Simulation Workshop. The Operational Research Society; 2012. p. 66-82. http://www.theorsociety.com/Pages/ImagesAndDocuments/documents/Conferences/SW12/Papers/FakhimiMustafee.pdf. Accessed 22 Apr 2017.

  23. Hulshof P, Kortbeek N, Boucherie R, Hans E, Bakker P. Taxonomic classification of planning decisions in health care: a structured review of the state of the art in OR/MS. Health Syst. 2012;1(2):129–75.

    Article  Google Scholar 

  24. Van Lent W, VanBerkel P, Van Harten W. A review on the relation between simulation and improvement in hospitals. BMC Med Inform Decis Making. 2012;12(18):1–8.

    Google Scholar 

  25. Beliën J, Forcé H. Supply chain management of blood products: a literature review. Eur J Oper Res. 2012;217(1):1–16.

    Article  Google Scholar 

  26. Aboueljinane L, Sahin E, Jemai Z. A review on simulation models applied to emergency medical service operations. Comput Ind Eng. 2013;66(4):734–50.

    Article  Google Scholar 

  27. Fakhimi M, Probert J. Operations research within UK healthcare: a review. J Enterprise Inf Manag. 2013;26(1/2):21–49.

    Article  Google Scholar 

  28. Timbie J, Ringel J, Fox D, Pillemer F, Waxman D, Moore M, et al. Systematic review of strategies to manage and allocate scarce resources during mass casualty events. Ann Emerg Med. 2013;61(6):677–689.e101.

    Article  PubMed  Google Scholar 

  29. Pomey M, Forest P, Sanmartin C, DeCoster C, Clavel N, Warren E, et al. Toward systematic reviews to understand the determinants of wait time management success to help decision-makers and managers better manage wait times. Implement Sci. 2013;8(1):61.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Verbano C, Crema M. Guidelines for overcoming hospital managerial challenges: a systematic literature review. Ther Clin Risk Manag. 2013;9:427–41.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Lakshmi C, Sivakumar A. Application of queueing theory in health care: a literature review. Oper Res Health Care. 2013;2(1–2):25–39.

    Google Scholar 

  32. Kammoun A, Loukil T, Hachicha W. The use of discrete event simulation in hospital supply chain management. In: 2014 International conferences on advanced logistics and transport (ICALT), Hammamet. IEEE; 2014. p. 143–8. doi:10.1109/ICAdLT.2014.6864108. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6864108&isnumber=6864062. Accessed 26 May 2017.

  33. Carey G, Malbon E, Carey N, Joyce A, Crammond B, Carey A. Systems science and systems thinking for public health: a systematic review of the field. BMJ Open. 2015;5(12):e009002.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Atkinson J, Wells R, Page A, Dominello A, Haines M, Wilson A. Applications of system dynamics modelling to support health policy. Public Health Res Pract. 2015;25(3):e2531531.

    Article  PubMed  Google Scholar 

  35. Baru R, Cudney E, Guardiola I. Systematic review of operations research and simulation methods for bed management. In: Proceedings of the 2015 industrial and systems engineering research conference. ResearchGate; 2015. p. 298–306. https://www.researchgate.net/publication/308971444_Systematic_Review_of_Operations_Research_and_Simulation_Methods_for_Bed_Management. Accessed 26 May 2017.

  36. Isern D, Moreno A. A systematic literature review of agents applied in healthcare. J Med Syst. 2015;40(2):43.

    Article  PubMed  Google Scholar 

  37. Gul M, Guneri A. A comprehensive review of emergency department simulation applications for normal and disaster conditions. Comput Ind Eng. 2015;83:327–44.

    Article  Google Scholar 

  38. Vieira B, Hans E, Van Vliet-Vroegindeweij C, Van de Kamer J, van Harten W. Operations research for resource planning and -use in radiotherapy: a literature review. BMC Med Inform Decis Making. 2016;16(1):3–11.

    Article  Google Scholar 

  39. Mielczarek B. Review of modelling approaches for healthcare simulation. Oper Res Decis. 2016;26(1):55–72.

    Google Scholar 

  40. Palmer R, Fulop N, Utley M. A systematic literature review of operational research methods for modelling patient flow and outcomes within community healthcare and other settings. Health Syst. 2017;6(15):1–21.

    Google Scholar 

  41. Soh K, Walker C, O’Sullivan M. A literature review on validated simulations of the surgical services. J Med Syst. 2017;41(4):61.

    Article  CAS  PubMed  Google Scholar 

  42. Mohiuddin S, Busby J, Savovi J, Richards A, Northstone K, Hollingworth W, et al. Patient flow within UK emergency departments: a systematic review of the use of computer simulation modelling methods. BMJ Open. 2017;7(5):1–14.

    Article  Google Scholar 

  43. Jun J, Jacobson S, Swisher J. Application of discrete-event simulation in health care clinics: a survey. J Oper Res Soc. 1999;50(2):109.

    Article  Google Scholar 

  44. Lehaney B, Hlupic V. Simulation modelling for resource allocation and planning in the health sector. J R Soc Promot Health. 1995;115(6):382–5.

    Article  CAS  Google Scholar 

  45. Jacobson SH, Hall SN, Swisher JR. Discrete-event simulation of health care systems. In: Hall R, editor. Patient flow: reducing delay in healthcare delivery. New York: Springer; 2006. p. 211–52.

    Chapter  Google Scholar 

  46. Thorwarth M, Arisha A. Application of discrete-event simulation in health care: a review. Reports. Paper 3. Dublin Institute of Technology; 2009. p. 1–32. http://arrow.dit.ie/buschmanrep/3/?utm_source=arrow.dit.ie%2Fbuschmanrep%2F3&utm_medium=PDF&utm_campaign=PDFCoverPages. Accessed 6 Nov 2015.

  47. Vanberkel P, Boucherie R, Hans E, Hurink J, Litvak N. A survey of health care models that encompass multiple departments. University of Twente; 2009. p. 1–49. http://doc.utwente.nl/67545/1/memo1903.pdf. Accessed 2 Jan 2016.

  48. Soni K, Saxena K. A study of applicability of waiting line model in health care: a systematic review. Int J Mark Technol. 2011;19(1):75–91.

    Google Scholar 

  49. Atuahene I, Kubi P, Acosta-Amando R, Lacera-Cortes I, Sawhney R, Atuahene E, et al. Towards an operations research sustainable healthcare: an overview of recent applications of OR in healthcare. In: Industrial and systems engineering research conference. ResearchGate; 2014. p. 1–12. https://www.researchgate.net/publication/287394488_Towards_an_operations_research_sustainable_healthcare_An_overview_of_recent_applications_of_or_in_healthcare. Accessed 26 May 2017.

  50. White L, Smith H, Currie C. OR in developing countries: a review. Eur J Oper Res. 2011;208(1):1–11.

    Article  Google Scholar 

  51. Van den Bergh J, Beliën J, De Bruecker P, Demeulemeester E, De Boeck L. Personnel scheduling: a literature review. Eur J Oper Res. 2013;226(3):367–85.

    Article  Google Scholar 

  52. Xing Y, Li L, Bi Z, Wilamowska-Korsak M, Zhang L. Operations research (OR) in service industries: a comprehensive review. Syst Res. 2013;30(3):300–353. http://onlinelibrary.wiley.com/doi/10.1002/sres.2185/abstract. Accessed 26 May 2017.

  53. Dangerfield B. System dynamics applications to European health care issues. J Oper Res Soc. 1999;50(4):345–53.

    Article  Google Scholar 

  54. Wolstenholme E. Health care in the United Kingdom and Europe, system dynamics applications to. In: Meyers RA, editor. Encyclopedia of complexity and systems science. New York: Springer Science + Business Media, LLC; 2009. p. 4561–76.

    Chapter  Google Scholar 

  55. Hammond R. Complex systems modeling for obesity research. Prev Chronic Dis. 2009;6(3):1–10.

    Google Scholar 

  56. Diez Roux A. Complex systems thinking and current impasses in health disparities research. Am J Public Health. 2011;101(9):1627–34.

    Article  Google Scholar 

  57. Luke D, Stamatakis K. Systems science methods in public health: dynamics, networks, and agents. Annu Rev Public Health. 2012;33(1):357–76.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Heesterbeek H, Anderson R, Andreasen V, Bansal S, De Angelis D, Dye C, et al. Modeling infectious disease dynamics in the complex landscape of global health. Science. 2015;347(6227):1–24.

    Article  Google Scholar 

  59. Eaton J, Johnson L, Salomon J, Bärnighausen T, Bendavid E, Bershteyn A, et al. HIV treatment as prevention: systematic comparison of mathematical models of the potential impact of antiretroviral therapy on HIV incidence in South Africa. PLoS Med. 2012;9(7):1–20.

    Article  Google Scholar 

  60. Brennan A, Chick S, Davies R. A taxonomy of model structures for economic evaluation of health technologies. Health Econ. 2006;15(12):1295–310.

    Article  PubMed  Google Scholar 

  61. AHRQ. Decision and simulation modeling: review of existing guidance, future research needs, and validity assessment. Maryland: AHRQ; 2014. p. 1–54. https://effectivehealthcare.ahrq.gov/index.cfm/search-for-guides-reviews-and-reports/?pageaction=displayproduct&productid=1965. Accessed 12 May 2017.

  62. Marshall D, Burgos-Liz L, IJzerman M, Crown W, Padula W, Wong P, et al. Selecting a dynamic simulation modeling method for health care delivery research—part 2: report of the ISPOR Dynamic Simulation Modeling Emerging Good Practices Task Force. Value Health. 2015;18(2):147–60.

    Article  PubMed  Google Scholar 

  63. Marshall D, Burgos-Liz L, IJzerman M, Osgood N, Padula W, Higashi M, et al. Applying dynamic simulation modeling methods in health care delivery research—the SIMULATE checklist: report of the ISPOR Simulation Modeling Emerging Good Practices Task Force. Value Health. 2015;18(1):5–16.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We thank all of those who contributed to this work. In addition, the corresponding author (SS) would like to thank Majlis Amanah Rakyat (MARA) for sponsoring this project.

Author information

Authors and Affiliations

  1. School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK

    Syed Salleh, Praveen Thokala, Alan Brennan, Ruby Hughes & Andrew Booth

Authors
  1. Syed Salleh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Praveen Thokala
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alan Brennan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ruby Hughes
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andrew Booth
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The study idea originated from PT and was further developed in discussions with SS, and finalised in communication with all authors. SS coordinated the data collection and interpretation, which was agreed among all authors. SS and PT wrote the initial draft, with all authors contributing to the submitted version and also revising the manuscript based on reviewers’ comments. SS is the overall guarantor for the manuscript.

Corresponding author

Correspondence to Syed Salleh.

Ethics declarations

Funding

This work was supported by the Majlis Amanah Rakyat (MARA).

Conflict of interest

Syed Salleh, Praveen Thokala, Alan Brennan, Ruby Hughes and Andrew Booth declare that they have no conflicts of interest.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 155 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Salleh, S., Thokala, P., Brennan, A. et al. Simulation Modelling in Healthcare: An Umbrella Review of Systematic Literature Reviews. PharmacoEconomics 35, 937–949 (2017). https://doi.org/10.1007/s40273-017-0523-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40273-017-0523-3

Search

Navigation