Journal of Medical Systems

, Volume 31, Issue 5, pp 397–432

Methods to Evaluate Health information Systems in Healthcare Settings: A Literature Review


DOI: 10.1007/s10916-007-9082-z

Cite this article as:
Rahimi, B. & Vimarlund, V. J Med Syst (2007) 31: 397. doi:10.1007/s10916-007-9082-z


Although information technology (IT)-based applications in healthcare have existed for more than three decades, methods to evaluate outputs and outcomes of the use of IT-based systems in medical informatics is still a challenge for decision makers, as well as to those who want to measure the effects of ICT in healthcare settings. The aim of this paper is to review published articles in the area evaluations of IT-based systems in order to gain knowledge about methodologies used and findings obtained from the evaluation of IT-based systems applied in healthcare settings. The literature review includes studies of IT-based systems between 2003 and 2005. The findings show that economic and organizational aspects dominate evaluation studies in this area. However, the results focus mostly on positive outputs such as user satisfaction, financial benefits and improved organizational work. This review shows that there is no standard framework for evaluation effects and outputs of implementation and use of IT in the healthcare setting and that until today no studies explore the impact of IT on the healthcare system’ productivity and effectiveness.


Evaluation studiesMedical informaticsLiterature review

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  1. 1.Department of Computer and Information ScienceLinköping UniversityLinköpingSweden
  2. 2.Department of Social MedicineUrmia University of Medical SciencesUrmiaIran