Validation of the World Health Organization Tool for Situational Analysis to Assess Emergency and Essential Surgical Care at District Hospitals in Ghana
The World Health Organization (WHO) Tool for Situational Analysis to Assess Emergency and Essential Surgical Care (hereafter called the WHO Tool) has been used in more than 25 countries and is the largest effort to assess surgical care in the world. However, it has not yet been independently validated. Test–retest reliability is one way to validate the degree to which tests instruments are free from random error. The aim of the present field study was to determine the test–retest reliability of the WHO Tool.
The WHO Tool was mailed to 10 district hospitals in Ghana. Written instructions were provided along with a letter from the Ghana Health Services requesting the hospital administrator to complete the survey tool. After ensuring delivery and completion of the forms, the study team readministered the WHO Tool at the time of an on-site visit less than 1 month later. The results of the two tests were compared to calculate kappa statistics for each of the 152 questions in the WHO Tool. The kappa statistic is a statistical measure of the degree of agreement above what would be expected based on chance alone.
Ten hospitals were surveyed twice over a short interval (i.e., less than 1 month). Weighted and unweighted kappa statistics were calculated for 152 questions. The median unweighted kappa for the entire survey was 0.43 (interquartile range 0–0.84). The infrastructure section (24 questions) had a median kappa of 0.81; the human resources section (13 questions) had a median kappa of 0.77; the surgical procedures section (67 questions) had a median kappa of 0.00; and the emergency surgical equipment section (48 questions) had a median kappa of 0.81.
Hospital capacity survey questions related to infrastructure characteristics had high reliability. However, questions related to process of care had poor reliability and may benefit from supplemental data gathered by direct observation. Limitations to the study include the small sample size: 10 district hospitals in a single country. Consistent and high correlations calculated from the field testing within the present analysis suggest that the WHO Tool for Situational Analysis is a reliable tool where it measures structure and setting, but it should be revised for measuring process of care.
- Farmer PE, Kim JY (2008) Surgery and global health: a view from beyond the OR. World J Surg 32:533–536 CrossRef
- Weiser TG, Regenbogen SE, Thompson KD et al (2008) An estimation of the global volume of surgery: a modelling strategy based on available data. Lancet 372:139–144 CrossRef
- Debas HT, Gosselin R, McCord C et al (2006) Surgery. In: Jamison D (ed) Disease control priorities in developing countries, 2nd edn. Oxford University Press, New York, pp 1245–1260
- Emergency and Essential Surgical Care (2009) http://www.who.int/surgery/globalinitiative/en/. Accessed 5 April 2010
- Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174 CrossRef
- Shengelia B, Tandon A, Adams OB et al (2005) Access, utilization, quality, and effective coverage: an integrated conceptual framework and measurement strategy. Soc Sci Med 61:97–109 CrossRef
- Bickler SW, Spiegel DA (2008) Global surgery: defining a research agenda. Lancet 372:90–92 CrossRef
- National Health Insurance Act of 2003. http://www.nhis.gov.gh/?CategoryID=158&ArticleID=80. Accessed 5 April 2010
- Donabedian A (1966) Evaluating the quality of medical care. Milbank Mem Fund Q 44:166–206 CrossRef
- Validation of the World Health Organization Tool for Situational Analysis to Assess Emergency and Essential Surgical Care at District Hospitals in Ghana
- Open Access
- Available under Open Access This content is freely available online to anyone, anywhere at any time.
World Journal of Surgery
Volume 35, Issue 3 , pp 500-504
- Cover Date
- Print ISSN
- Online ISSN
- Additional Links
- Industry Sectors
- Author Affiliations
- 1. Department of Surgery, Center for Surgical Systems and Public Health, University of California San Diego, San Diego, CA, USA
- 2. Department of Surgery, Johns Hopkins University, Baltimore, MD, USA
- 3. Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, USA
- 4. Department of Surgery, Korle Bu Teaching Hospital, Accra, Ghana
- 5. Department of Surgery, Komfo Anokye Teaching Hospital, Kumasi, Ghana
- 6. Department of Surgery, Columbia University, New York, NY, USA