Evaluating Health Services, Programs, and Systems

An Epidemiological Perspective
  • Dolores G. Clement
  • Thomas T. H. Wan


Evaluation will continue to play an important role for health care managers in all coun- tries, particularly in light of population-based planning, for several reasons. First, the organiza- tion of formal and informal alliances in the health care industry and the competition among them will prompt managers to continuously evaluate morbidity, mortality, and disability trends associated with service delivery and treatment of health problems in order to modify or discard services and treatments that are not efficient, effective, and of high quality. Second, the number and size of social programs have grown over time with the broadening scope of government involvement in health and social service issues. The application of epidemiological methods is useful for monitoring the health of the population and identifying changes over time. Epidemiology is based on the premise that health problems that can be identified often can be corrected. Last, programs addressing the needs of aging populations will proliferate and necessitate evaluation to assess changing needs, assure that expectations are met, and promote achievement of the desired health outcomes.Epidemiological methods can be used effectively to target identified needs and to assess the implications of programs or interventions for health care policy.


Invasive Cervical Cancer Smoking Cessation Program Birth Center Epidemiological Method Time Series Design 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Anderson, S., Auquier, A., Hauck, W. W., Oakes, D., Vandaele, W., and Wersberg, H. I., 1980, Statistical Methods for Comparative Studies, John Wiley & Sons, New York.Google Scholar
  2. Anonymous, 1999, European multicenter study of natural family planning (1989–1995): Efficacy and drop-out. The European Natural Family Planning Study Groups. Adv. Contracep. 15:69–83.Google Scholar
  3. Bibeau, D., Mullen, K., McLeroy, K., Green, L., and Foshee, V., 1988, Evaluations of workplace smoking cessation programs: A critique. Am. J. Prev. Med. 4:87–95.PubMedGoogle Scholar
  4. Bohlke, K., Harlow, B. L., Cramer, D. W., Spiegelman, D., and Mueller, N. E., 1999, Evaluation of a population roster as a source of population controls: The Massachusetts resident lists, Am. J. Epidemiol. 150:354–358.PubMedGoogle Scholar
  5. Box, G. E. P., and Jenkins, G. M., 1976, Time Series Analysis: Forecasting and Control, Holden-Day, San Francisco.Google Scholar
  6. Clement, D. G., Retchin, S. M., Brown, R. S., and Stegall, M. H., 1994, Access and outcomes of elderly patients enrolled in managed care, JAMA 271:1487–1492.PubMedCrossRefGoogle Scholar
  7. Cox, D. R., 1972, Regression models and life-tables, J. R. Statist. Soc. B34:187–220.Google Scholar
  8. DerSimonian, R., and Laird, N., 1986, Meta-analysis in clinical trials, Controlled Clin. Trials 7:177–188.PubMedGoogle Scholar
  9. Donabedian, A., 1980, Explorations in Quality Assessment and Monitoring—Volume I: The Definition of Quality and Approaches to Its Assessment, Health Administration Press, Ann Arbor, MI.Google Scholar
  10. Drummond, M. F., O’Brien, B. J., Stoddart, G. L., and Torrance, G. W., 1997, Methods for the Economic Evaluation of Health Programmes, 2nd ed., Oxford University Press, Cary, NC.Google Scholar
  11. Elam, K., Taylor, V., Ciol, M. A., Franklin, G. M., and Deyo, R. A., 1997, Impact of a worker’s compensation practice guideline on lumbar spine fusion in Washington State, Med. Care 35:417–424.PubMedCrossRefGoogle Scholar
  12. Funkhouser, E., Macaluso, M., and Wang, X., 2000, Alternative strategies for selecting population controls: Comparison of random digit dialing and targeted telephone calls, Ann. Epidemiol. 10:59–67.PubMedCrossRefGoogle Scholar
  13. Glasgow, R. E., Vogt, T. M., and Boles, S. M., 1999, Evaluating the public health impact of health promotion interventions: The RE-AIM framework, Am. J. Pub. Health 89:1322–1327.PubMedGoogle Scholar
  14. Greenlick, M. R., 1981, Assessing clinical competence: A society view, Eval. Health Profess. 4:3–12.Google Scholar
  15. Kahn, H. A., and Sempos, C. T., 1989, Statistical Methods in Epidemiology, Oxford University Press, New York.Google Scholar
  16. Kaplan, E. L., and Meier, P., 1958, Nonparametric estimation from incomplete observations, J. Am. Statist. Assoc. 53:457–481.Google Scholar
  17. Kotchen, J. M., McKean, H. E., Jackson-Thayer, S., Moore, R. W., Straus, R., and Kotchen, T., 1986, Impact of a rural high blood pressure control program on hypertension control and cardiovascular disease mortality, JAMA 255:2177–2182.PubMedCrossRefGoogle Scholar
  18. Lane, D. S., Polednak, A. P., and Burg, M. A., 1992, Breast cancer screening practices among users of county-funded health centers vs. women in the entire community, Am. J. Pub. Health 82:199–203.PubMedCrossRefGoogle Scholar
  19. Leveille, S. G., Guralnik, J. M., Ferrucci, L., and Langlois, J. A., 1999, Aging successfully until death in old age: Opportunities for increasing active life expectancy, Am. J. Epidemiol. 149:654–664.PubMedGoogle Scholar
  20. Levy, P. S., and Lemeshow, S., 1999, Sampling of Populations, 3rd ed., John Wiley & Sons, New York.Google Scholar
  21. Moritz, D. J., Kelsey, J. L., and Grisso, J. A., 1997, Hospital controls versus community controls: Differences in inferences regarding risk factors for hip fracture, Am. J. Epidemiol. 145:653–660.PubMedGoogle Scholar
  22. Murray, D. M., 1998, Design and Analysis of Group-Randomized Trials, Oxford University Press, New York.Google Scholar
  23. National Center for Health Statistics, 2000, Health United States, 2000, with Adolescent Chartbook, Author, Hyattsville, MD.Google Scholar
  24. Nieminen, P., Kallio, M., Anttila, A., and Hakama, M., 1999, Organised vs. spontaneous Pap smear screening for cervical cancer: A case-control study, Int. J. Cancer 83:55–58.PubMedCrossRefGoogle Scholar
  25. Okada, L. M., and Wan, T. T. H., 1980, Impact of community health centers and Medicaid on the use of health services, Pub. Health Rep. 95:520–534.Google Scholar
  26. Olson, S. H., Kelsey, J. L., Pearson, T. A., and Levin, B., 1992, Evaluation of random digit dialing as a method of control selection in case-control studies, Am. J. Epidemiol. 135:210–222.PubMedGoogle Scholar
  27. Olson, S. H., Mignone, L., and Harlap, S., 2000, Selection of control groups by using a commercial database and random digit dialing, Am. J. Epidemiol. 152:585–592.PubMedCrossRefGoogle Scholar
  28. Retchin, S. M., and Brown, B., 1990, The quality of ambulatory care in Medicare health maintenance organizations, Am. J. Pub. Health 80:411–415.PubMedGoogle Scholar
  29. Rohrer, J. E., 1993, Small area analysis: Descriptive epidemiology in health services research, Clin. Perf. Qual. Health Care 1:35–42.Google Scholar
  30. Rooks, J. P., Weatherby, N. L., Ernst, E., Stapleton, S., Rosen, D., and Rosenfield, A., 1989, Outcomes of care in birth centers, New Engl. J. Med. 321:1804–1811.PubMedCrossRefGoogle Scholar
  31. Rosen, H. M., and Feigin, W., Sr, 1983, Quality assurance and data feedback, Health Care Manage. Rev. 8:67–74.PubMedGoogle Scholar
  32. Sackett, D. L., 1979, Bias in analytic research, J. Chronic Dis. 32:51–63.PubMedCrossRefGoogle Scholar
  33. SAS Institute, Inc., 2000, SAS/ETS Software: Time series forecasting system, version 6, 1st ed., SAS Institute, Cary, NC.Google Scholar
  34. Shea, D., Stuart, B., Vasey, J., and Nag, S., 1999, Medicare physician referral patterns, HSR: Health Serv. Res. 34: 331–348.PubMedGoogle Scholar
  35. Villar, J., Bakketeig, L., Donner, A., Al-Mazrou, Y., Ba’aqeel, H., Belizan, J. M., Carroli, G., Farnot, U., Lumbiganon, P., Piaggio, G., and Berendes, H., 1998, The WHO Antenatal Care Randomised Controlled Trial: Rationale and study design, Paediatr. Perinat. Epidemiol. 12(Suppl.2):7–58.PubMedGoogle Scholar
  36. Vogt, T. M., and Schweitzer, S. O., 1985, Medical costs of cigarette smoking in a health maintenance organization, Am. J. Epidemiol. 122:1060–1066.PubMedGoogle Scholar
  37. Wan, T. T. H., Weissert, W. G., and Livieratos, B. B., 1980, Geriatric day care and homemaker services: An experimental study, J. Gerontol. 35:256–274.PubMedGoogle Scholar
  38. Wolinsky, F. D., and Johnson, R. J., 1991, The use of health services by older adults, J. Gerontol. 46:S345–357.PubMedGoogle Scholar
  39. World Health Organization, 2000, The World Health Report 2000, WHO, Geneva, Switzerland.Google Scholar
  40. Young, G. J., and Cohen, B. B., 1991, Inequities in hospital care, the Massachusetts experience, Inquiry 28:255–262.PubMedGoogle Scholar

Copyright information

© Kluwer Academic Publishers 2002

Authors and Affiliations

  • Dolores G. Clement
    • 1
  • Thomas T. H. Wan
    • 1
  1. 1.Department of Health Administration, School of Allied Health ProfessionsVirginia Commonwealth UniversityRichmond

Personalised recommendations