Abstract
The application of information and computer technology (ICT) to education, particularly when ICT is a component of a major school reform, raises difficult issues for program evaluation. In many cases even defining the program goal is difficult because so many different changes are often instituted at the same time: installation of a local area network, development of technical support, staff development for integrating ICT into the curriculum and for new teaching methods, and so on. To assist program developers and evaluators in gaining control of such complex interventions in education, two basic procedures are described: the history of the future and program logic mapping. The former is a goals and methods clarification scheme, built around a press release that describes at the projected end of the project what was achieved and how. The latter procedure draws on the goals defined in the history of the future, along with the project strategy, to make explicit all of the major links between project inputs and project outputs. This map then serves as a guide for planning an evaluation that would verify causal linkages as well as outcomes. For each type of node in such a diagram, appropriate evaluation techniques are defined.
Similar content being viewed by others
REFERENCES
Achen, C. H. (1986). The Statistical Analysis of Quasi-Experiments, University of California Press, Berkeley.
Campbell, D. T., and Stanley, J. C. (1971). Experimental and Quasi-Experimental Design for Research, Rand McNally, Chicago.
Hativa, N. (1988). Computer-based drill and practice in arithmetic: Widening the gap between high-and low-achieving students. American Educational Research Journal 25: 366–397.
McLaughlin, M. W. (1989). The RAND Change Agent Study Ten Years Later: Macro Perspectives and Micro Realities, Center for Research on the Context of Secondary School Teaching, Stanford University.
McLaughlin, M. W., and Phillips, D. C. (Eds.). (1991). Evaluation and Education: At Quarter Century (Ninetieth Yearbook of the National Society for the Study of Education), Distributed by the University of Chicago Press, Chicago.
Mosteller, F., Light, R. J., and Sachs, J. A. (1996). Sustained inquiry in education. Lessons from skill grouping and classs size. Harvard Educational Review 66: 797–842.
Wholey, J. S. (1979). Evaluation-Promise andPerformance, Urban Institute, Washington, DC.
Yin, R. K. (1993). Applications of Case Study Research, Sage, Newbury Park, California.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Venezky, R.L. Procedures for Evaluating the Impact of Complex Educational Interventions. Journal of Science Education and Technology 10, 17–30 (2001). https://doi.org/10.1023/A:1016664426024
Issue Date:
DOI: https://doi.org/10.1023/A:1016664426024