Skip to main content

Advertisement

SpringerLink
Log in

THE INQUIRY SCIENCE IMPLEMENTATION SCALE: DEVELOPMENT AND APPLICATIONS

  • Published:
International Journal of Science and Mathematics Education Aims and scope Submit manuscript

Abstract

Instruments for evaluating the implementation of inquiry science in K-12 classrooms are necessary if evaluators and researchers are to know the extent to which programs are implemented as intended and the extent to which inquiry science teaching accounts for student learning. For evaluators and researchers to be confident about the quality of these instruments, information about their development and validation—particularly about teacher self-report instruments—must be available. In this article, we present the Inquiry Science Implementation Scale, describe the instrument’s development and the results of analyses of the validity and reliability of data collected with it, and discuss the possible uses of the instrument.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adams, A. S., Soumerai, S. B., Lomas, J., & Ross-Degnan, D. (1999). Evidence of self-report bias in assessing adherence to guidelines. International Journal of Quality in Health Care, 11, 187–192.

    Article  Google Scholar 

  • Anderson, R. D. (2002). Reforming science teaching: What research says about inquiry. Journal of Science Teacher Education, 13(1), 1–12.

    Article  Google Scholar 

  • Ball, D. L., Camburn, E., Correnti, R., Phelps, G., & Wallace, R. (1999). New tools for research on instruction and instructional policy: A Web-based teacher log. Seattle, WA: University of Washington, Center for the Study of Teaching and Policy.

    Google Scholar 

  • Bass, B. M., Cascio, W. F., & O’Connor, E. (1974). Magnitude estimations of frequency and amount. Journal of Applied Psychology, 59, 313–320.

    Article  Google Scholar 

  • Bond, G. R., Evans, L., Salyers, M. P., Williams, J., & Kim, H.-W. (2000). Measurement of fidelity in psychiatric rehabilitation. Mental Health Services Research, 2(2), 75–87.

    Article  Google Scholar 

  • Brandon, P. R., Taum, A. K. H., Young, D. B., Speitel, T. W., Pottenger, F. M. III, Nguyen, T. T., & Gray, M. (2007). Final report of a phase-I study of the effects of professional development and long-term support on program implementation and scaling up. Honolulu: University of Hawai‘i at Mnoa, Curriculum Research & Development Group. http://www.hawaii.edu/crdg/programs/pre/scup.html.

    Google Scholar 

  • Brandon, P. R., Taum, A. K. H., Young, D. B., & Pottenger, F. M. (2008a). The development and validation of the Inquiry Science Observation Coding Sheet. Evaluation and Program Planning, 31, 247–258.

    Article  Google Scholar 

  • Brandon, P. R., Taum, A. K. H., Young, D. B., Pottenger, F. M. & Speitel T. W. (2008b). The complexity of measuring the quality of program implementation with observations: The case of middle-school inquiry-based science. American Journal of Evaluation, 29, 235–250.

    Article  Google Scholar 

  • Bredderman, T. (1983). Effects of activity-based elementary science on student outcomes: A quantitative synthesis. Review of Educational Research, 53, 499–518.

    Google Scholar 

  • Camburn, E. M. & Han, S. W. (2005, April). Validating measures of instruction based on annual surveys. Paper presented at the meeting of the American Educational Research Association, Montreal.

  • Center for Science Education. (2007). The Inquiry Science Instruction Observation Protocol (ISIOP) Development Project. Retrieved October 2, 2007 from http://cse.edc.org/projects/ProjectView.asp?PID=3719

  • Chin, C. (2007). Teacher questioning in science classrooms: Approaches that stimulate productive thinking. Journal of Research in Science Teaching, 44, 815–843.

    Article  Google Scholar 

  • Cohen, D. K., & Spillane, J. P. (1993). Policy and practice: The relationship between governance and instruction. In S. H. Fuhrman (Ed.), Designing coherent education policy: Improving the system (pp. 35–95). San Francisco: Jossey-Bass.

    Google Scholar 

  • Curriculum Research & Development Group (1996). Alignment of Foundational Approaches in Science Teaching (FAST) with the national science education standards grades 5–8. Honolulu: University of Hawai‘i at Mnoa Curriculum Research & Development Group.

    Google Scholar 

  • Curriculum Research & Development Group (2000). FAST: A summary of evaluations. Honolulu: University of Hawai‘i at Mnoa Curriculum Research & Development Group.

    Google Scholar 

  • Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18(1), 23–45.

    Article  Google Scholar 

  • Dekkers, J. (1978). The effects of junior inquiry science programs on student cognitive and activity preferences in science. Research in Science Education, 8, 71–78.

    Article  Google Scholar 

  • Desimone, L. M., & Le Floch, K. C. (2004). Are we asking the right questions? Using cognitive interviews to improve surveys in education research. Educational Evaluation and Policy Analysis, 26, 1–22.

    Article  Google Scholar 

  • Dillman, D. A. (2000). Mail and internet surveys: The tailored design method. New York: Wiley.

    Google Scholar 

  • Domitrovich, C. E., & Greenberg, M. T. (2000). The study of implementation: Current findings from effective programs that prevent mental disorders in school-aged children. Journal of Educational and Psychological Consultation, 11, 193–221.

    Article  Google Scholar 

  • Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256.

    Article  Google Scholar 

  • Gall, M. (1984). Synthesis of research on teachers’ questioning. Educational Leadership, 42(3), 40–47.

    Google Scholar 

  • Gresham, F. M. (1989). Assessment of treatment integrity in school consultation and prereferral intervention. School Psychology Review, 18(1), 37–50.

    Google Scholar 

  • Kirby, S. N., Berends, M., & Naftel, S. (2001). Implementation in a longitudinal sample of New American schools: Four years into scale-up. Santa Monica, CA: RAND.

    Google Scholar 

  • Lee, O., Hart, J. E., Cuevas, P., & Enders, C. (2004). Professional development in inquiry-based science for elementary teachers of diverse student groups. Journal of Research in Science Teaching, 41, 1021–1043.

    Article  Google Scholar 

  • Lott, G. W. (1983). The effect of inquiry teaching and advanced organizers upon student outcomes in science education. Journal of Research in Science Teaching, 29, 437–451.

    Article  Google Scholar 

  • Mayer, D. P. (1999). Measuring instructional practice: Can policymakers trust survey data? Educational Evaluation and Policy Analysis, 21, 29–45.

    Google Scholar 

  • Moncher, F. J., & Prinz, R. J. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247–266.

    Article  Google Scholar 

  • Mowbray, C. T., Holter, M. C., Teague, G. B., & Bybee, D. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Evaluation, 24, 315–340.

    Google Scholar 

  • National Research Council (1996). The national science education standards. Washington, DC: The National Academies.

    Google Scholar 

  • O’Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K-12 curriculum intervention research. Review of Educational Research, 78, 33–84.

    Article  Google Scholar 

  • Pottenger III, F. M., & Young, D. B. (1992a). Instructional guide: FAST, Foundational Approaches in Science Teaching (2nd ed.). Honolulu: University of Hawai‘i at Mnoa, Curriculum Research & Development Group.

    Google Scholar 

  • Pottenger III, F. M., & Young, D. B. (1992b). The local environment: FAST 1, Foundational Approaches in Science Teaching (2nd ed.). Honolulu: University of Hawai‘i at Mnoa, Curriculum Research & Development Group.

    Google Scholar 

  • Pottenger III, F. M., & Young, D. B. (1992c). The local environment: FAST 1, Foundational Approaches in Science Teaching, teacher’s guide (2nd ed.). Honolulu: University of Hawai‘i at Mnoa, Curriculum Research & Development Group.

    Google Scholar 

  • Redfield, D. L., & Rousseau, E. W. (1981). A meta-analysis of experimental research on teacher questioning behavior. Review of Educational Research, 51, 236–245.

    Google Scholar 

  • Resnicow, K., Davis, M., Smith, M., Lazarus-Yaroch, A., Baranowski, T., Baranowski, J., et al. (1998). How best to measure implementation of school health curricula: A comparison of three measures. Health Education Research, 13, 239–250.

    Article  Google Scholar 

  • Rogg, S., & Kahle, J. B. (1997). Middle level standards-based inventory. Oxford, OH: Miami University of Ohio.

    Google Scholar 

  • Rohrbach, L. A., Graham, J. W., & Hansen, W. B. (1993). Diffusion of a school-based substance abuse prevention program: Predictors of program implementation. Preventive Medicine, 22, 237–260.

    Article  Google Scholar 

  • Samson, G. E., Sirykowski, B., Weinstein, T., & Walberg, H. J. (1987). The effects of teacher questioning levels on student achievement: A quantitative synthesis. Journal of Educational Research, 80, 290–295.

    Google Scholar 

  • Schriesheim, C. A., & Novelli, L. (1989). A comparative test of the interval-scale properties of magnitude estimation and case iii scaling and recommendations for equal-interval frequency response anchors. Educational and Psychological Measurement, 49, 59–74.

    Article  Google Scholar 

  • Shymansky, J. A., Kyle, W. C., & Alport, J. M. (1983). The effects of new science curricula on student performance. Journal of Research in Science Teaching, 20, 387–404.

    Article  Google Scholar 

  • Sudman, S., & Bradburn, N. M. (1982). Asking questions: A practical guide to questionnaire design. San Francisco: Jossey-Bass.

    Google Scholar 

  • Sudman, S., Bradburn, N. M., & Schwarz, N. (1996). Thinking about answers: The application of cognitive processes to survey methodology. San Francisco, CA: Jossey-Bass.

    Google Scholar 

  • Supovitz, J. A., & May, H. (2004). A study of the links between implementation and effectiveness of the America’s choice comprehensive school reform design. Journal of Education for Students Placed at Risk, 9, 389–419.

    Article  Google Scholar 

  • Tamir, P. (1983). Inquiry and the science teacher. Science Teacher Education, 67, 657–672.

    Google Scholar 

  • Tamir, P., & Yamamoto, K. (1977). The effects of the junior high FAST program on student achievement and preferences in high school biology. Studies in Educational Evaluation, 3, 7–17.

    Article  Google Scholar 

  • Von Secker, C., & Lissitz, R. (1999). Estimating the impact of instructional practices on student achievement in science. Journal of Research in Science Teaching, 36, 1110–1126.

    Article  Google Scholar 

  • Wholey, J. S., Hatry, H. P., & Newcomer, K. E. (1994). Handbook of practical program evaluation. San Francisco: Jossey-Bass.

    Google Scholar 

  • Wise, K. C., & Okey, J. R. (1983). A meta-analysis of the effects of various science teaching strategies on achievement. Journal of Research in Science Teaching, 20, 419–435.

    Article  Google Scholar 

  • Wu, H. K., & Hsieh, C. E. (2006). Developing sixth grader’s inquiry skills to construct explanations in inquiry-based learning environments. International Journal of Science Education, 28, 1290–1313.

    Article  Google Scholar 

  • Young, D. B. (1982). Local science program makes good: The evaluation of FAST. Human Sciences, Technology, and Education, 1, 23–28.

    Google Scholar 

  • Young, D. B. (1993). Science achievement and thinking skills. Pacific-Asian Education, 5, 35–49.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Curriculum Research and Development Group, College of Education, University of Hawai‘i at Mnoa, 1776 University Avenue, UHS2-214, Honolulu, HI, 96822-2463, USA

    Paul R. Brandon & Alice K. Taum

  2. Curriculum Research and Development Group, College of Education, University of Hawai‘i at Mnoa, 1776 University Avenue, Castle Memorial Hall, Honolulu, HI, 96822-2463, USA

    Donald B. Young

  3. Curriculum Research and Development Group, College of Education, University of Hawai‘i at Mnoa, 1776 University Avenue, UHS2-202, Honolulu, HI, 96822-2463, USA

    Francis M. Pottenger

Authors
  1. Paul R. Brandon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Donald B. Young
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Francis M. Pottenger
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alice K. Taum
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paul R. Brandon.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Brandon, P.R., Young, D.B., Pottenger, F.M. et al. THE INQUIRY SCIENCE IMPLEMENTATION SCALE: DEVELOPMENT AND APPLICATIONS. Int J of Sci and Math Educ 7, 1135–1147 (2009). https://doi.org/10.1007/s10763-009-9156-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10763-009-9156-0

Key words

Search

Navigation