Skip to main content

Advertisement

Log in

DESIGN, DEVELOPMENT AND VALIDATION OF A MODEL OF PROBLEM SOLVING FOR EGYPTIAN SCIENCE CLASSES

  • Published:
International Journal of Science and Mathematics Education Aims and scope Submit manuscript

ABSTRACT

Educators and policymakers envision the future of education in Egypt as enabling learners to acquire scientific inquiry and problem-solving skills. In this article, we describe the validation of a model for problem solving and the design of instruments for evaluating new teaching methods in Egyptian science classes. The instruments were based on an established model for problem solving and were designed to assess seventh grade students’ problem solving, experimental strategy knowledge, achievement and motivation towards science. The test for assessing students’ knowledge has been developed based on the topic, density and buoyancy which will be taught in seventh grade in a later intervention study. The instruments were partly self-developed and partly adapted from newly performed studies on strategy knowledge and problem solving in Germany. All instruments were translated into Arabic; the translation process and quality control are described. In order to determine the quality of the instruments, 44 students in Egypt completed the questionnaires and tests. The study’s aim to develop and validate the instruments did require an ad hoc and typical sample which was drawn from an accessible population. Accordingly, the characteristics of the sample are described. Data were analysed according to the classical test theory, but to underpin the results, the instruments were additionally analysed using the even stronger Rasch model. The findings demonstrated the reliability of the items and aspects of validity. In addition, this study showed how test items can be successfully developed and adapted in an international study and applied in a different language.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Aczbl, J. & Saaty, T. L. (1983). Procedures for synthesizing ratio judgments. Journal of Mathematical Psychology, 27, 93–102.

    Article  Google Scholar 

  • Anderson, L. W. & Krathwohl, D. R. (2001). A taxonomy for learning, teaching and assessing: A revision of Bloom’s taxonomy. New York: Longman.

    Google Scholar 

  • Arora, A., Ramirez, M. J. & Howie, S. J. (2006). Using indicators of educational contexts in TIMSS. In S. J. Howie & T. Plomp (Eds.), Contexts of learning mathematics and science: Lessons learned from TIMSS (pp. 31–49). London: Routledge.

    Google Scholar 

  • Berg, C. A. R., Bergendahl, C. B., Lundberg, B. K. S. & Tibell, L. A. E. (2003). Benefiting from an open-ended experiment? A comparison of attitudes to, and outcomes of, an expository versus an open-inquiry version of the same experiment. International Journal of Science Education, 25(3), 351–372.

    Article  Google Scholar 

  • Bernholt, S., Neumann, K. & Nentwig, P. (Eds.). (2012). Making it tangible: Learning outcomes in science education. Münster: Waxman.

    Google Scholar 

  • Bloom, J. W. (Ed.). (2006). Creating a classroom community of young scientists (2nd ed.). New York: Routledge.

    Google Scholar 

  • Boone, W. J., & Scantlebury, K. (2006). The role of Rasch analysis when conducting science education research utilizing multiple-choice tests. Science Education, 90(2), 253–269.

  • Brislin, R. W. (1970). Back translation for cross-culture research. Journal of Cross-Culture Psychology, 1, 185–216.

    Article  Google Scholar 

  • Brislin, R. W. (1980). Translation and content analysis of oral and written material. In H. C. Triandis & J. W. Berry (Eds.), Handbook of cross-culture psychology: Methodology (pp. 389–444). Boston, MA: Allyn & Bacon, Inc.

    Google Scholar 

  • Bühner, M. (2004). Einführung in die Test- und Fragebogenkonstruktion. [Introduction to test- and questionnaire development]. München: Pearson.

    Google Scholar 

  • Carver, R. H. & Nash, J. G. (2012). Doing data analysis with SPSS® version 18. Boston, MA: Brooks/Cole Cengage Learning.

    Google Scholar 

  • Chen, Z. & Klahr, D. (1999). All other things being equal: Acquisition and transfer of the control of variables strategy. Child Development, 70(5), 1098–1120.

    Article  Google Scholar 

  • Cortina, J. M. (1993). What is coefficient Alpha? Examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104.

    Article  Google Scholar 

  • Darling-Hammond, L. (2000), Teacher quality and student achievement: A review of state policy evidence. Education Policy Analysis Archives, 8(1), Retrieved from (5.3.2012) http://epaa.asu.edu/ojs/article/view/392

  • Dogru, M. (2008). The application of problem solving method on science teacher trainees on the solution of the environmental problems. Journal of Environmental & Science Education, 3(1), 9–18.

    Google Scholar 

  • Duschl, R. & Hamilton, R. (2011). Learning science. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 78–107). New York: Routledge.

    Google Scholar 

  • Elliott, A.C. & Woodward, W.A. (2007). Statistical analysis quick reference guidebook: With SPSS examples. London: Sage Publications, Inc.

  • Emden, M. & Sumfleth, E. (2012). Assessing experimental procedures through different formats—a comparative study. In C. Bruguière, A. Tiberghien & P. Clément (Eds.), E-Book Proceedings of the ESERA 2011 Conference, Lyon France. Science learning and Citizenship. Part 10: Co-ed. R. Millar (pp. 23–29). Lyon, France: European Science Education Research Association.

    Google Scholar 

  • Field, A. (2009). Discovering statistics using SPSS (3rd ed.). London: Sage Publications.

    Google Scholar 

  • Fischer, H. E., Klemm, K., Leutner, D., Sumfleth, E., Tiemann, R. & Wirth, J. (2005). Framework for empirical research on science teaching and learning. Journal of Science Teacher Education, 16(4), 309–349.

    Article  Google Scholar 

  • Good, T. L. & Brophy, J. E. (Eds.). (2008). Learning in classroom (10th ed.). Boston, MA: Person Education, Inc.

    Google Scholar 

  • Goodwin, C. J. (2010). Research in psychology: Methods and design (6th ed.). San Francisco, CA: John Wiley & Sons, Inc.

    Google Scholar 

  • Hashimoto, K., Pillay, H. K. & Hudson, P. B. (2008). Evaluating teacher education reform projects in developing countries: A case study of teacher educational reform in Egypt. The International Journal of Learning, 15(1), 123–131.

    Google Scholar 

  • Hassan, F. (1997). Science education in Egypt and other Arab countries in Africa and west Asia. The Interdisciplinary of Study Abroad, 3, Retrieved from (22.10.2011) http://www.frontiersjournal.com/issues/vol3/vol3-11_Hassan.htm

  • Helmke, A. (2003). Unterrichtsqualität erfassen, bewerten, verbessern [Measuring, rating and improving the quality of instruction]. Seelze: Kallmeyer.

    Google Scholar 

  • Hofstein, A. & Kind, P. M. (2012). Learning in and from laboratories. In B. J. Fraser, K. G. Tobin & C. McRobbie (Eds.), Second international handbook of science education (Vol. 24, pp. 189–207). New York: Springer.

    Chapter  Google Scholar 

  • Jeong, H. & Songer, N. (2008). Understanding scientific evidence and the data collection process: Explorations of why, who, when, what, and how. In C. L. Petroselli (Ed.), Science education issues and developments (pp. 169–200). New York: Nova Science Publishers.

    Google Scholar 

  • Kaplan, R. M. & Saccuzzo, D. P. (2009). Psychological testing: Principles, applications, and issues (7th ed.). Belmont, CA: Wadsworth, Cengage Learning.

    Google Scholar 

  • Kim, M. C. & Hannafin, M. J. (2011). Scaffolding 6th graders’ problem solving in technology-enhanced science classrooms: A qualitative case study. Instructional Science, 39, 255–282.

    Article  Google Scholar 

  • Klahr, D. & Dunbar, K. (1988). Dual space search during scientific reasoning. Cognitive Science, 12(1), 1–48.

    Article  Google Scholar 

  • Klos, S., Henke, C., Kieren, C., Walpuski, M. & Sumfleth, E. (2008). Naturwissenschaftliches Experimentieren und chemisches Fachwissen-zwei verschiedene Kompetenzen [Natural science experimentation and content knowledge—two different components]. Zeitschrift für Pädagogik, 54(3), 304–321.

    Google Scholar 

  • Kneeland, S. (1999). Effective problem-solving: How to understand the process and practise it successfully. Oxford: How to Books, Ltd.

    Google Scholar 

  • Kuhn, D. (2005). Education for thinking. Cambridge, MA: Harvard University Press.

  • Lederman, N. G. & Lederman, J. S. (2012). Nature of scientific knowledge and scientific inquiry: Building instructional and capacity through professional development. In B. J. Fraser, K. G. Tobin & C. McRobbie (Eds.), Second international handbook of science education (Vol. 24, pp. 335–359). New York: Springer.

    Chapter  Google Scholar 

  • Linacre, J. M. (1994). Sample size and item calibrations stability. Rasch Measurement Transactions, 7(4), 328.

    Google Scholar 

  • Linacre, J. M. (2010). A User's guide to winstepsministep: Rasch-model computer programs. Chicago: Winsteps.com.

    Google Scholar 

  • Marschner, J. (2011). Adaptives Feedback zur Unterstützung des selbstregulierten Lernens durch Experimentieren. [Adaptive feedback to support self-regulated learning through experimentation]. Doctoral dissertation, Universität Duisburg-Essen.

  • Martin, M.O., Mullis, I.V.S., Gonzalez, E.J. & Chrostowski, S.J. (2004). TIMSS 2003 international science report. Findings from IEA’s trends in international mathematics and science study at the fourth and eighth Grades. TIMSS & PIRLS International Study Center, Lynch School of Education. Boston College: Boston, MA.

  • Meyer, J. P. (2010). Reliability. Oxford: Oxford University Press, Inc.

    Google Scholar 

  • Ministry of Education-Egypt (MOE) (2008). The development of education in Egypt (2004–2008). A national Report, Cairo, Retrieved from (22.10.2011) http://www.ibe.unesco.org/National_Reports/ICE_2008/egypt_NR08.pdf

  • Ministry of Education-Egypt (MOE) (2010). The future vision of pre-university education, (in Arabic). Retrieved from (26.08.2012) http://knowledge.moe.gov.eg/Arabic/about/politic/vision/

  • Mullis, I. V. S., Martin, M. O., Robitaille, D. F. & Foy, P. (2009). TIMSS 2007 international science report. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College.

    Google Scholar 

  • Newburghl, R. (2008). Why do we lose physics students? In C. L. Petroselli (Ed.), Science education issues and developments (2nd ed., pp. 1–4). New York: Nova Science Publishers, Inc.

    Google Scholar 

  • Ohle, A. (2010). Primary School teachers’ content Knowledge in physics and its impact on teaching and students’ achievement, Doctoral dissertation, Universität Duisburg-Essen

  • Organization for Economic Co-operation and Development (OECD) & IBRD/the World Bank (2010). Reviews of national policies for education: Higher education in Egypt (2nd ed.). Paris, France: OECD Publishing.

    Google Scholar 

  • Oser, F. K. & Baeriswyl, F. J. (2001). Choreographies of teaching: Bridging instruction to learning. In V. Richardson (Ed.), AERA’s handbook of research on teaching (4th ed., pp. 1031–1065). Washington, DC: American Educational Research Association.

    Google Scholar 

  • Peers, I. S. (2006). Statistical analysis for education and psychology researchers. London: The Falmer Press.

    Google Scholar 

  • Posamentier, A. S. & Krulik, S. (2009). Problem solving in mathematics, Grades 3–6: Powerful strategies to deepen understanding. Thousand Oaks, CA: Corwin.

    Google Scholar 

  • Quintana, C., Reiser, B. J., Davis, E. A., Krajcik, J., Fretz, E., Duncan, R. G., et al (2004). A scaffolding design framework for software to support science inquiry. Journal of the Learning Sciences, 13, 337–386.

    Article  Google Scholar 

  • Robertson, S. I. (2001). Problem solving. Philadelphia, PA: Psychology Press/Taylor & Francis, Inc.

    Book  Google Scholar 

  • Roderick, M. & Engel, M. (2001). The grasshopper and the ant: Motivational responses of low-achieving students to high-stakes testing. Educational Evaluation and Policy Analysis, 23, 197–227.

    Article  Google Scholar 

  • Ronald, H. H. (2009). Teacher effectiveness and student achievement: Investigating a multilevel cross-classified model. Journal of Educational Administration, 47(2), 227–249.

    Article  Google Scholar 

  • Schauble, L., Glaser, R., Ranghavan, K. & Reiner, M. (1991). Causal models and experimentation strategies in scientific reasoning. The Journal of the Learning Science, 1(2), 201–238.

    Article  Google Scholar 

  • Schauble, L., Glaser, R., Ranghavan, K. & Reiner, M. (1992). The integration of knowledge and experimentation strategies in understanding a physical system. Applied Cognitive Psychology, 6, 321–343.

    Article  Google Scholar 

  • Schreiber, N., Theyßen, H. & Schecker, H. (2009). Experimentelle Kompetenz messen?! [Measuring experimental competence?!]. Physik und Didaktik in Schule und Hochschule, 8(3), 92–101.

    Google Scholar 

  • Shadish, W. R., Memphis, T., Cook, T. D. & Evanston, I. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin Company.

    Google Scholar 

  • Sutman, F. X., Schmuckler, J. S. & Woodfield, J. D. (2008). The science quest using inquiry/discovery to enhance student learning, grades 7–12. San Francisco, CA: Wiley.

    Google Scholar 

  • Tang, X., Coffey, J. E., Elby, A. & Levin, D. M. (2009). The scientific method and scientific inquiry: Tensions in teaching and learning. Science Education, 94, 29–47.

    Google Scholar 

  • Thillmann, H., Künsting, J., Wirth, J. & Leutner, D. (2009). Is it merely a question of ‘what’ to prompt or also ‘when’ to prompt? The role of presentation time of prompts in self-regulated learning. Zeitschrift für Pädagogische Psychologie, 23, 105–115.

    Article  Google Scholar 

  • Toth, E. E., Klahr, D. & Chen, Z. (2000). Bridging research and practice: A cognitively based classroom intervention for teaching experimentation skills to elementary school children. Cognition and Instruction, 18, 423–459.

    Article  Google Scholar 

  • UNESCO (2008). Egypt’s educational context and the government’s education priorities and strategies. UNESCO Cairo Office-Egypt.

  • Urdan, T. C. (2001). Statistics in plain English. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

    Google Scholar 

  • VanGundy, A. B. (2005). 101 Activities for teaching creativity and problem solving. San Francisco, CA: John Wiley & Sons, Inc.

    Google Scholar 

  • Weinstein, C. E. & Mayer, R. E. (1986). The teaching of learning strategies. In M. C. Wittrock (Ed.), Handbook of research on teaching (3rd ed., pp. 315–327). New York: Macmillan.

    Google Scholar 

  • Wendler, C. L. W. & Walker, M. E. (2006). Practical issues in designing and maintaining multiple test forms for large-scale programs. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 445–467). Mahwah, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Wirth, J. & Leutner, D. (2006). Selbstregulation beim Lernen in interaktiven Lernumgebungen. [Self-regulated learning in interactive learning environments]. In H. Mandl & H. F. Friedrich (Eds.), Handbuch Lernstrategien (pp. 172–184). Göttingen: Hogrefe.

    Google Scholar 

  • Wirtz, M. & Caspar, F. (2002). Beurteilerübereinstimmung und Beurteilerreliabilität [Interrater agreement and interrater reliability]. Göttingen: Hogrefe.

    Google Scholar 

  • Wragg, E. C. (2005). The art and science of teaching and learning: The selected works of Ted Wragg. New York: Routledge.

    Google Scholar 

  • Zimmerman, C. (2000). The development of scientific reasoning skills. Developmental Review, 20, 99–149.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohamed A. Shahat.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Shahat, M.A., Ohle, A., Treagust, D.F. et al. DESIGN, DEVELOPMENT AND VALIDATION OF A MODEL OF PROBLEM SOLVING FOR EGYPTIAN SCIENCE CLASSES. Int J of Sci and Math Educ 11, 1157–1181 (2013). https://doi.org/10.1007/s10763-012-9367-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10763-012-9367-7

KEY WORDS

Navigation