Skip to main content

Advertisement

Log in

The Conceptualization and Development of the Practical Epistemology in Science Survey (PESS)

  • Published:
Research in Science Education Aims and scope Submit manuscript

Abstract

Various inquiry approaches have been promoted in science classrooms as a way for students to engage in, and have a deeper understanding of scientific discourse. However, there is a paucity of empirical evidence to suggest how children’s actions and engagement in these approaches, or practical epistemologies (Sandoval, Science Education 89(4): 634–656, 2005), may contribute to the development of their personal epistemologies, or their views about the nature of knowledge and knowing and the nature of learning. This paper puts forth the conceptualization and development of the Practical Epistemology in Science Survey (PESS) instrument, a 26-item Likert-scale self-assessment which measures how students view their individual and social participation in the classroom scientific community. Data were collected from 4th–6th-grade students (n = 1019) in the USA and a psychometric evaluation of the reliability, validity, and dimensionality of the instrument was conducted. The Cronbach’s alpha value indices for all subsets of items of the PESS suggest a strong reliability of the instrument (α ≥ .80). The development of the PESS may be useful in science education research to (a) detect changes to students’ beliefs about knowledge and knowledge development; (b) identify dispositions and beliefs which may or may not be in line with the aims and values of various pedagogical approaches; (c) monitor the process of change, e.g., time it takes for students to change their approaches and beliefs with respect to teacher practice; and, (d) overall, to provide an understanding of how students’ formal epistemologies are developed and informed by the affordances in science classrooms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  • Akkus, R., Gunel, M., & Hand, B. (2007). Comparing an inquiry based approach known as the science writing heuristic to traditional science teaching practices: Are there differences? International Journal of Science Education, 29, 1745–1765.

    Article  Google Scholar 

  • Bassesches, M. A. (1994). Dialectical thinking and adult development. Norwood: Ablex.

    Google Scholar 

  • Borda, E. (2007). Applying Gadamer’s concept of disposition to science and science education. Science & Education, 16(9), 1027–1041. doi:10.1007/s11191-007-9079-5.

  • Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1(2), 245–276.

    Article  Google Scholar 

  • Chinn, C. A., Buckland, L. A., & Samarapungavan, A. (2011). Expanding the dimensions of epistemic cognition: Arguments from philosophy and psychology. Educational Psychologist, 46(3), 141–167. doi:10.1080/00461520.2011.587722.

  • Colucciello, M. L. (1999). Relationship between critical thinking and learning styles. Journal of Professional Nursing, 15, 294–301.

    Article  Google Scholar 

  • Conley, A. M., Pintrich, P. R., Vekiri, I., & Harrison, D. (2004). Changes in epistemological beliefs in elementary science students. Contemporary Educational Psychology, 29, 186–204.

    Article  Google Scholar 

  • Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334.

    Article  Google Scholar 

  • Dewey, J. (1933). How we think. Boston: D.C.Heath & Co..

    Google Scholar 

  • Driver, R., Leach, J., Millar, R., & Scott, P. (1996). In Driver R. (Ed.), Young people's images of science. Open University Press.

  • Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105, 399–412. doi:10.1111/bjop.12046.

    Article  Google Scholar 

  • Duschl, R. (2008). Science education in three-part harmony: Balancing conceptual, epistemic, and social learning goals. Review of Research in Education, 32(1), 268–291. doi:10.3102/0091732X07309371.

    Article  Google Scholar 

  • Duschl, R., Maeng, S., & Sezen, A. (2011). Learning Progressions and teaching sequences: a review and analysis. Studies in Science Education, 47(2), 123–182.

    Article  Google Scholar 

  • Elder, A. D. (1999). An exploration of fifth-grade students’ epistemological beliefs in science and an investigation of their relation to science learning

  • Elder, A. (2002). Characterizing fifth grade students’ epistemological beliefs in science. Personal Epistemology: The Psychology of Beliefs about Knowledge and Knowing, 347–364.

  • Facione, P. A. (2000). The disposition toward critical thinking: Its character, measurement, and relationship to critical thinking skill. Informal Logic, 20(1), 61–84.

    Article  Google Scholar 

  • Falk, J. H., Storksdieck, M., & Dierking, L. D. (2007). Investigating public science interest and understanding: Evidence for the importance of free-choice learning. Public Understanding of Science, 16(4), 455–469.

    Article  Google Scholar 

  • Fan, X., Thompson, B., & Wang, L. (1999). Effects of sample size, estimation method and model specification on structural equation modeling fit indexes. Structural Equation Modeling, 6, 56–83.

    Article  Google Scholar 

  • Gadamer, H. G. (1947). On the primordiality of science: a rectoral address. In D. Misgeld & G. Nicholson (Eds.), Hans-Georg Gadamer on education, poetry and history: applied hermeneutics. Albany: State University of New York Press.

    Google Scholar 

  • George, D., & Mallery, M. (2003). Using SPSS for windows step by step: A simple guide and reference.

  • Gunel, M., Akkus, R., & Ozer-Keskin, M. (2011) Implementing the Argumentation Based Science Learning Approach in Middle School Setting Through Professional Development Programs and Investigating the Impact of The Approach on Teachers’ Pedagogy and Students’ Academic Achievements, Skills and Perceptions Toward Science. Paper presented at the annual meeting of the European Science Education Research Association (ESERA), Lyon, France.

  • Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10, 255–282.

    Article  Google Scholar 

  • Hammer, D., & Elby, A. (2002). On the form of a personal epistemology. In B. K. Hofer, D. Hammer, & A. Elby (Eds.), Personal epistemology: The psychology of beliefs about knowledge and knowing (pp. 169–190). Mahwah: Erlbaum.

    Google Scholar 

  • Hand, B., & Keys, C. (1999). Inquiry investigation. The Science Teacher, 66(4), 27–29.

    Google Scholar 

  • Hand, B., & Norton-Meier L. (Eds.) (2011). Voices from the classroom: Elementary teachers’ experience with argument based inquiry. Sense Publishers: Amsterdam.

  • Henson, R. K., & Roberts, J. K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement, 66, 393–416.

    Article  Google Scholar 

  • Hofer, B. K., & Pintrich, P. R. (Spring 1997). The development of epistemological theories: Beliefs about knowledge and knowing and their relation to learning. Review of Educational Research, 67(1), 88–140. doi:10.3102/00346543067001088.

  • Horn, J. L., & Engstrom, R. (1979). Cattell’s Scree Test In Relation To Bartlett’s Chi-Square Test And Other Observations On The Number Of Factors Problem. Multivariate Behavioral Research, 14, 283–300.

    Article  Google Scholar 

  • Iordanou, K. (2010). Developing argument skills across scientific and social domains. Journal of Cognition and Development, 11(3), 293–327. doi:10.1080/15248372.2010.485335.

  • King, P. M., & Kitchener, K. S. (1994). Developing reflective judgment: Understanding and promoting intellectual growth and critical thinking in adolescents and adults. jossey-bass higher and adult education series and jossey-bass social and behavioral science series. San Francisco: Jossey-Bass Publishers.

    Google Scholar 

  • Kuhn, D. (1991). The skills of argument. Cambridge University Press.

  • Kuhn, D., & Weinstock, M. (2002). What is epistemological thinking and why does it matter? In B. K. Hofer & P. R. Pintrich (Eds.), Personal epistemology: The psychology of beliefs about knowledge and knowing (pp. 121–144). Mahwah: Lawrence Erlbaum Associates Publishers.

    Google Scholar 

  • Kuhn, D., Zillmer, N., Crowell, A., & Zavala, J. (2013). Developing norms of argumentation: Metacognitive, epistemological, and social dimensions of developing argumentive competence. Cognition and Instruction, 31(4), 456–496.

    Article  Google Scholar 

  • Ledesma, R.D. & Valero-Mora, P. (2007). Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research & Evaluation, 12(2). Retrieved from: http://pareonline.net/getvn.asp?v=12&n=2.

  • Lee, M., Johanson, R. E., & Tsai, C. (2008). Exploring taiwanese high school students’ conceptions of and approaches to learning science through a structural equation modeling analysis. Science Education, 92(2), 191–220.

    Article  Google Scholar 

  • Lehrer, R., Schauble, L., & Lucas, D. (2008). Supporting development of the epistemology of inquiry. Cognitive Development, 23(4), 512–529.

    Article  Google Scholar 

  • McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah: L. Erlbaum Associates.

    Google Scholar 

  • Nam, J., Choi, A., & Hand, B. (2011). Implementation of the Science Writing Heuristic (SWH) approach in 8th grade science classrooms. International Journal of Science and Mathematics Education, 9, 1111–1133. doi:10.1007/s10763-010-9250-3.

  • National Research Council. (2007). In Committee on Enhancing Professional Development for Teachers, National Academies Teacher Advisory Council, Center for Education, Division of Behavioral and Social Sciences and Education. (Ed.), Enhancing professional development for teachers: Potential uses of information technology. Report of a workshop. Washington, D.C.: The National Academies Press. Retrieved from http://www.nap.edu/openbook.php?record_id=11995&page=R1

  • National Research Council. (2011). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. Washington, D.C.: National Academy of Sciences.

    Google Scholar 

  • Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York: McGraw-Hill.

    Google Scholar 

  • Pease, M. A., & Kuhn, D. (2011). Experimental analysis of the effective components of problem-based learning. Science Education, 95(1), 57–86.

    Article  Google Scholar 

  • Profetto-McGrath. (2003). The relationship of critical thinking skills and critical thinking dispositions of baccalaureate nursing students. Journal of Advanced Nursing, 43, 569–577. doi:10.1046/j.1365-2648.2003.02755.x.

  • Revelle, W., & Zinbarg, R. E. (2009). Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma. Psychometrika, 74(1), 145–154. doi:10.1007/S11336-008-9102-Z.

  • Sandoval, W. A. (2005). Understanding students’ practical epistemologies and their influence on learning through inquiry. Science Education, 89(4), 634–656. doi:10.1002/sce.20065.

  • Schommer, M. (1990). Effects of beliefs about the nature of knowledge on comprehension. Journal of Educational Psychology, 82, 498–504.

    Article  Google Scholar 

  • Schommer, M. (1993). Epistemological development and academic performance among secondary students. Journal of Educational Psychology, 85(3), 406–411.

    Article  Google Scholar 

  • Schraw, G., Bendixen, L. D., & Dunkle, M. E. (2002). Development and validation of the epistemic belief inventory (EBI).

  • Vygotsky, L., & Cole, M. (1978). Mind in Society. Boston: Havard Unversity Press.

    Google Scholar 

  • Wood, P., & Kardash, C. (2002). Critical elements in the design and analysis of studies of epistemology.

  • Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s α, Revelle’s β, and Mcdonald’s ωH: their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70(1), 123–133. doi:10.1007/s11336-003-0974-7.

  • Zinbarg, R. E., Yovel, I., Revelle, W., & McDonald, R. P. (2006). Estimating generalizability to a latent variable common to all of a scale’s indicators: A comparison of estimators for ω h. Applied Psychological Measurement, 30(2), 121–144. doi:10.1177/0146621605278814.

    Article  Google Scholar 

  • Zinbarg, R. E., Revelle, W., & Yovel, I. (2007). Estimating omega h for Structures Containing Two Group Factors: Perils and Prospects. Applied Psychological Measurement, 21(2), 135–157.

    Article  Google Scholar 

Download references

Acknowledgements

The research reported here was supported by the Institute of Education Sciences, US Department of Education, through grants R305A090094 and R305B10005 to The University of Iowa. The opinions expressed are those of the authors and do not necessarily represent the views of the Institute or the US Department of Education.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mary Grace Villanueva.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Villanueva, M.G., Hand, B., Shelley, M. et al. The Conceptualization and Development of the Practical Epistemology in Science Survey (PESS). Res Sci Educ 49, 635–655 (2019). https://doi.org/10.1007/s11165-017-9629-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11165-017-9629-z

Keywords

Navigation