Abstract
Geoscience instructors depend upon photos, diagrams, and other visualizations to depict geologic structures and processes that occur over a wide range of temporal and spatial scales. This proof-of-concept study tests click-on-diagram (COD) questions, administered using a classroom response system (CRS), as a research tool for identifying spatial misconceptions. First, we propose a categorization of spatial conceptions associated with geoscience concepts. Second, we implemented the COD questions in an undergraduate introductory geology course. Each question was implemented three times: pre-instruction, post-instruction, and at the end of the course to evaluate the stability of students’ conceptual understanding. We classified each instance as (1) a false belief that was easily remediated, (2) a flawed mental model that was not fully transformed, or (3) a robust misconception that persisted despite targeted instruction. Geographic Information System (GIS) software facilitated spatial analysis of students’ answers. The COD data confirmed known misconceptions about Earth’s structure, geologic time, and base level and revealed a novel robust misconception about hot spot formation. Questions with complex spatial attributes were less likely to change following instruction and more likely to be classified as a robust misconception. COD questions provided efficient access to students’ conceptual understanding. CRS-administered COD questions present an opportunity to gather spatial conceptions with large groups of students, immediately, building the knowledge base about students’ misconceptions and providing feedback to guide instruction.
Similar content being viewed by others
References
Atit, K., Shipley, T. F., & Tikoff, B. (2013). Twisting space: are rigid and non-rigid mental transformations separate spatial skills? Cognitive Processing, 14(2), 163–173.
Ault, C. R. (1998). Criteria of excellence for geological inquiry: the necessity of ambiguity. Journal of Research in Science Teaching, 35(2), 189–212.
Beatty, I. D., & Gerace, W. J. (2009). Technology-enhanced formative assessment: a research-based pedagogy for teaching science with classroom response technology. Journal of Science Education and Technology, 18(2), 146–162.
Brewer, W. F. (2008). Naïve theories of observational astronomy: review, analysis, and theoretical implications. In S. Vosniadou (Ed.), International handbook of research on conceptual change (pp. 155–204). New York: Routledge.
Carlson, L. A. (1999). Selecting a reference frame. Spatial Cognition and Computation, 1(4), 365–379.
Catley, K. M., & Novick, L. R. (2009). Digging deep: exploring college students’ knowledge of macroevolutionary time. Journal of Research in Science Teaching, 46(3), 311–332.
Catuneanu, O. (2006). Principles of sequence stratigraphy. Amsterdam: Elsevier.
Cheek, K. A. (2010). Commentary: A summary and analysis of twenty-seven years of geoscience conceptions research. Journal of Geoscience Education, 58(3), 122–134.
Cheek, K. A. (2013). Exploring the relationship between students’ understanding of conventional time and deep (geologic) time. International Journal of Science Education, 35(11), 1925–1945.
Cheek, K. A., LaDue, N. D., & Shipley, T. F. (2017). Learning about spatial and temporal scale: current research, psychological processes, and classroom implications. Journal of Geoscience Education, 65(4), 455–472.
Chi, M. T. H. (1997). Creativity: shifting across ontological categories flexibly. In T. B. Ward, S. M. Smith, & J. Vaid (Eds.), Creative thought: an investigation of conceptual structures and processes (pp. 209–234). Washington, DC: American Psychological Association. https://doi.org/10.1037/10227-009.
Chi, M. T. H. (2008). Three types of conceptual change: belief revision, mental model transformation, and categorical shift. In S. Vosniadou (Eds.), International handbook of research on conceptual change (pp. 61–82). New York: Routledge.
Clark, S. K., & Libarkin, J. C. (2011). Designing a mixed-methods research instrument and scoring rubric to investigate individuals’ conceptions of plate tectonics. Geological Society of America Special Papers, 474, 81–96.
Clark, S. K., Libarkin, J. C., Kortz, K. M., & Jordan, S. C. (2011). Alternative conceptions of plate tectonics held by nonscience undergraduates. Journal of Geoscience Education, 59(4), 251–262.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd). New York: Routledge Academic.
Dodick, J., & Orion, N. (2003). Cognitive factors affecting student understanding of geologic time. Journal of Research in Science Teaching, 40(4), 415–442.
Dolphin, G., & Benoit, W. (2016). Students’ mental model development during historically contextualized inquiry: how the ‘tectonic plate’ metaphor impeded the process. International Journal of Science Education, 38(2), 276–297.
Dove, J. E. (1998). Students’ alternative conceptions in Earth science: a review of research and implications for teaching and learning. Research Papers in Education, 13(2), 183–201.
Emenike, M. E., & Holme, T. A. (2012). Classroom response systems have not “crossed the chasm”: estimating numbers of chemistry faculty who use clickers. Journal of Chemical Education, 89(4), 465–469.
Forbus, K. D., Ferguson, R. W., Lovett, A., & Gentner, D. (2017). Extending SME to handle large-scale cognitive modeling. Cognitive Science, 41(5), 1152–1201.
Francek, M. (2013). A compilation and review of over 500 geoscience misconceptions. International Journal of Science Education, 35(1), 31–64.
Gagnier, K. M., Atit, K., Ormand, C. J., & Shipley, T. F. (2017). Comprehending 3D diagrams: sketching to support spatial reasoning. Topics in Cognitive Science, 9(4), 883–901.
Garvin-Doxas, K., & Klymkowsky, M. W. (2008). Understanding randomness and its impact on student learning: lessons learned from building the Biology Concept Inventory (BCI). CBE Life Sciences Education, 7(2), 227–233.
Gentner, D. (1989). Analogical learning. In S. Vosniadou & A. Ortony (Eds.), Similarity and analogical reasoning (p. 199). Cambridge: Cambridge University Press
Gobert, J. D. (2000). A typology of causal models for plate tectonics: inferential power and barriers to understanding. International Journal of Science Education, 22(9), 937–977.
Gurel, D. K., Eryılmaz, A., & McDermott, L. C. (2015). A review and comparison of diagnostic instruments to identify students’ misconceptions in science. Eurasia Journal of Mathematics, Science and Technology Education, 11(5), 989–1008.
Hegarty, M. (2011). The cognitive science of visual-spatial displays: implications for design. Topics in Cognitive Science, 3(3), 446–474.
Hegarty, M., & Waller, D. (2004). A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence, 32(2), 175–191.
Hegarty, M., Crookes, R. D., Dara-Abrams, D., & Shipley, T. F. (2010). Do all science disciplines rely on spatial abilities? Preliminary evidence from self-report questionnaires. In International Conference on Spatial Cognition (pp. 85–94). Berlin, Heidelberg: Springer.
Herrera, J. S., & Riggs, E. M. (2013). Identifying students’ conceptions of basic principles in sequence stratigraphy. Journal of Geoscience Education, 61(1), 89–102.
Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. Physics Teacher, 30(3), 141–158.
Jarrard, R. D., & Clague, D. A. (1977). Implications of Pacific island and seamount ages for the origin of volcanic chains. Reviews of Geophysics, 15(1), 57–76.
Jones, M. G., Tretter, T., Taylor, A., & Oppewal, T. (2008). Experienced and novice teachers’ concepts of spatial scale. International Journal of Science Education, 30(3), 409–429.
Jones, G., Taylor, A., & Broadwell, B. (2009). Estimating linear size and scale: Body rulers. International Journal of Science Education, 31(11), 1495–1509.
Karlstrom, K., Semken, S., Crossey, L., Perry, D., Gyllenhaal, E. D., Dodick, J., Williams, M., Hellmich-Bryan, J., Crow, R., Watts, N. B., & Ault, C. (2008). Informal geoscience education on a grand scale: the trail of time exhibition at Grand Canyon. Journal of Geoscience Education, 56(4), 354–361.
Kastens, K. A., & Rivet, A. (2010). Using analogical mapping to assess the affordances of scale models used in earth and environmental science education. In International Conference on Spatial Cognition (pp. 112–124). Berlin, Heidelberg: Springer.
Kastens, K. A., Pistolesi, L., & Passow, M. J. (2014). Analysis of spatial concepts, spatial skills and spatial representations in New York State regents Earth science examinations. Journal of Geoscience Education, 62(2), 278–289.
King, C. (2008). The earth science misconceptions of some science writers: how wrong can they be. Teaching Earth Sciences, 33(2), 9–11.
King, C. J. H. (2010). An analysis of misconceptions in science textbooks: Earth science in England and Wales. International Journal of Science Education, 32(5), 565–601.
Konrad, K., Koppers, A. A., Steinberger, B., Finlayson, V. A., Konter, J. G., & Jackson, M. G. (2018). On the relative motions of long-lived Pacific mantle plumes. Nature Communications, 9(1), 854.
LaDue, N. D. (2018). Scaffolding temporal reasoning with geologic timelines. Retrieved from: https://serc.carleton.edu/181886. Accessed 2 Apr 2018.
LaDue, N. D., Libarkin, J. C., & Thomas, S. R. (2015). Visual representations on high school biology, chemistry, earth science, and physics assessments. Journal of Science Education and Technology, 24(6), 818–834.
Lakoff, G., & Johnson, M. (2008). Metaphors we live by. Chicago: University of Chicago press.
Larkin, J. H., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11(1), 65–100.
Lee, H., & Feldman, A. (2015). Photographs and classroom response systems in middle school astronomy classes. Journal of Science Education and Technology, 24(4), 496–508.
Lee, H., & Schneider, S. E. (2015). Using astronomical photographs to investigate misconceptions about galaxies and spectra: question development for clicker use. Physical Review Special Topics - Physics Education Research, 11(2), 020101.
Libarkin, J. C. (2006). College student conceptions of geological phenomena and their importance in classroom instruction. Planet, 17(1), 6–9.
Libarkin, J. C., & Anderson, S. W. (2005). Assessment of learning in entry-level geoscience courses: results from the Geoscience Concept Inventory. Journal of Geoscience Education, 53(4), 394–401.
Libarkin, J. C., & Kurdziel, J. P. (2006). Ontology and the teaching of Earth system science. Journal of Geoscience Education, 54(3), 408–413.
Libarkin, J. C., Anderson, S. W., Beilfuss, M., & Boone, W. (2005). Qualitative analysis of college students’ ideas about the Earth: interviews and open-ended questionnaires. Journal of Geoscience Education, 53(1), 17–26.
Libarkin, J. C., Kurdziel, J. P., & Anderson, S. W. (2007). College student conceptions of geological time and the disconnect between ordering and scale. Journal of Geoscience Education, 55(5), 413–422.
Lombardi, D., & Sinatra, G. M. (2012). College students’ perceptions about the plausibility of human-induced climate change. Research in Science Education, 42(2), 201–217.
Lombardi, D., Brandt, C. B., Bickel, E. S., & Burg, C. (2016). Students’ evaluations about climate change. International Journal of Science Education, 38(8), 1392–1414.
Manduca, C. A., & Kastens, K. A. (2012). Geoscience and geoscientists: uniquely equipped to study Earth. Geological Society of America Special Papers, 486, 1–12.
Marshak, S. (2016). Essentials of geology (5th ed.). New York: W.W. Norton & Company, Inc..
Mills, R., Tomas, L., & Lewthwaite, B. (2016). Learning in Earth and space science: a review of conceptual change instructional approaches. International Journal of Science Education, 38(5), 767–790.
National Research Council. (2012). Discipline-based education research: understanding and improving learning in undergraduate science and engineering. S. R. Singer, N. R. Nielsen, & H. A. Schweingruber (Eds.), Washington, D.C.: National Academies Press.
New York State Education Department [NYSED]. (2018). Science Regents Exams: Physical Setting/Earth Science. Retrieved from: http://www.nysedregents.org/EarthScience/.
Newcombe, N. S., & Shipley, T. F. (2015). Thinking about spatial thinking: new typology, new assessments. In Studying visual and spatial reasoning for design creativity (pp. 179–192). Dordrecht: Springer.
Parham, T. L., Cervato, C., Gallus, W. A., Larsen, M., Hobbs, J., Stelling, P., Greenbowe, T., Gupta, T., Knox, J.A., Gill, T. E. (2018). The InVEST volcanic concept survey: Exploring student understanding about volcanoes. Journal of Geoscience Education, 58(3), 177–187.
Posner, G. J., Strike, K. A., Hewson, P. W., & Gertzog, W. A. (1982). Accommodation of a scientific conception: toward a theory of conceptual change. Science Education, 66(2), 211–227.
Resnick, I., & Shipley, T. F. (2013). Breaking new ground in the mind: an initial study of mental brittle transformation and mental rigid rotation in science experts. Cognitive Processing, 14(2), 143–152.
Resnick, I., Davatzes, A., Newcombe, N. S., & Shipley, T. F. (2017). Using relational reasoning to learn about scientific phenomena at unfamiliar scales. Educational Psychology Review, 29(1), 11–25.
Richardson, R. (2005). Teaching time in large enrollment intro classes: an active approach. Geological Society of America Abstracts with Programs, 37(7), 153.
Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representation. Learning and Instruction, 13(2), 141–156.
Shea, K. M. (2016). Beyond clickers, next generation classroom response systems for organic chemistry. Journal of Chemical Education, 93(5), 971–974.
Shipley, T. F., Tikoff, B., Ormand, C., & Manduca, C. (2013). Structural geology practice and learning, from the perspective of cognitive science. Journal of Structural Geology, 54, 72–84.
Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4(4), 295–312.
Trend, R. (2000). Conceptions of geological time among primary teacher trainees, with reference to their engagement with geoscience, history, and science. International Journal of Science Education, 22(5), 539–555.
Trend, R. D. (2001). Deep time framework: a preliminary study of UK primary teachers’ conceptions of geological time and perceptions of geoscience. Journal of Research in Science Teaching, 38(2), 191–221.
Tretter, T. R., Jones, M. G., & Minogue, J. (2006). Accuracy of scale conceptions in science: mental maneuverings across many orders of spatial magnitude. Journal of Research in Science Teaching, 43(10), 1061–1085.
United States Geological Survey [USGS]. (2017). Geology and the National Parks. Retrieved from: https://geomaps.wr.usgs.gov/parks/pltec/.
Uttal, D. H., Meadow, N. G., Tipton, E., Hand, L. L., Alden, A. R., Warren, C., & Newcombe, N. S. (2013). The malleability of spatial skills: a meta-analysis of training studies. Psychological Bulletin, 139(2), 352–402.
Vosniadou, S. (2002). On the nature of naive physics. In Reconsidering conceptual change: issues in theory and practice (pp. 61–76). Dordrecht: Springer.
Vosniadou, S., & Brewer, W. F. (1987). Theories of knowledge restructuring in development. Review of Educational Research, 57(1), 51–67.
Vosniadou, S. & Brewer, W. F. (1992) Mental models of the earth: A study of conceptual change in childhood. Cognitive Psychology, 24(4), 535–585.
Vosniadou, S., Vamvakoussi, X., & Skopeliti, I. (2008). The framework theory approach to the problem of conceptual change. In S. Voisniadou (Ed.), International handbook of research on conceptual change (pp. 3–34). New York: Routledge.
Wade, N. J. (1996). Frames of reference in vision. Minimally Invasive Therapy & Allied Technologies, 5(5), 435–439.
Wade, N. J., & Swanston, M. (2013). Visual perception: An introduction. London: Psychology Press.
Acknowledgements
The authors appreciate assistance from Kerri Gefeke and Sheldon Turner for assisting with the ArcGIS analysis protocol, Mark Howland for re-drafting the graphics used for the CRS questions, Allison Jaeger for input on the COD questions, Mia Velazquez for generating the figures, and Doug Lombardi for thoughtful suggestions on this manuscript.
Funding
This study was funded in part by the National Science Foundation (Grant 1640800). Preparation of this manuscript was supported in part by NIU’s PI Academy and National Science Foundation grant 1640800 to TFS & NDL.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Rights and permissions
About this article
Cite this article
LaDue, N.D., Shipley, T.F. Click-On-Diagram Questions: a New Tool to Study Conceptions Using Classroom Response Systems. J Sci Educ Technol 27, 492–507 (2018). https://doi.org/10.1007/s10956-018-9738-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10956-018-9738-0