Skip to main content

Click-On-Diagram Questions: a New Tool to Study Conceptions Using Classroom Response Systems

Journal of Science Education and Technology volume 27, pages 492–507 (2018)Cite this article

Abstract

Geoscience instructors depend upon photos, diagrams, and other visualizations to depict geologic structures and processes that occur over a wide range of temporal and spatial scales. This proof-of-concept study tests click-on-diagram (COD) questions, administered using a classroom response system (CRS), as a research tool for identifying spatial misconceptions. First, we propose a categorization of spatial conceptions associated with geoscience concepts. Second, we implemented the COD questions in an undergraduate introductory geology course. Each question was implemented three times: pre-instruction, post-instruction, and at the end of the course to evaluate the stability of students’ conceptual understanding. We classified each instance as (1) a false belief that was easily remediated, (2) a flawed mental model that was not fully transformed, or (3) a robust misconception that persisted despite targeted instruction. Geographic Information System (GIS) software facilitated spatial analysis of students’ answers. The COD data confirmed known misconceptions about Earth’s structure, geologic time, and base level and revealed a novel robust misconception about hot spot formation. Questions with complex spatial attributes were less likely to change following instruction and more likely to be classified as a robust misconception. COD questions provided efficient access to students’ conceptual understanding. CRS-administered COD questions present an opportunity to gather spatial conceptions with large groups of students, immediately, building the knowledge base about students’ misconceptions and providing feedback to guide instruction.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

References

  • Atit, K., Shipley, T. F., & Tikoff, B. (2013). Twisting space: are rigid and non-rigid mental transformations separate spatial skills? Cognitive Processing, 14(2), 163–173.

    Article  Google Scholar 

  • Ault, C. R. (1998). Criteria of excellence for geological inquiry: the necessity of ambiguity. Journal of Research in Science Teaching, 35(2), 189–212.

    Article  Google Scholar 

  • Beatty, I. D., & Gerace, W. J. (2009). Technology-enhanced formative assessment: a research-based pedagogy for teaching science with classroom response technology. Journal of Science Education and Technology, 18(2), 146–162.

    Article  Google Scholar 

  • Brewer, W. F. (2008). Naïve theories of observational astronomy: review, analysis, and theoretical implications. In S. Vosniadou (Ed.), International handbook of research on conceptual change (pp. 155–204). New York: Routledge.

  • Carlson, L. A. (1999). Selecting a reference frame. Spatial Cognition and Computation, 1(4), 365–379.

    Article  Google Scholar 

  • Catley, K. M., & Novick, L. R. (2009). Digging deep: exploring college students’ knowledge of macroevolutionary time. Journal of Research in Science Teaching, 46(3), 311–332.

    Article  Google Scholar 

  • Catuneanu, O. (2006). Principles of sequence stratigraphy. Amsterdam: Elsevier.

    Google Scholar 

  • Cheek, K. A. (2010). Commentary: A summary and analysis of twenty-seven years of geoscience conceptions research. Journal of Geoscience Education, 58(3), 122–134.

    Article  Google Scholar 

  • Cheek, K. A. (2013). Exploring the relationship between students’ understanding of conventional time and deep (geologic) time. International Journal of Science Education, 35(11), 1925–1945.

    Article  Google Scholar 

  • Cheek, K. A., LaDue, N. D., & Shipley, T. F. (2017). Learning about spatial and temporal scale: current research, psychological processes, and classroom implications. Journal of Geoscience Education, 65(4), 455–472.

    Article  Google Scholar 

  • Chi, M. T. H. (1997). Creativity: shifting across ontological categories flexibly. In T. B. Ward, S. M. Smith, & J. Vaid (Eds.), Creative thought: an investigation of conceptual structures and processes (pp. 209–234). Washington, DC: American Psychological Association. https://doi.org/10.1037/10227-009.

    Chapter  Google Scholar 

  • Chi, M. T. H. (2008). Three types of conceptual change: belief revision, mental model transformation, and categorical shift. In S. Vosniadou (Eds.), International handbook of research on conceptual change (pp. 61–82). New York: Routledge.

  • Clark, S. K., & Libarkin, J. C. (2011). Designing a mixed-methods research instrument and scoring rubric to investigate individuals’ conceptions of plate tectonics. Geological Society of America Special Papers, 474, 81–96.

    Article  Google Scholar 

  • Clark, S. K., Libarkin, J. C., Kortz, K. M., & Jordan, S. C. (2011). Alternative conceptions of plate tectonics held by nonscience undergraduates. Journal of Geoscience Education, 59(4), 251–262.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd). New York: Routledge Academic.

    Google Scholar 

  • Dodick, J., & Orion, N. (2003). Cognitive factors affecting student understanding of geologic time. Journal of Research in Science Teaching, 40(4), 415–442.

    Article  Google Scholar 

  • Dolphin, G., & Benoit, W. (2016). Students’ mental model development during historically contextualized inquiry: how the ‘tectonic plate’ metaphor impeded the process. International Journal of Science Education, 38(2), 276–297.

    Article  Google Scholar 

  • Dove, J. E. (1998). Students’ alternative conceptions in Earth science: a review of research and implications for teaching and learning. Research Papers in Education, 13(2), 183–201.

    Article  Google Scholar 

  • Emenike, M. E., & Holme, T. A. (2012). Classroom response systems have not “crossed the chasm”: estimating numbers of chemistry faculty who use clickers. Journal of Chemical Education, 89(4), 465–469.

    Article  Google Scholar 

  • Forbus, K. D., Ferguson, R. W., Lovett, A., & Gentner, D. (2017). Extending SME to handle large-scale cognitive modeling. Cognitive Science, 41(5), 1152–1201.

    Article  Google Scholar 

  • Francek, M. (2013). A compilation and review of over 500 geoscience misconceptions. International Journal of Science Education, 35(1), 31–64.

    Article  Google Scholar 

  • Gagnier, K. M., Atit, K., Ormand, C. J., & Shipley, T. F. (2017). Comprehending 3D diagrams: sketching to support spatial reasoning. Topics in Cognitive Science, 9(4), 883–901.

    Article  Google Scholar 

  • Garvin-Doxas, K., & Klymkowsky, M. W. (2008). Understanding randomness and its impact on student learning: lessons learned from building the Biology Concept Inventory (BCI). CBE Life Sciences Education, 7(2), 227–233.

    Article  Google Scholar 

  • Gentner, D. (1989). Analogical learning. In S. Vosniadou & A. Ortony (Eds.), Similarity and analogical reasoning (p. 199). Cambridge: Cambridge University Press

  • Gobert, J. D. (2000). A typology of causal models for plate tectonics: inferential power and barriers to understanding. International Journal of Science Education, 22(9), 937–977.

    Article  Google Scholar 

  • Gurel, D. K., Eryılmaz, A., & McDermott, L. C. (2015). A review and comparison of diagnostic instruments to identify students’ misconceptions in science. Eurasia Journal of Mathematics, Science and Technology Education, 11(5), 989–1008.

  • Hegarty, M. (2011). The cognitive science of visual-spatial displays: implications for design. Topics in Cognitive Science, 3(3), 446–474.

    Article  Google Scholar 

  • Hegarty, M., & Waller, D. (2004). A dissociation between mental rotation and perspective-taking spatial abilities. Intelligence, 32(2), 175–191.

    Article  Google Scholar 

  • Hegarty, M., Crookes, R. D., Dara-Abrams, D., & Shipley, T. F. (2010). Do all science disciplines rely on spatial abilities? Preliminary evidence from self-report questionnaires. In International Conference on Spatial Cognition (pp. 85–94). Berlin, Heidelberg: Springer.

    Chapter  Google Scholar 

  • Herrera, J. S., & Riggs, E. M. (2013). Identifying students’ conceptions of basic principles in sequence stratigraphy. Journal of Geoscience Education, 61(1), 89–102.

    Article  Google Scholar 

  • Hestenes, D., Wells, M., & Swackhamer, G. (1992). Force concept inventory. Physics Teacher, 30(3), 141–158.

    Article  Google Scholar 

  • Jarrard, R. D., & Clague, D. A. (1977). Implications of Pacific island and seamount ages for the origin of volcanic chains. Reviews of Geophysics, 15(1), 57–76.

    Article  Google Scholar 

  • Jones, M. G., Tretter, T., Taylor, A., & Oppewal, T. (2008). Experienced and novice teachers’ concepts of spatial scale. International Journal of Science Education, 30(3), 409–429.

    Article  Google Scholar 

  • Jones, G., Taylor, A., & Broadwell, B. (2009). Estimating linear size and scale: Body rulers. International Journal of Science Education, 31(11), 1495–1509.

    Article  Google Scholar 

  • Karlstrom, K., Semken, S., Crossey, L., Perry, D., Gyllenhaal, E. D., Dodick, J., Williams, M., Hellmich-Bryan, J., Crow, R., Watts, N. B., & Ault, C. (2008). Informal geoscience education on a grand scale: the trail of time exhibition at Grand Canyon. Journal of Geoscience Education, 56(4), 354–361.

    Article  Google Scholar 

  • Kastens, K. A., & Rivet, A. (2010). Using analogical mapping to assess the affordances of scale models used in earth and environmental science education. In International Conference on Spatial Cognition (pp. 112–124). Berlin, Heidelberg: Springer.

    Chapter  Google Scholar 

  • Kastens, K. A., Pistolesi, L., & Passow, M. J. (2014). Analysis of spatial concepts, spatial skills and spatial representations in New York State regents Earth science examinations. Journal of Geoscience Education, 62(2), 278–289.

    Article  Google Scholar 

  • King, C. (2008). The earth science misconceptions of some science writers: how wrong can they be. Teaching Earth Sciences, 33(2), 9–11.

    Google Scholar 

  • King, C. J. H. (2010). An analysis of misconceptions in science textbooks: Earth science in England and Wales. International Journal of Science Education, 32(5), 565–601.

    Article  Google Scholar 

  • Konrad, K., Koppers, A. A., Steinberger, B., Finlayson, V. A., Konter, J. G., & Jackson, M. G. (2018). On the relative motions of long-lived Pacific mantle plumes. Nature Communications, 9(1), 854.

    Article  Google Scholar 

  • LaDue, N. D. (2018). Scaffolding temporal reasoning with geologic timelines. Retrieved from: https://serc.carleton.edu/181886. Accessed 2 Apr 2018.

  • LaDue, N. D., Libarkin, J. C., & Thomas, S. R. (2015). Visual representations on high school biology, chemistry, earth science, and physics assessments. Journal of Science Education and Technology, 24(6), 818–834.

    Article  Google Scholar 

  • Lakoff, G., & Johnson, M. (2008). Metaphors we live by. Chicago: University of Chicago press.

    Google Scholar 

  • Larkin, J. H., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten thousand words. Cognitive Science, 11(1), 65–100.

    Article  Google Scholar 

  • Lee, H., & Feldman, A. (2015). Photographs and classroom response systems in middle school astronomy classes. Journal of Science Education and Technology, 24(4), 496–508.

    Article  Google Scholar 

  • Lee, H., & Schneider, S. E. (2015). Using astronomical photographs to investigate misconceptions about galaxies and spectra: question development for clicker use. Physical Review Special Topics - Physics Education Research, 11(2), 020101.

    Article  Google Scholar 

  • Libarkin, J. C. (2006). College student conceptions of geological phenomena and their importance in classroom instruction. Planet, 17(1), 6–9.

    Article  Google Scholar 

  • Libarkin, J. C., & Anderson, S. W. (2005). Assessment of learning in entry-level geoscience courses: results from the Geoscience Concept Inventory. Journal of Geoscience Education, 53(4), 394–401.

    Article  Google Scholar 

  • Libarkin, J. C., & Kurdziel, J. P. (2006). Ontology and the teaching of Earth system science. Journal of Geoscience Education, 54(3), 408–413.

    Article  Google Scholar 

  • Libarkin, J. C., Anderson, S. W., Beilfuss, M., & Boone, W. (2005). Qualitative analysis of college students’ ideas about the Earth: interviews and open-ended questionnaires. Journal of Geoscience Education, 53(1), 17–26.

    Article  Google Scholar 

  • Libarkin, J. C., Kurdziel, J. P., & Anderson, S. W. (2007). College student conceptions of geological time and the disconnect between ordering and scale. Journal of Geoscience Education, 55(5), 413–422.

    Article  Google Scholar 

  • Lombardi, D., & Sinatra, G. M. (2012). College students’ perceptions about the plausibility of human-induced climate change. Research in Science Education, 42(2), 201–217.

    Article  Google Scholar 

  • Lombardi, D., Brandt, C. B., Bickel, E. S., & Burg, C. (2016). Students’ evaluations about climate change. International Journal of Science Education, 38(8), 1392–1414.

    Article  Google Scholar 

  • Manduca, C. A., & Kastens, K. A. (2012). Geoscience and geoscientists: uniquely equipped to study Earth. Geological Society of America Special Papers, 486, 1–12.

    Article  Google Scholar 

  • Marshak, S. (2016). Essentials of geology (5th ed.). New York: W.W. Norton & Company, Inc..

    Google Scholar 

  • Mills, R., Tomas, L., & Lewthwaite, B. (2016). Learning in Earth and space science: a review of conceptual change instructional approaches. International Journal of Science Education, 38(5), 767–790.

    Article  Google Scholar 

  • National Research Council. (2012). Discipline-based education research: understanding and improving learning in undergraduate science and engineering. S. R. Singer, N. R. Nielsen, & H. A. Schweingruber (Eds.), Washington, D.C.: National Academies Press.

  • New York State Education Department [NYSED]. (2018). Science Regents Exams: Physical Setting/Earth Science. Retrieved from: http://www.nysedregents.org/EarthScience/.

  • Newcombe, N. S., & Shipley, T. F. (2015). Thinking about spatial thinking: new typology, new assessments. In Studying visual and spatial reasoning for design creativity (pp. 179–192). Dordrecht: Springer.

    Google Scholar 

  • Parham, T. L., Cervato, C., Gallus, W. A., Larsen, M., Hobbs, J., Stelling, P., Greenbowe, T., Gupta, T., Knox, J.A., Gill, T. E. (2018). The InVEST volcanic concept survey: Exploring student understanding about volcanoes. Journal of Geoscience Education, 58(3), 177–187.

    Article  Google Scholar 

  • Posner, G. J., Strike, K. A., Hewson, P. W., & Gertzog, W. A. (1982). Accommodation of a scientific conception: toward a theory of conceptual change. Science Education, 66(2), 211–227.

    Article  Google Scholar 

  • Resnick, I., & Shipley, T. F. (2013). Breaking new ground in the mind: an initial study of mental brittle transformation and mental rigid rotation in science experts. Cognitive Processing, 14(2), 143–152.

    Article  Google Scholar 

  • Resnick, I., Davatzes, A., Newcombe, N. S., & Shipley, T. F. (2017). Using relational reasoning to learn about scientific phenomena at unfamiliar scales. Educational Psychology Review, 29(1), 11–25.

    Article  Google Scholar 

  • Richardson, R. (2005). Teaching time in large enrollment intro classes: an active approach. Geological Society of America Abstracts with Programs, 37(7), 153.

    Google Scholar 

  • Schnotz, W., & Bannert, M. (2003). Construction and interference in learning from multiple representation. Learning and Instruction, 13(2), 141–156.

    Article  Google Scholar 

  • Shea, K. M. (2016). Beyond clickers, next generation classroom response systems for organic chemistry. Journal of Chemical Education, 93(5), 971–974.

    Article  Google Scholar 

  • Shipley, T. F., Tikoff, B., Ormand, C., & Manduca, C. (2013). Structural geology practice and learning, from the perspective of cognitive science. Journal of Structural Geology, 54, 72–84.

    Article  Google Scholar 

  • Sweller, J. (1994). Cognitive load theory, learning difficulty, and instructional design. Learning and Instruction, 4(4), 295–312.

    Article  Google Scholar 

  • Trend, R. (2000). Conceptions of geological time among primary teacher trainees, with reference to their engagement with geoscience, history, and science. International Journal of Science Education, 22(5), 539–555.

    Article  Google Scholar 

  • Trend, R. D. (2001). Deep time framework: a preliminary study of UK primary teachers’ conceptions of geological time and perceptions of geoscience. Journal of Research in Science Teaching, 38(2), 191–221.

    Article  Google Scholar 

  • Tretter, T. R., Jones, M. G., & Minogue, J. (2006). Accuracy of scale conceptions in science: mental maneuverings across many orders of spatial magnitude. Journal of Research in Science Teaching, 43(10), 1061–1085.

    Article  Google Scholar 

  • United States Geological Survey [USGS]. (2017). Geology and the National Parks. Retrieved from: https://geomaps.wr.usgs.gov/parks/pltec/.

  • Uttal, D. H., Meadow, N. G., Tipton, E., Hand, L. L., Alden, A. R., Warren, C., & Newcombe, N. S. (2013). The malleability of spatial skills: a meta-analysis of training studies. Psychological Bulletin, 139(2), 352–402.

    Article  Google Scholar 

  • Vosniadou, S. (2002). On the nature of naive physics. In Reconsidering conceptual change: issues in theory and practice (pp. 61–76). Dordrecht: Springer.

    Chapter  Google Scholar 

  • Vosniadou, S., & Brewer, W. F. (1987). Theories of knowledge restructuring in development. Review of Educational Research, 57(1), 51–67.

    Article  Google Scholar 

  • Vosniadou, S. & Brewer, W. F. (1992) Mental models of the earth: A study of conceptual change in childhood. Cognitive Psychology, 24(4), 535–585.

    Article  Google Scholar 

  • Vosniadou, S., Vamvakoussi, X., & Skopeliti, I. (2008). The framework theory approach to the problem of conceptual change. In S. Voisniadou (Ed.), International handbook of research on conceptual change (pp. 3–34). New York: Routledge.

  • Wade, N. J. (1996). Frames of reference in vision. Minimally Invasive Therapy & Allied Technologies, 5(5), 435–439.

    Article  Google Scholar 

  • Wade, N. J., & Swanston, M. (2013). Visual perception: An introduction. London: Psychology Press.

    Book  Google Scholar 

Download references

Acknowledgements

The authors appreciate assistance from Kerri Gefeke and Sheldon Turner for assisting with the ArcGIS analysis protocol, Mark Howland for re-drafting the graphics used for the CRS questions, Allison Jaeger for input on the COD questions, Mia Velazquez for generating the figures, and Doug Lombardi for thoughtful suggestions on this manuscript.

Funding

This study was funded in part by the National Science Foundation (Grant 1640800). Preparation of this manuscript was supported in part by NIU’s PI Academy and National Science Foundation grant 1640800 to TFS & NDL.

Author information

Authors and Affiliations

  1. Geology and Environmental Geosciences Department, Northern Illinois University, 312 Davis Hall, DeKalb, IL, 60115, USA

    Nicole D. LaDue

  2. Department of Psychology, Temple University, 325 Weiss Hall, Philadelphia, PA, 19122, USA

    Thomas F. Shipley

Authors
  1. Nicole D. LaDue
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas F. Shipley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nicole D. LaDue.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

LaDue, N.D., Shipley, T.F. Click-On-Diagram Questions: a New Tool to Study Conceptions Using Classroom Response Systems. J Sci Educ Technol 27, 492–507 (2018). https://doi.org/10.1007/s10956-018-9738-0

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10956-018-9738-0

Keywords

  • Clickers
  • Diagrams
  • Conceptions
  • Mental models
  • Spatial thinking
  • Geology