Abstract
This study examined the inclusion of nature of science (NOS) in popular science writing to determine whether it could serve supplementary resource for teaching NOS and to evaluate the accuracy of text mining and classification as a viable research tool in science education research. Four groups of documents published from 2001 to 2010 were analyzed: Scientific American, Discover magazine, winners of the Royal Society Winton Prize for Science Books, and books from NSTA’s list of Outstanding Science Trade Books. Computer analysis categorized passages in the selected documents based on their inclusions of NOS. Human analysis assessed the frequency, context, coverage, and accuracy of the inclusions of NOS within computer identified NOS passages. NOS was rarely addressed in selected document sets but somewhat more frequently addressed in the letters section of the two magazines. This result suggests that readers seem interested in the discussion of NOS-related themes. In the popular science books analyzed, NOS presentations were found more likely to be aggregated in the beginning and the end of the book, rather than scattered throughout. The most commonly addressed NOS elements in the analyzed documents are science and society and empiricism in science. Only one inaccurate presentation of NOS were identified in all analyzed documents. The text mining technique demonstrated exciting performance, which invites more applications of the technique to analyze other aspects of science textbooks, popular science writing, or other materials involved in science teaching and learning.
Similar content being viewed by others
Notes
References
Abd-El-Khalick, F. (2002). Images of nature of science in middle grade science trade books. The New Advocate, 15(2), 121–127.
Abd-El-Khalick, F., & Lederman, N. G. (2000). Improving science teachers’ conceptions of nature of science: A critical review of the literature. International Journal of Science Education, 22(7), 665–701.
Abd-El-Khalick, F., Bell, R. L., & Lederman, N. G. (1998). The nature of science and instructional practice: Making the unnatural natural. Science Education, 82(4), 417–436.
Abd-El-Khalick, F., Waters, M., & Le, A.-P. (2008). Representations of nature of science in high school chemistry textbooks over the past four decades. Journal of Research in Science Teaching, 45, 835–855.
Akerson, V. L., & Hanuscin, D. L. (2007). Teaching nature of science through inquiry: Results of a 3-year professional development program. Journal of Research on Science Teaching, 44, 653–680.
Alshamrani, S. M. (2008). Context, accuracy, and level of inclusion of nature of science concepts in current high school physics textbooks. Fayetteville, AR: University of Arkansas.
American Association for the Advancement of Science. (1994). Benchmarks for science literacy. New York, NY: Oxford University Press.
Ball, P. (2006). Critical mass: How one thing leads to another. Farrar: Straus and Giroux.
Brooks, K. (2008). A content analysis of physical science textbooks with regard to the nature of science and ethnic diversity (Unpublished Doctor of Education Dissertation). University of Houston.
Chiappetta, E. L., & Fillman, D. A. (2007). Analysis of five high school biology textbooks used in the United States for inclusion of the nature of science. International Journal of Science Education, 29, 1847–1868.
Chiappetta, E. L., Sethna, G. H., & Fillman, D. A. (1991). A quantitative analysis of high school chemistry textbooks for scientific literacy themes and expository learning aids. Journal of Research in Science Teaching, 28(10), 939–952.
Chiappetta, E. L., Sethna, G. H., & Fillman, D. A. (1993). Do middle school life science textbooks provide a balance of scientific literacy themes? Journal of Research in Science Teaching, 30(7), 787–797.
Fan, R.-E., Chang, K.-W., Hsieh, C.-J., Wang, X.-R., & Lin, C.-J. (2011). LIBLINEAR: A library for large linear classification. http://www.csie.ntu.edu.tw/~cjlin/liblinear.
Feldman, R., & Sanger, J. (2006). The text mining handbook: Advanced approaches in analyzing unstructured data. New York, NY: Cambridge University Press.
Ford, D. J. (2006). Representations of science within children’s trade books. Journal of Research in Science Teaching, 43(2), 214–235. doi:10.1002/tea.20095.
Gamon, M., Aue, A., Corston-Oliver, S., & Ringger, E. (2005). Pulse: Mining customer opinions from free text. In A. F. Famili, J. N. Kok, J. M. Peña, A. Siebes, & A. Feelders (Eds.), Advances in intelligent data analysis (Vol. VI, pp. 121–132). Berlin: Springer.
Gibbs, A., & Lawson, A. E. (1992). The nature of scientific thinking as reflected by the work of biologists and by biology textbooks. American Biology Teacher, 54(3), 137–152.
Guisasola, J., Almudí, J. M., & Furió, C. (2005). The nature of science and its implications for physics textbooks: The case of classical magnetic field theory. Science & Education, 14(3), 321–328.
Hakim, J. (2007). The story of science: Einstein adds a new dimension. USA: Smithsonian Books.
Hanuscin, D. L., Lee, M. H., & Akerson, V. L. (2011). Elementary teachers’ pedagogical content knowledge for teaching the nature of science. Science Education, 95(1), 145–167.
Holmes, R. (2009). The age of wonder: How the romantic generation discovered the beauty and terror of science. USA: Pantheon.
Irez, S. (2009). Nature of science as depicted in Turkish biology textbooks. Science Education, 93(3), 422–447.
Lederman, N. G. (2007). Nature of science: past, present, and future. In S. K. Abell & N. G. Lederman (Eds.), Handbook of research on science education (pp. 831–879). Mahwah, NJ: Lawrence Erlbaum Associates.
Lee, Y. (2007). How do the high school biology textbooks introduce the nature of science? (Unpublished Doctor of Education Dissertation). University of Houston.
Lumpe, A. T., & Beck, J. (1996). A profile of high school biology textbooks using scientific literacy recommendations. The American Biology Teacher, 58(3), 147–153.
McComas, W. F. (2003). A textbook case of the nature of science: Laws and theories in the science of biology. International Journal of Science and Mathematics Education, 1(2), 141–155.
McComas, W. F. (2005). Seeking NOS standards: What content consensus exists in popular books on the nature of science. In Presented at the annual conference of the National Association of Research in Science Teaching, Dallas, TX.
McComas, W. F. (2007). Seeking historical examples to illustrate key aspects of the nature of science. Science & Education, 17(2–3), 249–263.
McComas, W. F., Clough, M. P., & Almazroa, H. (1998). The role and character of the nature of science in science education. In W. F. McComas (Ed.), the nature of science in science education (Vol. 5, pp. 3–39). New York, NY: Springer.
National Research Council. (1996). National science education standards. Washington, DC: The National Academies Press.
National Science Teachers Association. (2000). NSTA position statement: The nature of science. http://www.nsta.org/about/positions/natureofscience.aspx.
Niaz, M. (1998). From cathode rays to alpha particles to quantum of action: A rational reconstruction of structure of the atom and its implications for chemistry textbooks. Science Education, 82(5), 527–552.
Niaz, M. (2000). A rational reconstruction of the kinetic molecular theory of gases based on history and philosophy of science and its implications for chemistry textbooks. Instructional Science, 28(1), 23–50.
Phillips, M. C. (2006). A content analysis of sixth-grade, seventh-grade, and eighth-grade science textbooks with regard to the nature of science (Unpublished Doctor of Education Dissertation). University of Houston.
Raja, U., Mitchell, T., Day, T., & Hardin, J. M. (2008). Text mining in healthcare: Applications and opportunities. Journal of Healthcare Information Management, 22(3), 52–56.
Rodriguez, M. A., & Niaz, M. (2004). A reconstruction of structure of the atom and its implications for general physics textbooks: A history and philosophy of science perspective. Journal of Science Education and Technology, 13(3), 409–424.
Rodríguez, M. A., & Niaz, M. (2002). How in spite of the rhetoric, history of chemistry has been ignored in presenting atomic structure in textbooks. Science & Education, 11(5), 423–441.
Rosé, C. P., Roque, A., Bhembe, D., & Vanlehn, K. (2003). A hybrid text classification approach for analysis of student essays. In Proceedings of the HLT-NAACL 03 workshop on building educational applications using natural language processing, Vol. 2 (pp. 68–75). Association for Computational Linguistics.
Scharmann, L. C., Smith, M. U., James, M. C., & Jensen, M. (2005). Explicit reflective nature of science instruction: Evolution, intelligent design, and umbrellaology. Journal of Science Teacher Education, 16(1), 27–41.
Schwartz, R. S., & Lederman, N. G. (2002). “It’s the nature of the beast”: The influence of knowledge and intentions on learning and teaching nature of science. Journal of Research in Science Teaching, 39(3), 205–236.
Schwartz, R. S., Lederman, N. G., & Crawford, B. (2004). Developing views of nature of science in an authentic context: An explicit approach to bridging the gap between nature of science and scientific inquiry. Science Education, 88, 610–645.
Villalon, J., Kearney, P., Calvo, R. A., & Reimann, P. (2008). Glosser: Enhanced feedback for student writing tasks. In Proceedings of the 2008 eighth IEEE international conference on advanced learning technologies (pp. 454–458). IEEE Computer Society.
Wilkinson, J. (1999). A quantitative analysis of physics textbooks for scientific literacy themes. Research in Science Education, 29(3), 385–399.
Yang, Y., & Pedersen, J. O. (1997). A comparative study on feature selection in text categorization. In Proceedings of 14th international conference on machine learning, pp. 412–420, Nashville, US.
Zanasi, A. (2009). Virtual weapons for real wars: Text mining for national security. In E. Corchado, R. Zunino, P. Gastaldo, & Á. Herrero (Eds.), Proceedings of the international workshop on computational intelligence in security for information systems CISIS’08 (Vol. 53, pp. 53–60). Berlin: Springer.
Author information
Authors and Affiliations
Corresponding author
Appendix: List of Analyzed Popular Science Books
Appendix: List of Analyzed Popular Science Books
List of Winton Prize Winner Books from 2002 to 2011:
-
1.
Ball, P. (2005). Critical mass: How one thing leads to another. Farrar, Straus and Giroux.
-
2.
Bodanis, D. (2006). Electric universe: How electricity switched on the modern world. Broadway.
-
3.
Bryson, B. (2003). A short history of nearly everything. New York, NY: Broadway.
-
4.
Gilbert, D. (2007). Stumbling on happiness. Vintage.
-
5.
Hawking, S. W. (2001). The universe in a nutshell. Bantam.
-
6.
Holmes, R. (2009). The age of wonder: How the romantic generation discovered the beauty and terror of science. Pantheon.
-
7.
Lane, N. (2010). Life ascending: The ten great inventions of evolution. W. W. Norton & Company.
-
8.
Lynas, M. (2008). Six degrees: Our future on a hotter planet. National Geographic.
-
9.
McManus, C. (2004). Right hand, left hand: The origins of asymmetry in brains, bodies, atoms and cultures. Harvard University Press.
-
10.
Pretor-Pinney, G. (2010). The wave watcher’s companion: From ocean waves to light waves via shock waves, stadium waves, and all the rest of life’s undulations. Perigee Trade.
List of Analyzed NSTA Recommend Science Trade Books from 2002 to 2011:
-
1.
Aronson, M. (2010). If stones could speak: Unlocking the secrets of stonehenge. National Geographic Children’s Books.
-
2.
Bankston, J. (2005). Stephen Hawking: Breaking the boundaries of time and space. Enslow Publishers.
-
3.
Batten, M. (2001). Anthropologist: Scientist of the people. Houghton Mifflin Books for Children.
-
4.
Buchmann, S. (2010). Honey bees: Letters from the hive. Delacorte Books for Young Readers.
-
5.
Castner, J. L. (2002). Rainforest researchers. Benchmark Books/Marshall Cavendish.
-
6.
Collier, M. (2007). Over the mountains: An aerial view of geology. Mikaya Press.
-
7.
Collier, M. (2009). Over the coasts: An aerial view of geology. Mikaya Press.
-
8.
Cooney, C. B. (2007). Code orange. Laurel Leaf.
-
9.
Deem, J. M. (2008). Bodies from the ice: Melting glaciers and the recovery of the past. Houghton Mifflin Books for Children.
-
10.
Delano, M. F., & Sloane, D. E. E. (2002). Inventing the future: A photobiography of Thomas Alva Edison. National Geographic Children’s Books.
-
11.
Farr, R. (2008). Emperors of the ice: A true story of disaster and survival in the Antarctic, 1910-13. Farrar, Straus and Giroux (BYR).
-
12.
Favor, L. J. P. D. (2007). Food as foe: Nutrition and eating disorders. Tarrytown, New York, U.S.A.: Benchmark Books.
-
13.
Fleischman, J. (2002). Phineas gage: A gruesome but true story about brain science. Houghton Mifflin Books for Children.
-
14.
Fleisher, P. (2005). The Big Bang. Twenty-First Century Books (CT).
-
15.
Goldenberg, L. (2006). Little people and a lost world: An anthropological mystery. Twenty-First Century Books (CT).
-
16.
Goldsmith, C. (2006). Influenza: The next pandemic? Twenty-First Century Books (CT).
-
17.
Goldsmith, C. (2007). Superbugs strike back: When antibiotics fail. Twenty-First Century Books (CT).
-
18.
Hakim, J. (2007). The story of science: Einstein adds a new dimension. Smithsonian Books.
-
19.
Harris, J., & Goodall, J. (2005). The least of these: Rescue and rehabilitation of wild baby birds. Westwiinds Press.
-
20.
Hobbs, W. (2003). Wild man island. HarperCollins.
-
21.
Hobbs, W. (2004). Jackie’s wild seattle. HarperCollins.
-
22.
Holtz Jr., T. R. (2007). Dinosaurs: The most complete, up-to-date encyclopedia for dinosaur lovers of all ages. Random House Books for Young Readers.
-
23.
Hoose, P. M. (2004). The race to save the Lord God Bird. Farrar, Straus and Giroux.
-
24.
Johnson, J. (2008). Animal tracks and signs: Track over 400 animals from big cats to backyard birds. National Geographic Children’s Books.
-
25.
Kent, D. (2003). Snake pits, talking cures and magic bullets: A history of mental illness. 21st Century.
-
26.
Koppes, S. N. (2003). Killer rocks from outer space: Asteroids, comets, and meteorite. Lerner Pub Group (L).
-
27.
Kowalski, K. M. (2005). Attack of the superbugs: The crisis of drug-resistant diseases. Enslow Publishers.
-
28.
Krull, K. (2009). Marie Curie: The woman who changed the course of science. Puffin.
-
29.
LeVert, S. (2006). The facts about cocaine. New York: Marshall Cavendish Benchmark.
-
30.
Malnor, C. L., & Malnor, B. (2010). Earth heroes: Champions of wild animals. Dawn Pubns.
-
31.
McClafferty, C. K. (2001). The head bone’s connected to the neck bone: The weird, wacky, and wonderful X-Ray. Farrar, Straus and Giroux (BYR).
-
32.
Miller, R. (2007). Rockets. Twenty-First Century Books (CT).
-
33.
Pasachoff, N. (2003). Niels Bohr: Physicist and humanitarian. Enslow Publishers.
-
34.
Pasachoff, N. (2004). Linus Pauling: Advancing science, advocating peace. Enslow Publishers.
-
35.
Patent, D. H. (2001). Charles Darwin: The life of a revolutionary thinker. Holiday House.
-
36.
Rubalcaba, J., & Robertshaw, P. (2010). Every bone tells a story: Hominin discoveries, deductions, and debates. Charlesbridge Publishing.
-
37.
Sandler, M. W. (2009). Secret subway: The fascinating tale of an amazing feat of engineering. National Geographic Children’s Books.
-
38.
Simpson, K. (2008). Genetics: From DNA to designer dogs. National Geographic Children’s Books.
-
39.
Stefoff, R. (2006). Microscopes and telescopes. Benchmark Books (NY).
-
40.
Tagliaferro, L. (2000). Galapagos Islands: Nature’s delicate balance at risk. Lerner Publications.
-
41.
Thimmesh, C. (2009). Lucy long ago: Uncovering the mystery of where we came from. Houghton Mifflin Books for Children.
-
42.
Turner, P. S. (2008). Life on earth—and beyond: An astrobiologist’s quest. Charlesbridge Publishing.
-
43.
Vogel, C. G., & Vogel, C. G. (2001). Breast cancer: Questions and answers for young woman. 21st Century.
-
44.
Walker, S. M. (2002). Fossil fish found alive: Discovering the coelacanth. Carolrhoda Books.
-
45.
Walker, S. M. (2009). Written in bone: Buried lives of Jamestown and colonial Maryland. Carolrhoda Books.
-
46.
Winner, C. (2007). Circulating life: Blood transfusion from ancient superstition to modern medicine. Twenty-First Century Books (CT).
Rights and permissions
About this article
Cite this article
Jiang, F., McComas, W.F. Analysis of Nature of Science Included in Recent Popular Writing Using Text Mining Techniques. Sci & Educ 23, 1785–1809 (2014). https://doi.org/10.1007/s11191-014-9703-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11191-014-9703-0