Skip to main content
SpringerLink
Log in

Comparing Optimization Practices Across Engineering Learning Contexts Using Process Data

  • Published:
Journal of Science Education and Technology Aims and scope Submit manuscript

Abstract

Despite an increasing focus on integrating engineering design in K-12 settings, relatively few studies have investigated how to support students to engage in systematic processes to optimize the designs of their solutions. Emerging learning technologies such as computational models and simulations enable rapid feedback to learners about their design performance, as well as the ability to research how students may or may not be using systematic approaches to the optimization of their designs. This study explored how middle school, high school, and pre-service students optimized the design of a home for energy efficiency, size, and cost using facets of fluency, flexibility, closeness, and quality. Results demonstrated that students with successful designs tended to explore the solution space with designs that met the criteria, with relatively lower numbers of ideas and fewer tightly controlled tests. Optimization facets did not vary across different student levels, suggesting the need for more emphasis on supporting quantitative analysis and optimization facets for learners in engineering settings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Advancing Excellence in P12 Engineering Education, & American Society for Engineering Education [ASEE]. (2020). Framework for P-12 engineering learning: A defined and cohesive educational foundation for P-12 engineering. https://p12framework.asee.org/

  • Akin, Ö. (1990). Necessary conditions for design expertise and creativity. Design Studies, 11(2), 107–113.

    Article  Google Scholar 

  • Allen, M. S. (1962). Morphological creativity: The miracle of your hidden brain power: A practical guide to the utilization of your creative potential. Prentice-Hall.

  • American Association for the Advancement of Science. (1994). Benchmarks for science literacy. Oxford University Press.

  • Austin-Breneman, J., Honda, T., & Yang, M. C. (2012). A study of student design team behaviors in complex system design. Journal of Mechanical Design, 134(12).

  • Chao, J., Xie, C., Nourian, S., Chen, G., Bailey, S., Goldstein, M. H., Purzer, S., Adams, R. S., & Tutwiler, M. S. (2017). Bridging the design-science gap with tools: Science learning and design behaviors in a simulated environment for engineering design. Journal of Research in Science Teaching, 54(8), 1049–1096.

    Article  Google Scholar 

  • Chiu, J. L., Malcolm, P. T., Hecht, D., DeJaegher, C. J., Pan, E. A., Bradley, M., & Burghardt, M. D. (2013). WISEngineering: Supporting precollege engineering design and mathematical understanding. Computers & Education, 67, 142–155.

    Article  Google Scholar 

  • Crismond, D. P., & Adams, R. S. (2012). The informed design teaching & learning matrix. Journal of Engineering Education-Washington, 101(4), 738.

    Article  Google Scholar 

  • Cross, N. (2004). Expertise in design: An overview. Design Studies, 25(5), 427–441.

    Article  Google Scholar 

  • Cross, N. (2011). Design thinking. Bloomsbury Visual Arts.

  • Cunningham, C. M., & Lachapelle, C. P. (2014). Designing engineering experiences to engage all students. Engineering in Pre-College Settings: Synthesizing Research, Policy, and Practices, 21(7), 117–142.

    Article  Google Scholar 

  • Daly, S. R., Yilmaz, S., Christian, J. L., Seifert, C. M., & Gonzalez, R. (2012). Design heuristics in engineering concept generation.

  • Dym, C. L., Agogino, A. M., Eris, O., Frey, D. D., & Leifer, L. J. (2005). Engineering design thinking, teaching, and learning. Journal of Engineering Education, 94(1), 103–120.

    Article  Google Scholar 

  • Dym, C. L., Little, P., & Orwin, E. (2014). Engineering design: A project-based introduction (4th ed.). Wiley.

  • English, L. D. (2016). STEM education K-12: Perspectives on integration. International Journal of STEM Education, 3(1), 3, s40594–016–0036–1. https://doi.org/10.1186/s40594-016-0036-1

  • Fu, K., Cagan, J., & Kotovsky, K. (2010). Design team convergence: The influence of example solution quality.

  • Goldschmidt, G. (2016). Linkographic evidence for concurrent divergent and convergent thinking in creative design. Creativity Research Journal, 28(2), 115–122.

    Article  Google Scholar 

  • Goldstein, M. H., Omar, S. A., Purzer, S., & Adams, R. S. (2018). Comparing two approaches to engineering design in the 7th grade science classroom. International Journal of Education in Mathematics, Science and Technology, 6(4), 381–397.

    Article  Google Scholar 

  • Goldstein, M. H., Purzer, Ş, Mejia, C. V., Zielinski, M., & Douglas, K. A. (2015). Assessing idea fluency through the student design process. IEEE Frontiers in Education Conference (FIE), 2015, 1–5.

    Google Scholar 

  • Hutchins, N. M., Biswas, G., Maróti, M., Lédeczi, Á., Grover, S., Wolf, R., & McElhaney, K. (2020). C2STEM: A system for synergistic learning of physics and computational thinking. Journal of Science Education and Technology, 29, 83–100.

  • Karabiyik, T., Magana, A. J., & Newell, B. A. (2022). First-year undergraduate students’ economic decision outcomes in engineering design. The Engineering Economist, 67(4), 306–324. https://doi.org/10.1080/0013791X.2022.2065395

    Article  Google Scholar 

  • Lammi, M., Denson, C., & Asunda, P. (2018). Search and review of the literature on engineering design challenges in secondary school settings. Journal of Pre-College Engineering Education Research (J-PEER), 8(2), 5.

  • Lee, K. (1999). Principles of cad/cam/cae systems.

  • Magana, A. J. (2017). Modeling and simulation in engineering education: A learning progression. Journal of Professional Issues in Engineering Education and Practice, 143(4), 04017008.

  • Magana, A. J., & de Jong, T. (2018). Modeling and simulation practices in engineering education. Computer Applications in Engineering Education, 26(4), 731–738.

    Article  Google Scholar 

  • Magana, A. J., Chiu, J., Ying Seah, Y., Bywater, J. P., Schimpf, C., Karabiyik, T., ... & Xie, C. (2021). Classroom orchestration of computer simulations for science and engineering learning: A multiple-case study approach. International Journal of Science Education, 43(7), 1140–1171.

    Article  Google Scholar 

  • McBride, E., Vitale, J. M., Gogel, H., Martinez, M. M., Pardos, Z., & Linn, M. C. (2016). Predicting student learning using log data from interactive simulations on climate change. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale (pp. 185–188).

  • McElhaney, K. W., & Linn, M. C. (2011). Investigations of a complex, realistic task: Intentional, unsystematic, and exhaustive experimenters. Journal of Research in Science Teaching, 48(7), 745–770.

    Article  Google Scholar 

  • Molina-Toro, J. F., Rendón-Mesa, P. A., & Villa-Ochoa, J. (2019). Research trends in digital technologies and modeling in mathematics education. Eurasia Journal of Mathematics, Science and Technology Education, 15(8), 1–13.

    Article  Google Scholar 

  • Montgomery, R., Greenwald, E., Crane, S., Krakowski, A., & Barber, J. (2020). Operationalizing optimization in a middle school virtual engineering internship. Journal of Science Education and Technology, 29(3), 409–420.

    Article  Google Scholar 

  • Moore, T. J., Glancy, A. W., Tank, K. M., Kersten, J. A., Smith, K. A., & Stohlmann, M. S. (2014a). A framework for quality K-12 engineering education: Research and development. Journal of Pre-College Engineering Education Research (J-PEER), 4(1). https://doi.org/10.7771/2157-9288.1069

  • Moore, T. J., Stohlmann, M. S., Wang, H. H., Tank, K. M., Glancy, A. W., & Roehrig, G. H. (2014b). Implementation and integration of engineering in K-12 STEM education. In Engineering in pre-college settings: Synthesizing research, policy, and practices (pp. 35–60). Purdue University Press.

  • Müller-Wienbergen, F., Müller, O., Seidel, S., & Becker, J. (2011). Leaving the beaten tracks in creative work–A design theory for systems that support convergent and divergent thinking. Journal of the Association for Information Systems, 12(11), 2.

    Article  Google Scholar 

  • Murphy, L. R., Daly, S. R., McKilligan, S., & Seifert, C. M. (2017). Supporting novice engineers in idea generation using design heuristics. 2017 ASEE Annual Conference & Exposition.

  • National Research Council. (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas. National Academies Press.

  • NGSS. (2013). Next Generation Science Standards: For states, by states. National Academies Press.

  • Phadnis, V. S., Wallace, D. R., & Olechowski, A. (2021). A multimodal experimental approach to study CAD collaboration. Computer-Aided Design and Applications, 18(2), 328–342.

    Article  Google Scholar 

  • Project Lead the Way. (n.d.). PTLW engineering. https://www.pltw.org/our-programs/pltw-engineering-curriculum#curriculum-2

  • Purzer, S., Adams, R., Goldstein, M. H., & Douglas, K. A. (2015a). Large-scale research on engineering design in secondary classrooms: Big learner data using energy3D computer-aided design paper presented at 2015 ASEE Annual Conference & Exposition, Seattle, Washington. https://doi.org/10.18260/p.24391

  • Purzer, Ş, Goldstein, M. H., Adams, R. S., Xie, C., & Nourian, S. (2015b). An exploratory study of informed engineering design behaviors associated with scientific explanations. International Journal of STEM Education, 2(1), 1–12.

    Article  Google Scholar 

  • Purzer, S., & Quintana-Cifuentes, J. P. (2019). Integrating engineering in K-12 science education: Spelling out the pedagogical, epistemological, and methodological arguments. Disciplinary and Interdisciplinary Science Education Research, 1(1), 13. https://doi.org/10.1186/s43031-019-0010-0

    Article  Google Scholar 

  • Purzer, Ş., Strobel, J., & Cardella, M. E. (2014). Engineering in pre-college settings: Synthesizing research, policy, and practices. Purdue University Press.

  • Rahman, M. H., Schimpf, C., Xie, C., & Sha, Z. (2019). A computer-aided design based research platform for design thinking studies. Journal of Mechanical Design, 141(12).

  • Seah, Y. Y., & Magana, A. J. (2019). Exploring students’ experimentation strategies in engineering design using an educational CAD tool. Journal of Science Education and Technology, 28, 195–208.

    Article  Google Scholar 

  • Schauble, L., Klopfer, L. E., & Raghavan, K. (1991). Students’ transition from an engineering model to a science model of experimentation. Journal of Research in Science Teaching, 28(9), 859–882.

    Article  Google Scholar 

  • Shah, J. J., Millsap, R. E., Woodward, J., & Smith, S. (2012). Applied tests of design skills—Part 1: Divergent thinking.

  • Shah, J. J., Smith, S. M., & Vargas-Hernandez, N. (2003). Metrics for measuring ideation effectiveness. Design Studies, 24(2), 111–134.

    Article  Google Scholar 

  • Shah, J. J., Vargas-Hernandez, N., Summers, J. D., & Kulkarni, S. (2001). Collaborative sketching (C-Sketch)—An idea generation technique for engineering design. The Journal of Creative Behavior, 35(3), 168–198.

    Article  Google Scholar 

  • Simon, H. (1996). The sciences of the artificial (3rd ed.). The MIT Press.

  • Sio, U. N., Kotovsky, K., & Cagan, J. (2015). Fixation or inspiration? A meta-analytic review of the role of examples on design processes. Design Studies, 39, 70–99.

    Article  Google Scholar 

  • Svihla, V., & Kachelmeier, L. (2020). The wrong theory protocol: A pre-ideation technique to enhance creativity and empathy. Proceedings of the ASEE 127th Annual Conference and Exhibition.

  • Toh, C. A., & Miller, S. R. (2015). How engineering teams select design concepts: A view through the lens of creativity. Design Studies, 38, 111–138.

    Article  Google Scholar 

  • Vieira, C., Goldstein, M. H., Purzer, Ş, & Magana, A. J. (2016). Using learning analytics to characterize student experimentation strategies in the context of engineering design. Journal of Learning Analytics, 3(3), 291–317.

    Article  Google Scholar 

  • Viswanathan, V. K., & Linsey, J. S. (2013). Design fixation and its mitigation: A study on the role of expertise. Journal of Mechanical Design, 135(5), 051008.

    Article  Google Scholar 

  • Wendell, K. B., Andrews, C. J., & Paugh, P. (2019). Supporting knowledge construction in elementary engineering design. Science Education, 103(4), 952–978.

    Article  Google Scholar 

  • Wieman, C. E., Adams, W. K., & Perkins, K. K. (2008). PhET: Simulations that enhance learning. Science, 322(5902), 682–683.

    Article  Google Scholar 

  • Yilmaz, S., Daly, S. R., Seifert, C. M., & Gonzalez, R. (2016). Evidence-based design heuristics for idea generation. Design Studies, 46, 95–124.

    Article  Google Scholar 

  • Zhang, N., Biswas, G., McElhaney, K. W., Basu, S., McBride, E., & Chiu, J. L. (2020). Studying the interactions between science, engineering, and computational thinking in a learning-by-modeling environment. In Artificial Intelligence in Education: 21st International Conference, AIED 2020, Ifrane, Morocco, July 6–10, 2020, Proceedings, Part I 21 (pp. 598–609). Springer International Publishing.

Download references

Funding

This material is based upon work supported by the National Science Foundation under Grant Nos. DRL-1503170 and 1503436.

Author information

Authors and Affiliations

  1. Curriculum, Instruction, and Special Education, School of Education and Human Development, University of Virginia, 313 Bavaro, Charlottesville, VA, 22903, USA

    Jennifer L. Chiu

  2. Learning, Technology, & Leadership Education, James Madison University, Harrisonburg, USA

    James P. Bywater

  3. Computer and Information Technology, Purdue University, West Lafayette, USA

    Tugba Karabiyik & Alejandra Magana

  4. Department of Engineering Education, University at Buffalo, Buffalo, USA

    Corey Schimpf

  5. School of Business, Oakland City University, Oakland, USA

    Ying Ying Seah

Authors
  1. Jennifer L. Chiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. James P. Bywater
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tugba Karabiyik
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alejandra Magana
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Corey Schimpf
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ying Ying Seah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jennifer L. Chiu.

Ethics declarations

Ethics Approval

All procedures involving human participants in this study were in accordance with the ethical standards of the Institutional Review Boards of the universities. This study was approved by the Human Research Protection Program/Review Board for Social and Behavioral Sciences at the two universities.

Consent Statement

Informed consent was obtained from all adult participants included in the study. The middle school and high school contexts were deemed as normal educational practice in educational settings by the Institutional Review Board. Informed notification of the study was given to parents/guardians of middle and high school students including study purposes, data gathered, processes to make the data confidential and secure, as well as contact information to withdraw from the study.

Conflict of Interest

The authors declare no competing interests.

Disclaimer

Any opinions, findings, and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the National Science Foundation.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

James P. Bywater, Tugba Karabiyik, Alejandra Magana, Corey Schimpf, and Ying Ying Seah contributed equally to this manuscript

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chiu, J.L., Bywater, J.P., Karabiyik, T. et al. Comparing Optimization Practices Across Engineering Learning Contexts Using Process Data. J Sci Educ Technol 33, 143–155 (2024). https://doi.org/10.1007/s10956-023-10080-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10956-023-10080-x

Keywords

Search

Navigation