Skip to main content
SpringerLink
Log in

Role of conjecture mapping in applying a game-based strategy towards a case library: a view from educational design research

  • Published:
Journal of Computing in Higher Education Aims and scope Submit manuscript

Abstract

Despite the prevalence of case-based reasoning in systems design, many of the established design principles are based on theory rather than empirical studies. This study describes the evolution of a case library learning environment and its transition to a game-based learning approach using educational design research (EDR). We discuss our iterative processes of design and development and situate these processes within the broader framework of educational design research. We discuss how the earlier versions of the problem-based learning environment were based on design principles extracted from case-based reasoning theory. Subsequent studies caused us to rethink the intersection of theory and design, along with its impact on learning outcomes. Using a variety of data collections (e.g. analytics, causal maps) and EDR strategies (e.g. conjecture maps), we identify the following new design principles based on CBR theory: emergent design principles that focused on optimal case length, mechanisms to prompt case retrieval and decision-making, and visual presentation. Implications for problem-based reasoning, case-based theory, and interface design are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Adapted from McKenney and Reeves (2018)

Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  • Adams, D. M., Mayer, R. E., & MacNamara, A. (2012). Narrative games for learning: Testing the discovery and narrative hypotheses. Journal of Educational Psychology, 104(1), 235–249.

    Article  Google Scholar 

  • Aha, D. W., Mcsherry, D., & Yang, Q. (2005). Advances in conversational case-based reasoning. Knowledge Engineering Review, 20(03), 247–254.

    Article  Google Scholar 

  • Amiel, T., & Reeves, T. C. (2008). Design-based research and educational technology: Rethinking technology and the research agenda. Educational Technology & Society, 11(4), 29–40.

    Google Scholar 

  • Anderson, T., & Shattuck, J. (2012). Design-based research a decade of progress in education research? Educational Researcher, 41(1), 16–25.

    Article  Google Scholar 

  • Barab, S., & Squire, K. (2004). Design-based research: Putting a stake in the ground. The Journal of the Learning Sciences, 13(1), 1–14.

    Article  Google Scholar 

  • Barrows, H. (1986). A taxonomy of problem-based learning methods. Medical Education, 20(6), 481–486.

    Article  Google Scholar 

  • Belland, B. (2017). Context of use of computer-based scaffolding. In B. Belland (Ed.), Instructional scaffolding in STEM education (pp. 55–77). Berlin: Springer.

    Chapter  Google Scholar 

  • Belland, B., Walker, A., Olsen, M., & Leary, H. (2015). A pilot meta-analysis of computer-based scaffolding in STEM education. Journal of Educational Technology & Society, 18(1), 183–197.

    Google Scholar 

  • Bennett, S. (2010). Investigating strategies for using related cases to support design problem solving. Educational Technology Research and Development, 58(4), 459–480.

    Article  Google Scholar 

  • Blomberg, G., Sherin, M. G., Renkl, A., Glogger, I., & Seidel, T. (2014). Understanding video as a tool for teacher education: Investigating instructional strategies to promote reflection. Instructional Science, 42(3), 443–463.

    Article  Google Scholar 

  • Clariana, R. B., Engelmann, T., & Yu, W. (2013). Using centrality of concept maps as a measure of problem space states in computer-supported collaborative problem solving. Educational Technology Research and Development, 61(3), 423–442.

    Article  Google Scholar 

  • Cobb, P., Confrey, J., diSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9–13.

    Article  Google Scholar 

  • Davies, R., Randall, D., & West, R. (2015). Using open badges to certify practicing evaluators. American Journal of Evaluation, 36(2), 151–163.

    Article  Google Scholar 

  • Dickey, M. D. (2005). Engaging by design: How engagement strategies in popular computer and video games can inform instructional design. Educational Technology Research and Development, 53(2), 67–83.

    Article  Google Scholar 

  • Ertmer, P., & Koehler, A. A. (2014). Online case-based discussions: Examining coverage of the afforded problem space. Educational Technology Research and Development, 62(5), 617–636.

    Article  Google Scholar 

  • Ertmer, P., Schlosser, S., Clase, K., & Adedokun, O. (2014). The grand challenge: Helping teachers learn/teach cutting-edge science via a PBL Approach. Interdisciplinary Journal of Problem-Based Learning, 8(1), 1–20.

    Article  Google Scholar 

  • Eseryel, D., Ifenthaler, D., & Ge, X. (2013). Validation study of a method for assessing complex ill-structured problem solving by using causal representations. Educational Technology Research and Development, 61(3), 443–463.

    Article  Google Scholar 

  • Ferguson, W., Bareiss, R., Birnbaum, L., & Osgood, R. (1992). ASK systems: An approach to the realization of story-based teachers. Journal of the Learning Sciences, 2(1), 95–134.

    Article  Google Scholar 

  • Fitzgerald, G., Koury, K., Mitchem, K., Hollingsead, C., Miller, K., Park, M. K., et al. (2009). Implementing case-based instruction in higher education through technology: What works best? Journal of Technology and Teacher Education, 17(1), 31–63.

    Google Scholar 

  • Gartmeier, M., Bauer, J., Fischer, M. R., Hoppe-Seyler, T., Karsten, G., Kiessling, C., et al. (2015). Fostering professional communication skills of future physicians and teachers: Effects of e-learning with video cases and role-play. Instructional Science, 43(4), 443–462.

    Article  Google Scholar 

  • Ge, X., & Land, S. (2003). Scaffolding students’ problem-solving processes in an ill-structured task using question prompts and peer interactions. Educational Technology Research and Development, 51(1), 21–38.

    Article  Google Scholar 

  • Gee, J. P. (2007). Good video games and good learning: Collected essays on video games, learning, and literacy. New York: Peter Lang Publishing.

    Book  Google Scholar 

  • Glazewski, K. D., & Hmelo-Silver, C. E. (2018). Scaffolding and supporting use of information for ambitious learning practices. Information and Learning Sciences, 120(1), 39–58.

    Google Scholar 

  • Goeze, A., Zottmann, J. M., Vogel, F., Fischer, F., & Schrader, J. (2014). Getting immersed in teacher and student perspectives? Facilitating analytical competence using video cases in teacher education. Instructional Science, 42(1), 91–114.

    Article  Google Scholar 

  • Graesser, A., Foltz, P. W., Rosen, Y., Shaffer, D., Forsyth, C., & Germany, M.-L. (2018). Challenges of assessing collaborative problem solving. In E. Care, P. Griffin, & M. Wilson (Eds.), Assessment and teaching of 21st century skills: Research and applications (pp. 75–91). Heidelberg: Springer.

    Chapter  Google Scholar 

  • Hainey, T., Connolly, T. M., Boyle, E. A., Wilson, A., & Razak, A. (2016). A systematic literature review of games-based learning empirical evidence in primary education. Computers & Education, 102, 202–223.

    Article  Google Scholar 

  • Hemberger, L., Kuhn, D., Matos, F., & Shi, Y. (2017). A dialogic path to evidence-based argumentive writing. Journal of the Learning Sciences, 26(4), 575–607.

    Article  Google Scholar 

  • Henry, H., Tawfik, A. A., Jonassen, D. H., Winholtz, R., & Khanna, S. (2012). “I know this is supposed to be more like the real world, but…”: Student perceptions of a PBL implementation in an undergraduate materials science course. Interdisciplinary Journal of Problem-Based Learning. https://doi.org/10.7771/1541-5015.1312.

    Article  Google Scholar 

  • Hmelo-Silver, C., Derry, S. J., Bitterman, A., & Hatrak, N. (2009). Targeting transfer in a STELLAR PBL course for pre-service teachers. Interdisciplinary Journal of Problem-Based Learning, 3(2), 24–42.

    Article  Google Scholar 

  • Hmelo-Silver, C., Duncan, R. G., & Chinn, C. (2007). Scaffolding and achievement in problem-based and inquiry learning: A response to Kirschner, Sweller, and Clark (2006). Educational Psychologist, 42(2), 99–107.

    Article  Google Scholar 

  • Hung, W. (2015). Problem-based learning: Conception, practice, and future. In Y. Cho, I. S. Caleon, & M. Kapur (Eds.), Authentic problem solving and learning in the 21st century (pp. 75–92). Singapore: Springer.

    Chapter  Google Scholar 

  • Hung, W., & Van Eck, R. (2010). Aligning problem solving and gameplay: A model for future research and design. In R. van Eck (Ed.), Interdisciplinary models and tools for serious games: Emerging concepts and future directions (pp. 227–263). Hershey: IGI Global.

    Chapter  Google Scholar 

  • Hwang, G.-J., & Wu, P.-H. (2012). Advancements and trends in digital game-based learning research: A review of publications in selected journals from 2001 to 2010. British Journal of Educational Technology, 43(1), 6–10.

    Article  Google Scholar 

  • Jaakkola, T., & Veermans, K. (2018). Exploring the effects of concreteness fading across grades in elementary school science education. Instructional Science, 46(2), 185–207.

    Article  Google Scholar 

  • Jacobson, M. J. (2001). Problem solving, cognition, and complex systems: Differences between experts and novices. Complexity, 6(3), 41–49.

    Article  Google Scholar 

  • Jerrim, J., Oliver, M., & Sims, S. (2019). The relationship between inquiry-based teaching and students’ achievement. New evidence from a longitudinal PISA study in England. Learning and Instruction, 61, 35–44.

    Article  Google Scholar 

  • Jonassen, D. H. (1997). Instructional design models for well-structured and ill-structured problem-solving learning outcomes. Educational Technology Research and Development, 45(1), 65–94.

    Article  Google Scholar 

  • Jonassen, D. H. (2011a). ASK systems: Interrogative access to multiple ways of thinking. Educational Technology Research and Development, 59(1), 159–175.

    Article  Google Scholar 

  • Jonassen, D. H. (2011b). Learning to solve problems: A handbook for designing problem-solving learning environments (1st ed.). London: Routledge.

    Google Scholar 

  • Jonassen, D. H., & Cho, Y. (2011). Fostering argumentation while solving engineering ethics problems. Journal of Engineering Education, 100(4), 680–702.

    Article  Google Scholar 

  • Jonassen, D. H., & Hernandez-Serrano, J. (2002). Case-based reasoning and instructional design: Using stories to support problem solving. Educational Technology Research and Development, 50(2), 65–77.

    Article  Google Scholar 

  • Jonassen, D. H., & Kim, B. (2010). Arguing to learn and learning to argue: Design justifications and guidelines. Educational Technology Research and Development, 58, 439–457.

    Article  Google Scholar 

  • Ju, H., & Choi, I. (2017). The role of argumentation in hypothetico-deductive reasoning during problem-based learning in medical education: A conceptual framework. Interdisciplinary Journal of Problem-Based Learning, 12(1), 4.

    Article  Google Scholar 

  • Kim, N. J., Belland, B., & Walker, A. E. (2017). Effectiveness of computer-based scaffolding in the context of problem-based learning for STEM education: Bayesian meta-analysis. Educational Psychology Review, 30(2), 397–429.

    Article  Google Scholar 

  • Kim, H., & Hannafin, M. J. (2011). Developing situated knowledge about teaching with technology via web-enhanced case-based activity. Computers & Education, 57(1), 1378–1388.

    Article  Google Scholar 

  • Kirschner, P., Sweller, J., & Clark, R. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75–86.

    Article  Google Scholar 

  • Kirschner, P., & van Merriënboer, J. J. G. (2013). Do learners really know best? Urban legends in education. Educational Psychologist, 48(3), 169–183.

    Article  Google Scholar 

  • Kolodner, J. (1991). Improving human decision making through case-based decision aiding. AI Magazine, 12(2), 52–68.

    Google Scholar 

  • Kolodner, J., Camp, P. J., Crismond, D., Fasse, B., Gray, J., Holbrook, J., et al. (2003). Problem-Based learning meets case-based reasoning in the middle-school science classroom: Putting learning by design into practice. Journal of the Learning Sciences, 12(4), 495–547.

    Article  Google Scholar 

  • Kolodner, J., Cox, M., & Gonzalez-Calero, P. (2005). Case-based reasoning-inspired approaches to education. Knowledge Engineering Review, 20(03), 299–303.

    Article  Google Scholar 

  • Kolodner, J., Dorn, B., Owensby, J., & Guzdial, M. (2012). Theory and practice of case-based learning aids. In D. H. Jonassen & S. Land (Eds.), Theoretical foundations of learning environments (2nd ed., pp. 142–170). Abingdon: Routledge.

    Google Scholar 

  • Kolodner, J., Owensby, J., & Guzdial, M. (2004). Case-based learning aids. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology: A project of the Association for Educational Communications and Technology (pp. 829–861). Hrajel: LEA.

    Google Scholar 

  • Lazonder, A., & Harmsen, R. (2016). Meta-analysis of inquiry-based learning: Effects of guidance. Review of Educational Research, 87(4), 1–38.

    Google Scholar 

  • Lin-Siegler, X., Ahn, J. N., Chen, J., Fang, F.-F. A., & Luna-Lucero, M. (2016). Even Einstein struggled: Effects of learning about great scientists’ struggles on high school students’ motivation to learn science. Journal of Educational Psychology, 108(3), 314.

    Article  Google Scholar 

  • Lu, J., & Chan, L. K. (2015). Differ in socio-cognitive processes? Some comparisons between paper and video triggered PBL. Interdisciplinary Journal of Problem-Based Learning, 9(2), 5.

    Article  Google Scholar 

  • Lucas, M., Gunawardena, C., & Moreira, A. (2014). Assessing social construction of knowledge online: A critique of the interaction analysis model. Computers in Human Behavior, 30, 574–582.

    Article  Google Scholar 

  • McKenney, S., & Reeves, T. (2014). Educational design research. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (4th ed., pp. 131–140). New York: Springer.

    Chapter  Google Scholar 

  • McKenney, S., & Reeves, T. C. (2018). Conducting educational design research. Routledge.

  • McSherry, D. (2001). Minimizing dialog length in interactive case-based reasoning.In Proceedings of the 17th international joint conference on artificial intelligence—volume 2, 993–998. San Francisco, CA, USA: Morgan Kaufmann Publishers Inc.

  • Nielsen, J. (2006). F-shaped pattern for reading web content. Retrieved May 1, 2019, from https://www.nngroup.com/articles/f-shaped-pattern-reading-web-content/.

  • Olney, A. M., Graesser, A. C., & Person, N. K. (2012). Question generation from concept maps. Dialogue & Discourse, 3(2), 75–99.

    Article  Google Scholar 

  • Phillips, D. C., & Dolle, J. R. (2006). From Plato to Brown and beyond: Theory, practice, and the promise of design experiments. In L. Verschaffel, F. Dochy, M. Boekaerts, & S. Vosniadou (Eds.), Instructional psychology: Past, present and future trends: Sixteen essays in honour of Erik DeCorte (pp. 277–292). Amsterdam: Elsevier.

    Google Scholar 

  • Puntambekar, S., & Hubscher, R. (2005). Tools for scaffolding students in a complex learning environment: What have we gained and what have we missed? Educational Psychologist, 40(1), 1–12.

    Article  Google Scholar 

  • Raaijmakers, S. F., Baars, M., Schaap, L., Paas, F., van Merriënboer, J., & van Gog, T. (2017). Training self-regulated learning skills with video modeling examples: Do task-selection skills transfer? Instructional Science, 46, 1–18.

    Google Scholar 

  • Reeves, T., Herrington, J., & Oliver, R. (2005). Design research: A socially responsible approach to instructional technology research in higher education. Journal of Computing in Higher Education, 16(2), 96–115.

    Article  Google Scholar 

  • Sandoval, W. (2014). Conjecture mapping: An approach to systematic educational design research. Journal of the Learning Sciences, 23(1), 18–36.

    Article  Google Scholar 

  • Schank, R. (1999). Dynamic memory revisited (2nd ed.). Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Schmidt, M., & Tawfik, A. (2018). Using analytics to transform a problem-based case library: An educational design research approach. Interdisciplinary Journal of Problem-Based Learning, 12(1). https://doi.org/10.7771/1541-5015.1635.

  • Si, J., Kong, H.-H., & Lee, S.-H. (2018). Developing clinical reasoning skills through argumentation with the concept map method in medical problem-based learning. Interdisciplinary Journal of Problem-Based Learning, 13(1), 5.

    Google Scholar 

  • Squire, K. (2008). Video games and education: Designing learning systems for an interactive age. Educational Technology Research and Development, 48(2), 17–26.

    Google Scholar 

  • Tang, H., & Clariana, R. (2017). Leveraging a sorting task as a measure of knowledge structure in bilingual settings. Technology, Knowledge and Learning, 22(1), 23–35.

    Article  Google Scholar 

  • Tawfik, A. A. (2017). Do cases teach themselves? A comparison of case library prompts in supporting problem-solving during argumentation. Journal of Computing in Higher Education, 29(2), 267–285.

  • Tawfik, A. A., & Kolodner, J. (2016). Systematizing scaffolding for problem-based learning: A view from case-based reasoning. Interdisciplinary Journal of Problem-Based Learning, 10(1), 6.

    Article  Google Scholar 

  • Tawfik, A. A., & Jonassen, D. H. (2013). The effects of successful versus failure-based cases on argumentation while solving decision-making problems. Educational Technology Research & Development, 61(3), 385–406.

    Article  Google Scholar 

  • Tripp, S. D., & Bichelmeyer, B. (1990). Rapid prototyping: An alternative instructional design strategy. Educational Technology Research and Development, 38(1), 31–44.

    Article  Google Scholar 

  • van Merriënboer, J. J. G. (2013). Perspectives on problem solving and instruction. Computers & Education, 64, 153–160.

    Article  Google Scholar 

  • Vogel, F., Wecker, C., Kollar, I., & Fischer, F. (2017). Socio-cognitive scaffolding with computer-supported collaboration scripts: A meta-analysis. Educational Psychology Review, 29(3), 477–511.

    Article  Google Scholar 

  • Walker, A., & Leary, H. (2009). A problem based learning meta analysis: Differences across problem types, implementation types, disciplines, and assessment levels. Interdisciplinary Journal of Problem-Based Learning, 3(1). Retrieved May 1, 2019, from http://docs.lib.purdue.edu/ijpbl/vol3/iss1/3.

  • Wilder, S. (2015). Impact of problem-based learning on academic achievement in high school: A systematic review. Educational Review, 67(4), 414–435.

    Article  Google Scholar 

  • Wolff, C. E., Jarodzka, H., van den Bogert, N., & Boshuizen, H. P. A. (2016). Teacher vision: Expert and novice teachers’ perception of problematic classroom management scenes. Instructional Science, 44(3), 243–265.

    Article  Google Scholar 

Download references

Funding

No funding is associated with this research.

Author information

Authors and Affiliations

  1. Instructional Design and Technology, University of Memphis, Memphis, USA

    Andrew A. Tawfik & Chelsy P. Hooper

  2. Instructional Design and Technology, University of Florida, Gainesville, USA

    Matthew Schmidt

Authors
  1. Andrew A. Tawfik
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Matthew Schmidt
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chelsy P. Hooper
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrew A. Tawfik.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tawfik, A.A., Schmidt, M. & Hooper, C.P. Role of conjecture mapping in applying a game-based strategy towards a case library: a view from educational design research. J Comput High Educ 32, 655–681 (2020). https://doi.org/10.1007/s12528-020-09251-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12528-020-09251-1

Keywords

Search

Navigation