Skip to main content
Log in

The effects of successful versus failure-based cases on argumentation while solving decision-making problems

  • Research Article
  • Published:
Educational Technology Research and Development Aims and scope Submit manuscript

Abstract

Solving complex, ill-structured problems may be effectively supported by case-based reasoning through case libraries that provide just-in-time domain-specific principles in the form of stories. The cases not only articulate previous experiences of practitioners, but also serve as problem-solving narratives from which learners can acquire meaning. The current study investigated the effects of different case-types (success, failures) on analogical transfer to similar problems. In the first week, undergraduate sales management students (N = 36) were assigned to different case library treatments (success, failure) and asked to construct a multifaceted argument (initial argument, counterargument, rebuttal) to resolve an ill-structured, decision-making hiring problem. In the following week, students constructed an argument to solve a novel case without the support of the case library. Data analysis revealed the failure-based case library condition produced significantly higher scores on measurements of counterarguments and holistic argumentation scores on both tasks. A discussion of the implications for pedagogy and instructional design are also presented.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Aamodt, A., & Plaza, E. (1996). Case-based reasoning: Foundational issues, methodological variations, and systems approaches. Artificial Intelligence Communications, 7(1), 39–59.

    Google Scholar 

  • Asterhan, C. S. C., & Schwarz, B. B. (2009). Argumentation and explanation in conceptual change: Indications from protocol analyses of peer-to-peer dialog. Cognitive Science, 33(3), 374–400. doi:10.1111/j.1551-6709.2009.01017.x.

    Article  Google Scholar 

  • Barrows, H. (1988). The tutorial process. Springfield: Southern Illinois University School of Medicine.

    Google Scholar 

  • Barrows, H. (1996). Problem-based learning in medicine and beyond: A brief overview. New Directions for Teaching and Learning, 1996(68), 3–12.

    Article  Google Scholar 

  • Barrows, H., & Tamblyn, R. (1980). Problem-based learning: An approach to medical education. New York: Springer Publishing Company.

    Google Scholar 

  • Bauer, J., & Mulder, R. (2007). Modelling learning from errors in daily work. Learning in Health and Social Care, 6(3), 121–133.

    Article  Google Scholar 

  • Dunlap, J., & Grabinger, R. S. (1996). Rich environments for active learning in the higher education classroom. In B. G. Wilson (Ed.), Constructivist learning environments: Case studies in instructional design (pp. 65–82). Englewood Cliffs: Educational Technology.

  • Ellis, S., & Davidi, I. (2005). After-event reviews: Drawing lessons from successful and failed experience. Journal of Applied Psychology, 90(5), 857–871.

    Article  Google Scholar 

  • Ellis, S., Mendel, R., & Davidi, I. (2006). Learning from successful and failed experience: The moderating role of kind of after-event review. Journal of Applied Psychology, 91(3), 669–680.

    Article  Google Scholar 

  • Fullerton, A. S. (2009). A conceptual framework for ordered logistic regression models. Sociological Methods & Research, 38(2), 306–347. doi:10.1177/0049124109346162.

    Article  Google Scholar 

  • Gartmeier, M., Bauer, J., Gruber, H., & Heid, H. (2008). Negative knowledge: Understanding professional learning and expertise. Vocations and Learning, 1(2), 87–103. doi:10.1007/s12186-008-9006-1.

    Article  Google Scholar 

  • Gartmeier, M., Bauer, J., Gruber, H., & Heid, H. (2010). Workplace errors and negative knowledge in elder care nursing. Human Resource Development International, 13(1), 5–25.

    Article  Google Scholar 

  • Gijbels, D., Dochy, F., Van den Bossche, P., & Segers, M. (2005). Effects of problem-based learning: A meta-analysis from the angle of assessment. Review of Educational Research, 75(1), 27–61. doi:10.3102/00346543075001027.

    Article  Google Scholar 

  • Gore, D. C. (2006). National survey of surgical morbidity and mortality conferences. The American Journal of Surgery, 191(5), 708–714. doi:10.1016/j.amjsurg.2006.01.029.

    Article  Google Scholar 

  • Hernandez-Serrano, J., & Jonassen, D. H. (2003). The effects of case libraries on problem solving. Journal of Computer Assisted Learning, 19(1), 103–114.

    Article  Google Scholar 

  • Hoeve, A., & Nieuwenhuis, L. F. (2006). Learning routines in innovation processes. Journal of Workplace Learning, 18(3), 171–185.

    Article  Google Scholar 

  • Ifenthaler, D. (2010). Relational, structural, and semantic analysis of graphical representations and concept maps. Educational Technology Research and Development, 58(1), 81–97.

    Article  Google Scholar 

  • Jeong, A., & Joung, S. (2007). Scaffolding collaborative argumentation in asynchronous discussions with message constraints and message labels. Computers & Education, 48(3), 427–445. doi:10.1016/j.compedu.2005.02.002.

    Article  Google Scholar 

  • Jeong, A. C., & Lee, J. (2008). The effects of active versus reflective learning style on the processes of critical discourse in computer-supported collaborative argumentation. British Journal of Educational Technology, 39(4), 651–665.

    Article  Google Scholar 

  • Jonassen, D. (1997). Instructional design models for well-structured and ill-structured problem-solving learning outcomes. Educational Technology Research and Development, 45(1), 65–94.

    Article  Google Scholar 

  • Jonassen, D. (2000). Toward a design theory of problem solving. Educational Technology Research and Development, 48(4), 63–85.

    Article  Google Scholar 

  • Jonassen, D. H. (2011). Learning to solve problems: A handbook for designing problem-solving learning environments. New York: Routledge.

    Google Scholar 

  • Jonassen, D. H., & Cho, Y. (2011). Fostering argumentation while solving engineering ethics problems. Journal of Engineering Education, 100(4), 680–702.

    Article  Google Scholar 

  • Jonassen, D. H., & Hernandez-Serrano, J. (2002). Case-based reasoning and instructional design: Using stories to support problem solving. Educational Technology Research and Development, 50(2), 65–77.

    Article  Google Scholar 

  • Jonassen, D., & Hung, W. (2006). Learning to troubleshoot: A new theory-based design architecture. Educational Psychology Review, 18(1), 77–114.

    Article  Google Scholar 

  • Jonassen, D., & Hung, W. (2008). All problems are not equal: Implications for problem-based learning. Interdisciplinary Journal of Problem-based Learning, 2(2), 6–28.

    Article  Google Scholar 

  • Kim, H., & Hannafin, M. J. (2008). Grounded design of web-enhanced case-based activity. Educational Technology Research and Development, 56(2), 161–179.

    Article  Google Scholar 

  • Kolodner, J. L. (1992). An introduction to case-based reasoning. Artificial Intelligence Review, 6(1), 3–34. doi:10.1007/BF00155578.

    Article  Google Scholar 

  • Kolodner, J. L., Cox, M., & Gonzalez-Calero, P. (2005). Case-based reasoning-inspired approaches to education. The Knowledge Engineering Review, 20(3), 299–303. doi:10.1017/S0269888906000634.

    Article  Google Scholar 

  • Kolodner, J. L., Owensby, J., & Guzdial, M. (2004). Case-based learning aids. In D. Jonassen (Ed.), Handbook of research on educational communications and technology (2nd ed., pp. 829–861). Mahwah: LEA.

  • Kuhn, D. (1993). Science as argument: Implications for teaching and learning scientific thinking. Science Education, 77(3), 319–337. doi:10.1002/sce.3730770306.

    Article  Google Scholar 

  • Kuhn, D., & Udell, W. (2003). The development of argument skills. Child Development, 74(5), 1245–1260.

    Article  Google Scholar 

  • Kuhn, D., & Udell, W. (2007). Coordinating own and other perspectives in argument. Thinking & Reasoning, 13(2), 90–104.

    Article  Google Scholar 

  • Lin, T.-J., & Anderson, R. C. (2008). Reflections on collaborative discourse, argumentation, and learning. Contemporary Educational Psychology, 33(3), 443–448. doi:10.1016/j.cedpsych.2008.06.002.

    Article  Google Scholar 

  • Mason, L., Gava, M., & Boldrin, A. (2008). On warm conceptual change: The interplay of text, epistemological beliefs, and topic interest. Journal of Educational Psychology, 100(2), 291–309. doi:10.1037/0022-0663.100.2.291.

    Article  Google Scholar 

  • Mathan, S., & Koedinger, K. (2005). Fostering the intelligent novice: Learning from errors with metacognitive tutoring. Educational Psychologist, 40(4), 257–265.

    Article  Google Scholar 

  • Norman, G., & Schmidt, H. G. (1992). The psychological basis of problem-based learning: A review of the evidence. Academic Medicine, 67(9), 557–565.

    Article  Google Scholar 

  • Nussbaum, M. (2008). Collaborative discourse, argumentation, and learning: Preface and literature review. Contemporary Educational Psychology, 33(3), 345–359. doi:10.1016/j.cedpsych.2008.06.001.

    Article  Google Scholar 

  • Nussbaum, M., & Schraw, G. (2007). Promoting argument-counterargument integration in students’ writing. Journal of Experimental Education, 76(1), 59–92.

    Article  Google Scholar 

  • Nussbaum, M., Kardash, C. A. M., & Graham, S. E. (2005). The effects of goal instructions and text on the generation of counterarguments during writing. Journal of Educational Psychology, 97(2), 157.

    Article  Google Scholar 

  • Parviainen, J., & Eriksson, M. (2006). Negative knowledge, expertise and organisations. International Journal of Management Concepts and Philosophy, 2(2), 140–153.

    Google Scholar 

  • Popper, K. (1987). All life is problem solving. London: Routledge.

    Google Scholar 

  • Rosenfeld, J. C. (2005). Using the morbidity and mortality conference to teach and assess the ACGME general competencies. Current Surgery, 62(6), 664–669. doi:10.1016/j.cursur.2005.06.009.

    Article  Google Scholar 

  • Rourke, L., Anderson, T., Garrison, D. R., & Archer, W. (2001). Methodological issues in the content analysis of computer conference transcripts. International Journal of Artificial Intelligence in Education, 12, 8–22.

    Google Scholar 

  • Savery, J. R., & Duffy, T. M. (1996). Problem based learning: An instructional model and its constructivist framework. Educational Technology, 35(5), 31–38.

    Google Scholar 

  • Schank, R. (1999). Dynamic memory revisited (2nd ed.). Cambridge: Cambridge University Press.

  • Schank, R., Berman, T., & Macpherson, K. (1999). Learning by doing. In C. M. Reigeluth (Ed.), Instructional-design theories and models: A new paradigm of instructional theory (1st ed., Vol. 2, pp. 241–261). Mahwah: Lawrence Erlbaum Associates.

  • Schrader, P. G., Leu, D. J., Kinzer, C. K., Ataya, R., Teale, W. H., Labbo, L. D., et al. (2003). Using Internet delivered video cases, to support pre-service teachers’ understanding of effective early literacy instruction: An exploratory study. Instructional Science, 31(4), 317–340. doi:10.1023/A:1024690111227.

    Article  Google Scholar 

  • Seel, N. (2008). Empirical perspectives on memory and motivation. In J. M. Spector, M. D. Merrill, J. van Merrienboer, & M. Driscoll (Eds.), Handbook of research on educational communications and technology (3rd ed., pp. 659–670). New York: Routledge.

    Google Scholar 

  • Shepherd, D. A. (2003). Learning from business failure: Propositions of grief recovery for the self-employed. The Academy of Management Review, 28(2), 318–328. doi:10.2307/30040715.

    Google Scholar 

  • Sitkin, S. B. (1992). Learning through failure: The strategy of small losses. Research in Organizational Behavior, 14, 231–266.

    Google Scholar 

  • Spiro, R. J., Coulson, R. L., Feltovich, P. J., & Anderson, D. K. (1988). Cognitive flexibility theory: Advanced knowledge acquisition in ill-structured domains. Tech Report No. 441. Champaign, IL: University of Illinois, Center for the Study of Reading.

  • Stegmann, K., Weinberger, A., & Fischer, F. (2007). Facilitating argumentative knowledge construction with computer-supported collaboration scripts. International Journal of Computer-Supported Collaborative Learning, 2(4), 421–447. doi:10.1007/s11412-007-9028-y.

    Article  Google Scholar 

  • Weinberger, A., Stegmann, K., & Fischer, F. (2010). Learning to argue online: Scripted groups surpass individuals (unscripted groups do not). Computers in Human Behavior, 26(4), 506–515. doi:10.1016/j.chb.2009.08.007.

    Article  Google Scholar 

Download references

Acknowledgments

We would like to express our gratitude for the helpful comments of the reviewers throughout the iterations of this manuscript. We would like also like to thank the editors for their detailed assistance at each stage of the review process.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andrew Tawfik.

Appendices

Appendix 1: Initial task

Nick stepped into work Monday morning with his boss, Sheila. She scheduled this meeting to discuss a series of applicants that were being considered to fill a medical device sales position left open after someone recently left to pursue another opportunity at another company.

“Nick”, she begins, “we need to stop having to fill this position. It is killing us in terms of time and money to have to hire and train a new person every 6 months. We’ve had a lot of turnover in this medical sales position that needs to be stopped. As you know, we’ve missed on some of the previous hires. The three people we have had come in and out have cost us $90,000 over the last year in terms of revenue and training. That’s $30,000 per person! The last individual hired for the position seemed pretty good in terms of technical expertise, but it was pretty clear that the sales aspect of the job wasn’t a great fit. Let’s go through some of these together and see if we can find someone with that right mix between technical expertise and social skills”.

After going through the applicants, it becomes evident that it was difficult to find a great deal of qualified applicants.

“Oh man,” Nick exclaims. “I didn’t realize it would be this hard to find one person to fill a position. A lot of these people look really good on paper, but they just don’t have the sales experience needed. They have decent schooling, but I want to make sure we bring in the right people. We could try to retry posting a job ad in the St. Louis newspaper, but that costs us about $1,500 per month. It’s a risk shelling out all that money, but I think it’s worth it if we get the right person rather than continuing to lose market share and have to constantly train new people. How about that list you have in front of you? Do you see any resumes that you like in particular?”

Sheila thumbs through some applicants. “Actually, here is one that seems pretty interesting. This individual, Lewis, has a decent GPA. It is about a 3.1 overall, but a 3.8 in classes related to his major. He also has somewhat related experience when he worked as a marketing intern for a children’s hospital. Another option is try to try to promote from within. That might only cost us $15,000 to train a new person. I’ve heard great things about one employee in particular. This one employee, Terry, gets great telemarketing numbers in one of the worst territories for selling smaller medical devices. Plus, I know the supervisor in that department raves about Terry’s character and leadership in that role. Although the experience isn’t totally equivalent, it sounds like Terry has a chance to connecting with customers face-to-face.”

Nick quickly peruses the resume. “Terry is interesting, but I really like Lewis’ resume. I see there’s a lot of activity in some service fraternities and showed some leadership qualities there. I just love the experience in the medical field. If the references check out, why don’t we setup an interview? If not, a better bet might be to just draft a posting for a newspaper advertisement.”

Nick takes the time to contact Lewis’ references. Each are previous supervisors for whom he has worked within the last 5 years. They all speak positively about his experience and determination in the workforce. They also raved about how Lewis fit in so well within various work cultures. Nick decides to move forward with the interview at headquarters. However, in doing the background check, Nick discovers that Lewis has had an incident with an underage DUI. This is problematic because the company has a policy that does not allow individuals with moving violations to be eligible for sales positions that require a company car. However, Nick decides to still pursue the interview.

During the interview, Nick is impressed with Lewis’ demeanor and knowledge of the field. As the interview is wrapping up, Nick says “I enjoyed our meeting. I have to be honest with you. I did a background check and your DUI came up. Our policy says that we are not allowed to hire you except for special exceptions. We have a lot of expensive medical equipment and this a big burden for our insurance. If we were to hire you, our insurance would go up even more. What do you think I should do?”

Lewis says, “I know that. I probably should have detailed that on the online application, but I didn’t want to be excluded right away. To be honest, that was something that happened a long time ago. I realize it was a learning experience for me and I did all that the court required of me. Now that I’m 25, I feel as though I have taken those life lessons and will be a better employee for you because I appreciate the opportunity more. This is a dream job for me and I will be willing to do whatever it takes. You could start me off at a smaller job to demonstrate my trustworthiness. In fact, you can even take out any additional liability cost out of my paycheck until it is no longer an issue”.

Nick pauses for a minute. “I am going to have to reflect on this a bit more. I will call you in a week to tell you our decision”.

Assignment

Construct an argument (2 pages double spaced) detailing why Nick should or should not hire Lewis. The argument should include three different components: initial argument, counterargument, and rebuttal.

1. The initial argument provides a stance and supporting evidence for an initial position.2. The counterargument consists of a position and evidence that others might suggest that undermine your theory made in the initial argument.3. Finally, propose a rebuttal will answer and/or respond to the evidence proposed by the counterargument. Rather that restate the initial argument, the rebuttal should reconcile the arguments made in the argument and counterargument. For instance, the rebuttal might (a) try to challenge the validity of the stance made in the counterclaim (b) suggest a solution that offers a compromise between the initial argument and counterargument or (c) argue that one side is stronger and more influential to the argument.

Appendix 2: Sample success story

Case 1: Holly’s chance

After looking for 2 years, Jason finally found the right position that would allow him to transition from the factory floor to steel sales. In fact, he had always dreamed of working in steel sales after 10 years of making steel pipe. The move would require him to move from Pittsburgh to St. Louis, but he was ready to begin his sales career. After many years on the job market and frantic searches for new sales positions, this was finally the new opportunity Jason had been looking for. Although many of his friends had tried and failed to move from the blue-collar culture of manufacturing to the social-oriented sales career, Jason felt up for the task.

Across the country, the St. Louis distributor human resources were reviewing applicants and came across Jason’s resume. Initially, Holly discarded the resume. She had been around long enough to know that individuals did not transition well from moving to the sales side of the steel industry after so many years on the factory floor. Her colleagues did not know how to explain it. They called that missing trait the “it factor”. Holly knew that it was much more than that. She knew that those that failed did not have the social skills necessary to adapt to the new culture. She reasoned this was particularly important sales people that needed to relate with the blue-collar contractors. Finding an individual that had the technical aptitude to speak meaningfully about steel, but know how to communicate in an effective way was difficult to come by. This lack of social skills was unfortunate because the current sales personnel did not have the technical aptitude that could compare with those who actually made steel day-in and day-out.

As Holly looked more closely at Jason’s resume, she wondered if there was some additional work experience that may be applicable. Since Jason did not have many employers, he listed as many as he could on his application even if the positions did not always seem relevant. Despite the advice from his friends who insisted listing a minimum wage position at Ace Hardware was beneath the position he was applying for, Jason included the experience. Holly reasoned that maybe something as simple as listening and relating to customers everyday in this context would be provide Jason the experience needed to build and gain important social skills. Holly knew it wasn’t much, but she strongly believed it showed the aptitude to connect with customers.

Holly decided to take a chance on Jason and hire him. To the surprise of her colleagues, Jason was able to pick up the social aspect of the sale quickly. After 6 months on the job, Jason and Holly sat down to discuss lifting the initial probationary period for all new employees and possible addition of more customer territories. Whereas other individuals required additional training on relating to others or technical aspects of the steel pipe, Jason and Holly began discussing the next steps for his career.

Appendix 3: Sample failure story

Case 1: Holly’s chance

After looking for 2 years, Jason finally found the right position that would allow him to transition from the factory floor to steel sales. In fact, he had always dreamed of working in steel sales after 10 years of making steel pipe. The move would require him to move from Pittsburgh to St. Louis, but he was ready to begin his sales career. After many years on the job market and frantic searches for new sales positions, this was finally the new opportunity Jason had been looking for. Although many of his friends had tried and failed to move from the blue-collar culture of manufacturing to the social-oriented sales career, Jason felt up for the task.

The day of the interview came and the hiring staff really liked Jason’s experience. Although some questioned Holly as to whether Jason had applicable experience that would translate to the new position, she was confident in his skills to become a successful salesman. The job was offered and Jason needed little time to mull over the opportunity. In fact, he had reason to feel confident about his decision. He had a strong college degree in sales and later worked in sales for a mill for another 4 years.

Although Jason had 4 years experience working sales for a mill, he believed it would be a seamless transition as he learned how to be a salesman for a distributor. He soon realized that this position needed a different set of skillsets.

Jason came in on Monday to a meeting with his boss.

“Jason, please sit down” Holly began. “I just heard that we lost another big client last week. That is your third one in 7 months! What’s worse is that one of their executives just said that you yelled at her on a phone conference? What is going on?”

“Well, it’s not my fault. They were complaining about the product and it was clear they just weren’t understanding what it all entails. That’s on them, not me! They come to me complaining about the quality of the product. When I was selling at the mill, we were on a month-to-month commission to keep us moving. We didn’t focus up on all those tedious follow-up issues because we were focused on bringing in money. The way I see it, my job is to sell a product, not have to jump at every little thing they ask me for. You should see some of these things they send to me everyday. They are so trivial and they just drive me crazy all day. I focus on the big things of what I sell to your business, but it’s unreasonable for them to ask me to always hold their hand along the way. How am I making the company money if I’m always responding to every little complaint?”

“Well, that attitude has cost us a lot of money. You need to understand that this is a new culture and it’s not always the same between different industries. We focus on long-term relationship building, not a frenetic selling pace promoted by the mill. You have been so focused on the short-term sales because of your previous experience and now you have compromised our long-term sales strategies. I don’t know if you skillsets truly transferred. As a result of this oversight, I’m wondering if we need to reevaluate your future in this position.”

Appendix 4: Sample counterargument

“While the underage DUI on Lewis’ record can be attributed to childhood mistakes, the repercussions of such a mistake will impact whether he can be hired. With the recent trend of failed hires, costing the company about $30,000 per hire, selecting a candidate with a known risk that will increase the company’s liability jeopardizes the success of the sales team and potentially Nick’s job as a recruiter. With the masses of resumes piling in, Nick’s time is better spent locating a candidate with similar qualifications and no red flags that hiring Lewis and spending time trying to circumvent the costs associated with Lewis’ DUI. A thorough review of possible candidates could possibly save costs in the future associated with lost sales, extra training, etc.

“Promoting from within also boasts several benefits to the company as opposed to hiring outside the firm. Promoting an existing employee is less expensive (increase of $15,000), bypassing questions regarding fit with company culture. Terry, the existing employee, is also better understood by management, perhaps allowing the transition to the new position to be designed more efficiently, without overlap in training, growing pains from becoming acquainted with new people, etc. Management knows Terry’s strengths (face-to-face connections, character, leadership) and could adjust Terry’s responsibilities to her strengths and avoid her weaknesses. The act also serves as incentive for other employees to grow their own careers inside the company.”

Rights and permissions

Reprints and permissions

About this article

Cite this article

Tawfik, A., Jonassen, D. The effects of successful versus failure-based cases on argumentation while solving decision-making problems. Education Tech Research Dev 61, 385–406 (2013). https://doi.org/10.1007/s11423-013-9294-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11423-013-9294-5

Keywords

Navigation