Soft Computing

, Volume 21, Issue 24, pp 7579–7596 | Cite as

Hybrid case-based reasoning system by cost-sensitive neural network for classification

  • Saroj Kr. Biswas
  • Manomita Chakraborty
  • Heisnam Rohen Singh
  • Debashree Devi
  • Biswajit Purkayastha
  • Akhil Kr. Das
Methodologies and Application
  • 166 Downloads

Abstract

Case-based reasoning (CBR) is an artificial intelligent approach to learning and problem-solving, which solves a target problem by relating past similar solved problems. But it faces the challenge of weights assignment to features to measure similarity between cases. There are many methods to overcome this feature weighting problem of CBR. However, neural network’s pruning is one of the powerful and useful methods to overcome this feature weighting problem, which extracts feature weights from trained neural network without losing the generality of training set by four popular mechanisms: sensitivity, activity, saliency and relevance. It is habitually assumed that the training sets used for learning are balanced. However, this hypothesis is not always true in real-world applications, and hence, the tendency is to yield classification models that are biased toward the overrepresented class. Therefore, a hybrid CBR system is proposed in this paper to overcome this problem, which adopts a cost-sensitive back-propagation neural network (BPNN) in network pruning to find feature weights. These weights are used in CBR. A single cost parameter is used by the cost-sensitive BPNN to distinguish the importance of class errors. A balanced decision boundary is generated by the cost parameter using prior information. Thus, the class imbalance problem of network pruning is overcome to improve the accuracy of the hybrid CBR. From the empirical results, it is observed that the performance of the proposed hybrid CBR system is better than the hybrid CBR by standard neural network. The performance of the proposed hybrid system is validated with seven datasets.

Keywords

Case-based reasoning Artificial neural networks Similarity measure k-NN similarity measure Data mining 

References

  1. Aamodt A, Plaza E (1994) Case-based reasoning: foundational issues, methodological variations, and system approaches. Artif Intell Commun 7(1):39–52Google Scholar
  2. Becker L, Jazayeri K (1989) A connectionist approaches to case-based reasoning. In: Proceedings of case-based reasoning workshop pensacola beach. Morgan Kaufmann, San Mateo, pp 213–217Google Scholar
  3. Braga AP, Castro CL (2013) Novel cost-sensitive approach to improve the multilayer perceptron performance on imbalanced data. IEEE Trans Neural Netw Learn Syst 24(6):888–899CrossRefGoogle Scholar
  4. Buta P (1994) Mining for financial knowledge with CBR. AI Expert 9(2):34–41Google Scholar
  5. Daelemans W, Gillis S, Durieux G (1994) The acquisition of stress: a data oriented approach. Comput Linguist 20(3):421–451Google Scholar
  6. de Villiers J, Barnard E (1993) Backpropagation neural nets with one and two hidden layers. IEEE Trans Neural Netw 4(1):136–141CrossRefGoogle Scholar
  7. Ganganwar V (2012) An overview of classification algorithms for imbalanced datasets. Int J Emerg Technol Adv Eng 2(4):42–47Google Scholar
  8. Ha S (2008) A personalized counseling system using case-based reasoning with neural symbolic feature weighting (CANSY). Appl Intell 29(3):279–288CrossRefGoogle Scholar
  9. Im KH, Park SC (2007) Case-based reasoning and neural network based expert system for personalization. Expert Syst Appl 32(1):77–85CrossRefGoogle Scholar
  10. Leake DB (1996) Case-based reasoning: experiences, lessons and future directions. MIT Press, CambridgeGoogle Scholar
  11. López V, Fernández A, Moreno-Torres JG, Herrera F (2012) Analysis of preprocessing vs. cost-sensitive learning for imbalanced classification. Open problems on intrinsic data characteristics. J Expert Syst Appl 39(7):6585–6608CrossRefGoogle Scholar
  12. Nguyen GH, Bouzerdoum A, Phung SL (2009) Learning pattern classification tasks with imbalanced data sets. In: Yin P (ed) Pattern recognition, chap 10. In-Tech, Vukovar, Croatia, pp 193–208Google Scholar
  13. Nunez H, Sanchez-Marre M, Cortes U, Comas J, Martinez M, Rodriguez-Roda I, Poch M (2004) A comparative study on the use of similarity measures in case based reasoning to improve the classification of environmental system situations. Environ Model Softw 19(9):809–819CrossRefGoogle Scholar
  14. Park JH, Im KH, Shin CK, Park SC (2004) MBNR: case-based reasoning with local feature weighting by neural network. Appl Intell 21(3):265–276CrossRefMATHGoogle Scholar
  15. Park SC, Kim JW, Im KH (2006) Feature-weighted CBR with neural network for symbolic features. ICIC, LNCS 4113, pp 1012–1020Google Scholar
  16. Peng Y, Zhuang L (2007) A case-based reasoning with feature weights derived by BP network. In: Proceedings of workshop on intelligent information technology application. IEEE Computer Society, pp 26–29Google Scholar
  17. Sarwar S, Ul-Qayyum Z, Malik OA (2010) CBR and neural networks based technique for predictive prefetching. MICAI, Part II, LNAI 6438, pp 221–232Google Scholar
  18. Shin CK, Park SC (1999) Memory and neural network based expert system. Expert Syst Appl 16(2):145–155CrossRefGoogle Scholar
  19. Shin CK, Yun UT, Kim HK, Park SC (2000) A hybrid approach of neural network and memory-based learning to data mining. IEEE Trans Neural Netw 11(3):637–646CrossRefGoogle Scholar
  20. Thrift P (1989) A neural network model for case-based reasoning. In: Proceedings of case-based reasoning workshop, Pensacola Beach. Morgan Kaufmann, San Mateo, pp 334–337Google Scholar
  21. Watson I, Marir F (1994) Case-based reasoning: a review. Knowl Eng Rev 9(4):327–354CrossRefGoogle Scholar
  22. Wettschereck D, Dietterich T (1995) An experimental comparison of the nearest-neighbor and nearest-hyper rectangle algorithms. Mach Learn 19(1):5–27Google Scholar
  23. Wettschereck D, Aha DW, Mohri T (1997) A review and empirical evaluation of feature weighting methods for a class of lazy learning algorithms. Artif Intell Rev 11(1–5):273–314CrossRefGoogle Scholar
  24. Yang B, Jin X (2010) Method on determining feature weight in case-based reasoning system. In: E-Product E-Service and E-Entertainment (ICEEE) international conference on 7–9 Nov 2010, pp 1–4Google Scholar
  25. Zeng X, Martinez TR (2004) Feature weighting using neural networks. In: IEEE international joint conference on neural networks, pp 1327–1330Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2016

Authors and Affiliations

  • Saroj Kr. Biswas
    • 1
  • Manomita Chakraborty
    • 1
  • Heisnam Rohen Singh
    • 1
  • Debashree Devi
    • 1
  • Biswajit Purkayastha
    • 1
  • Akhil Kr. Das
    • 2
  1. 1.Computer Science and Engineering DepartmentNIT SilcharSilcharIndia
  2. 2.Faculty of TechnologyUttar Banga Krishi ViswavidylayaCooch BeharIndia

Personalised recommendations