Skip to main content
SpringerLink
Log in

A novel technique: ensemble hybrid 1NN model using stacking approach

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

This paper proposes a novel hybrid classification model which has enhanced the performance of the standard kNN (k = 1) classification model significantly. In this study by the means of ensemble stacking approach kNN classification model and rotation forest classification model are hybridized as base classifiers and simple logistic classifier as the meta classification model. The performance of this proposed hybrid model was assessed using Accuracy and FMeasure. The model was compared with standard kNN and nine other classification models. The results showed that the proposed hybrid model has notably high performance than the other models.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Han J, Kamber M, Pei J (2012) Data mining: concepts and techniques. Morgan Kaufmann, Waltham

    MATH  Google Scholar 

  2. Yu Z, Chen H, Liu J, You J, Leung H, Han G (2015) Hybrid k-nearest neighbor classifier. IEEE Trans Cybern 46(6):1263–1275

    Article  Google Scholar 

  3. Vinoth R, Jayachandran A, Balaji M, Srinivasan R (2014) A hybrid text classification approach using KNN and SVM. Int J Adv Found Res Comput (IJAFRC) 1(3):20–26

    Google Scholar 

  4. Gill NS, Mittal P (2016) Computational hybrid model, with two level classification using SVM and neural network for predicting diabetes disease. J Theor Appl Info Technol 87(1):1–10

    Google Scholar 

  5. Aci M, İnan C, Avci M (2010) A hybrid classification method of k nearest neighbor, Bayesian methods and genetic algorithm. Expert Syst Appl 37(7):5061–5067

    Article  Google Scholar 

  6. Miloud-Aouidate A, Baba-Ali AR (2012) A hybrid KNN-ant colony optimization algorithm for prototype selection. Laboratory of Robotics, Parallelism and Embedded University of Sciences and Technology Houari Boumediene, USTHB, T. Huang et al. (Eds.): ICONIP 2012, © Springer-Verlag Berlin Heidelberg

  7. Sahu SK, Kumar P, Singh AP (2018) Modified K-NN algorithm for classification problems with improved accuracy. Int J Inf Technol 10(1):65–70

    Google Scholar 

  8. Zhang S, Li X, Zong M, Zhu X, Cheng D (2017) Learning k for kNN classification. ACM Trans Intell Syst Technol 8(3):43

    Google Scholar 

  9. Rodriguez JJ, Kuncheva LI, Alonso CJ (2006) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28(10):19–30

    Article  Google Scholar 

  10. Sumner M, Frank E, Hall M (2005) Speeding up logistic model tree induction. In: 9th European conference on principles and practice of knowledge discovery in databases

  11. Wolpert DH (1992) Stacked generalization. Neural networks. IEEE Trans Pattern Anal Mach Intell 28(10):241–259

    Google Scholar 

  12. Hsu KW (2017) A theoretical analysis of why hybrid ensembles work. Hindawi Comput Intell Neurosci. https://doi.org/10.1155/2017/1930702

    Article  Google Scholar 

  13. Salunkhe UR, Mali SN (2016) classifier ensemble design for imbalanced data classification: a hybrid approach. In: International conference on computational modelling and security (CMS)

  14. Huang MW, Chen CW, Lin WC, Ke SW, Tsai CF (2017) SVM and SVM ensembles in breast cancer. PLOS ONE 12(1):e0161501

    Article  Google Scholar 

  15. Huda S, Yerarwood J, Jelinek HF, Hasssan MM, Fortin G, Buckland M (2016) A hybrid feature selection with ensemble classification for imbalanced access. IEEE Access 4:9145–9154

    Article  Google Scholar 

  16. Chen Y, Zhao X, Lin Z (2014) Optimizing subspace SVM ensemble for hyperspectral imagery classification. IEEE J Sel Topics Appl Earth Observations Remote Sens 7(4):1295–1305

    Article  Google Scholar 

  17. Campos R, Canuto S, Salles T, de Sá CC, Gonçalves MA (2017) Stacking bagged and boosted forests for effective automated classification. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval

  18. El Bialy R, Salama MA, Karam O (2016) An ensemble model for heart disease data sets: a generalized model. In: Proceedings of the 10th International Conference on Informatics and Systems, INFOS, May 09–11. ACM

  19. Tang J, Alelyani S, Liu H (2015) Data classification: algorithms and applications, data mining and knowledge discovery series. CRC Press, Boca Raton

    Google Scholar 

  20. Agaoglu M (2016) Predicting instructor performance using data mining techniques in higher education. IEEE Access 4:2379–2387

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Manav Rachana University, Delhi Suraj Kund Road, Sector 43, Faridabad, Haryana, 121004, India

    Preeti Nair & Indu Kashyap

  2. Maharshi Dayanand University, Delhi Road, University Secretariat, Rohtak, Haryana, 124001, India

    Navneet Khatri

  3. T 2/1, DLF Phase 3, Gurgaon, Haryana, 122002, India

    Preeti Nair

Authors
  1. Preeti Nair
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Navneet Khatri
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Indu Kashyap
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Preeti Nair.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nair, P., Khatri, N. & Kashyap, I. A novel technique: ensemble hybrid 1NN model using stacking approach. Int. j. inf. tecnol. 12, 683–689 (2020). https://doi.org/10.1007/s41870-018-0109-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-018-0109-0

Keywords

Search

Navigation