Skip to main content

An Ensemble K-Nearest Neighbor with Neuro-Fuzzy Method for Classification

  • Conference paper
Recent Advances in Information and Communication Technology

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 265))

Abstract

This paper introduces an ensemble k-nearest neighbor with neuro-fuzzy method for the classification. A new paradigm for classification is proposed. The structure of the system includes the use of neural network, fuzzy logic and k-nearest neighbor. The first part is the beginning stages of learning by using 1-hidden layer neural network. In stage 2, the error from the first stage is forwarded to Mandani fuzzy system. The final step is the defuzzification process to create new dataset for classification. This new data is called "transformed training set". The parameters of the learning process are applied to the test dataset to create a "transformed testing set". Class of the transformed testing set is determined by using k-nearest neighbor.  A variety of standard datasets from UCI were tested with our proposed. The fabulous classification results obtained from the experiments can confirm the good performance of ensemble k-nearest neighbor with neuro-fuzzy method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Han, J., Kamber, M., Pei, J.: Data mining: Concepts and Techniques, pp. 325–370. Morgan Kaufmann, San Francisco (2006)

    MATH  Google Scholar 

  2. Haykin, S.S.: Neural Networks and Learning Machines, 3rd edn. Prentice Hall, New York (2008)

    Google Scholar 

  3. Kriesel, D.: A Brief Introduction to Neural Networks, pp. 37–124 (2007) (retrieved August 15, 2011)

    Google Scholar 

  4. Eiamkanitchat, N., Theera-Umpon, N., Auephanwiriyakul, S.: A Novel Neuro-Fuzzy Method for Linguistic Feature Selection and Rule-Based Classification. In: The 2nd International Conference on Computer and Automation Engineering (ICCAE), pp. 247–252. IEEE Press (2010)

    Google Scholar 

  5. Eiamkanitchat, N., Theera-Umpon, N., Auephanwiriyakul, S.: Colon Tumor Microarray Classification Using Neural Network with Feature Selection and Rule-Based Classification. In: Zeng, Z., Wang, J. (eds.) Advances in Neural Network Research and Applications. LNEE, vol. 67, pp. 363–372. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  6. Jirayusakul, A.: Improve the SOM Classifier with the Fuzzy Integral Technique. In: The 9th International Conference on ICT and Knowledge, pp. 1–4. IEEE Press (2011)

    Google Scholar 

  7. Weihong, Z., Shunqing, X., Ting, M.: A Fuzzy Classifier based on Mamdani Fuzzy Logic System and Genetic Algorithm. In: IEEE Youth Conference on Information Computing and Telecommunications (YC-ICT), pp. 198–201. IEEE Press (2010)

    Google Scholar 

  8. Bova, S., Codara, P., Maccari, D., Marra, V.: A Logical Analysis of Mamdani-type Fuzzy Inference, I theoretical bases. In: 2010 International Conference on Fuzzy System, pp. 1–8. IEEE Press (2010)

    Google Scholar 

  9. Tamás, K., Kóczy, L.T.: Selection from a Fuzzy Signature Database by Mamdani-Algorithm. In: 6th International Symposium on Applied Machine Intelligence and Informatics, pp. 63–68. IEEE Press (2008)

    Google Scholar 

  10. Juan, L.: TKNN: An Improved KNN Algorithm Based on Tree Structure. In: The 7th International Conference on Computational Intelligence and Security (CIS), pp. 1390–1394. IEEE Press (2011)

    Google Scholar 

  11. Liu, H., Zhang, S., Zhao, J., Zhao, X., Mo, Y.: A New Classification Algorithm Using Mutual Nearest Neighbors. In: The 9th International Conference on Grid and Cooperative Computing (GCC), pp. 52–57. IEEE Press (2010)

    Google Scholar 

  12. Bache, K., Lichman, M.: UCI Machine Learning Repository. University of California, School of Information and Computer Science, Irvine (2013), http://archive.ics.uci.edu/ml

    Google Scholar 

  13. Salama, K.M., Freitas, A.A.: Clustering-based Bayesian Multi-net Classifier Construction with Ant Colony Optimization. In: The IEEE Congress on Evolutionary Computation, pp. 3079–3086. IEEE Press (2013)

    Google Scholar 

  14. Hong, K., Chalup, S.K., King, R.A.: An Experimental Evaluation of Pairwise Adaptive Support Vector Machines. In: The 2012 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE Press (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kaochiem Saetern .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Saetern, K., Eiamkanitchat, N. (2014). An Ensemble K-Nearest Neighbor with Neuro-Fuzzy Method for Classification. In: Boonkrong, S., Unger, H., Meesad, P. (eds) Recent Advances in Information and Communication Technology. Advances in Intelligent Systems and Computing, vol 265. Springer, Cham. https://doi.org/10.1007/978-3-319-06538-0_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-06538-0_5

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-06537-3

  • Online ISBN: 978-3-319-06538-0

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics