Skip to main content
SpringerLink
Log in

A new cognitive filtering approach based on Freeman K3 Neural Networks

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Huge volume of data over several domains demands the development of new more efficient tools for search, analysis, and interpretation. Clustering approaches represent an important step in exploring the internal structure and relationships in datasets. In this study, the cognitively motivated neural network Freeman K 3-set was applied as a filter to preprocess the data, achieving a better clustering performance. We combine K 3 with a variety of clustering algorithms commonly used, and tested its performance using standard UCI datasets and also datasets from social networks. A comprehensive evaluation using a number of cluster validation measures shows significant improvement in the overall performance of the K 3-based clustering method for social data sets, for two types of clustering validation measures. Additionally, K 3 filtering results in transparent representation of data, which leads to improved efficiency of data processing algorithms used.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. Java K-sets v1.1.0. doi:10.5281/zenodo.13680 [59]

  2. A trapezoidal numerical integration was performed through MATLAB function trapz(Y).

  3. Em relation to f b 1 6 8 4 dataset the improvement is much better: 27 %.

References

  1. Dueck D (2009) Affinity propagation: clustering data by passing messages. Ph.D. dissertation, Graduate Department of Electrical & Computer Engineering, University of Toronto

  2. Xu R, Wunsch-II DC (2009) Clustering. IEEE Press, Wiley

    MATH  Google Scholar 

  3. MacQueen JB (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of 5-th Berkeley symposium on mathematical statistics and probability, vol 1. University of California Press, Berkeley, pp 281–297

  4. Xu R, Wunsch-II DC (2005) Survey of clustering algorithms. IEEE Trans Neural Netw 16(3):645–678

    Article  Google Scholar 

  5. Dunn JC (1973) A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters. J Cybern 3:32–57

    Article  MathSciNet  MATH  Google Scholar 

  6. Bezdek JC (1981) Pattern recognition with fuzzy objective function algoritms. Plenum, New York

    Book  MATH  Google Scholar 

  7. Kodogiannis VS, Amina M, Petrounias I (2013) A clustering-based fuzzy-wavelet neural network model for short-term load forecasting. Int J Neural Syst 23(5):1350024

    Article  Google Scholar 

  8. Kohonen T (1997) Self-organizing maps, 2nd edn. Springer, New York

    Book  MATH  Google Scholar 

  9. Pal N, Bezdek JC, Tsao EK (1993) Generalized clustering networks and kohonen’s self-organizing scheme. IEEE Trans Neural Netw 4(4):549–557

    Article  Google Scholar 

  10. Fraley C, Raftery AE (2002) Model-based clustering, discriminant analysis, and density estimation. J Am Stat Assoc 97:611– 631

    Article  MathSciNet  MATH  Google Scholar 

  11. Kozma R, Aghazarian H, Huntsherger T, Tunstel E, Freeman W (2007) Computational aspects of cognition and consciousness in intelligent devices. IEEE Comput Intell Mag 2(3):53–64

    Article  Google Scholar 

  12. Kiss T, Érdi P (2002) Mesoscopic neurodynamics. Biosystems 64(1–3):119–126

    Article  Google Scholar 

  13. Ilin R (2008) Learning and parameterization of recurrent neural network arrays for brain models and practical applications. Ph.D. dissertation, University of Memphis

  14. Freeman W (1991) The physiology of perception. Sci Am 264(2):78–85

    Article  MathSciNet  Google Scholar 

  15. Ilin R, Kozma R (2006) Stability of coupled excitatory-inhibitory neural populations and application to control of multi-stable systems. Phys Lett A 360(1):66–83

    Article  Google Scholar 

  16. Erwin H, Freeman W (2008) Freeman k-set. Scholarpedia, p 3238

  17. Freeman W (1975) Mass action in the nervous system. Academic, New York

    Google Scholar 

  18. Kozma R, Beliaev I (2004) Time series prediction using chaotic neural networks: case study of IJCNN CATS benchmark test. In: Proceedings of the 2004 IEEE international joint conference on neural networks, vol 2, pp 1609–1613

  19. Zhang J, Li G, Wang L, Freeman W (2005) Application of chaotic neural network on face recognition. In: International conference on neural networks and brain, 2005. ICNNB’05, pp 1367– 1372

  20. Zhang J, Wang Y, Li G, Freeman W (2006d) Application of bionic neural network on face recognition based on SVD and DCT. In: The sixth world congress on intelligent control and automation, 2006. WCICA 2006, pp 2733–2736

  21. Zhang J, Lou Z, Li G, Freeman W (2006c) Application of a novel neural network to face recognition based on DWT. In: BioRob 2006—the first IEEE/RAS-EMBS international conference on biomedical robotics and biomechatronics, 2006, pp 1042–1046

  22. Carlos LFM Jr, Rosa JLG (2014) Face recognition through a chaotic neural network model. In: Proceedings of the IEEE IJCNN 2014 international joint conference on neural networks, pp 859–863

  23. Harter D (2005) Evolving neurodynamic controllers for autonomous robots. In: Proceedings of the 2005 IEEE international joint conference on neural networks—IJCNN’05, pp 137–142

  24. Li G, Zhang J, Freeman W (2007) Mandarin digital speech recognition based on a chaotic neural network and fuzzy c-means clustering. In: 2007 IEEE international conference on fuzzy systems—FUZZ-IEEE, 2007, pp 1–5

  25. Zhang J, Li G, Freeman W (2006a) Application of novel chaotic neural networks to mandarin digital speech recognition. In: International joint conference neural networks, 2006. IJCNN’06, pp 653–658

  26. Xiaomin B, Xiaoqing N, Yaming W, Yanjiang Z (2010) Recognition of fabric structures based on improved olfactory neural network. In: 2010 international conference on artificial intelligence and computational intelligence (AICI), pp 325–328

  27. Yang X, Fu J, Lou Z, Wang L, Li G, Freeman W (2006) Tea classification based on artificial olfaction using bionic olfactory neural network. In: Wang J, Yi Z, Zurada J, Lu B-L, Yin H (eds) Advances in neural networks—ISNN 2006, Lecture notes in computer science, vol 3972. Springer, Berlin, pp 343–348

  28. Zhang J, Li G, Freeman W (2006b) Application of novel chaotic neural networks to text classification based on pca. In: Chang L-W, Lie W-N (eds) Advances in image and video technology—lecture notes in computer science, vol 4319. Springer, Berlin, pp 1041–1048

  29. Piazentin DRM, Rosa JLG (2014) Motor imagery classification for brain-computer interfaces through a chaotic neural network. In: Proceedings of the IEEE IJCNN 2014 international joint conference on neural networks, pp 4103–4108

  30. Kozma R, Rosa JLG, Piazentin DRM (2013) Cognitive clustering algorithm for efficient cybersecurity applications. In: Proceedings of the 2013 international joint conference on neural networks—IJCNN2013, pp 471–478

  31. Kozma R, Freeman W (2001) Chaotic resonance-methods and applications for robust classification of noisy and variable patterns. Int J Bifurc Chaos Appl Sci Eng 11(6):1607–1630

    Article  Google Scholar 

  32. Kozma R, Freeman W (2002) Classification of EEG patterns using nonlinear dynamics and identifying chaotic phase transitions. Neurocomputing 44–46:1107–1112

    Article  MATH  Google Scholar 

  33. Hu M, Li J, Li G, Tang X, Freeman W (2006b) Normal and hypoxia EEG recognition based on a chaotic olfactory model. In: Advances in neural networks—ISNN 2006, Lecture notes in computer science, vol 3973. Springer, Berlin, pp 554–559

  34. Hu M, Li J, Li G, Freeman W (2006a) Analysis of early hypoxia EEG based on a novel chaotic neural network. In: King I, Wang J, Chan L-W, Wang D (eds) Neural information processing, Lecture notes in computer science, vol 4232. Springer, Berlin, pp 11–18

  35. Zhang J, Liu X, Li R, Ma Z, Li G (2008) Improved KIII model and its application. In: 7th world congress on intelligent control and automation, 2008. WCICA 2008, pp 2218–2220

  36. Ilin R, Kozma R (2009) Sensor integration in KIV brain model for decision making. In: Proceedings of the international joint conference on neural networks, 2009. IJCNN 2009, pp 1328– 1334

  37. Principe JC, Tavares VG, Harris JG, Freeman W (2001) Design and implementation of a biologically realistic olfactory cortex in analog VLSI. Proc IEEE 89(7):1030–1051

  38. Leskovec J, Lang KJ, Mahoney MW (2010) Empirical comparison of algorithms for network community detection. In: Proceedings of World Wide Web conference (WWW 2010), pp 631–640

  39. Hartigan JA, Wong MA (1979) A k-means clustering algorithm. Appl Stat 28:100–108

    Article  MATH  Google Scholar 

  40. Kaufman L, Rousseeuw PJ (1990) Finding groups in data: an introduction to cluster analysis. Wiley, New York

    Book  Google Scholar 

  41. Brock G, Pihur V, Datta S, Datta S (2011) clValid: an R package for cluster validation. Department of Bioinformatics and Biostatistics. University of Louisville, ftp://ftp2.it.postgresql.org/pub/mirrors/CRAN/web/packages/clValid/vignettes/clValid.pdf, Tech. Rep.

  42. Ben-David S, Pal D, Simon U (2007) Stability of k-means clustering. In: Lecture notes in computer science, vol LNCS 4539, pp 20–34

  43. Menendez H, Barrero DF, Camacho D (2014) A genetic graph-based approach to the partitional clustering. Int J Neural Syst 24(3):1430008

    Article  Google Scholar 

  44. Datta S, Datta S (2006) Methods for evaluating clustering algorithms for gene expression data using a reference set of functional classes. BMC Bioinforma 7:397

    Article  Google Scholar 

  45. Gonçalves N, Nikkilä J, Vigário R (2014) Self-supervised mri tissue segmentation by discriminative clustering. Int J Neural Syst 24(1):1450004

    Article  Google Scholar 

  46. Yeung KY, Haynor DR, Ruzzo WL (2001) Validating clustering for gene expression data. Bioinformatics 17(4):309– 318

    Article  Google Scholar 

  47. Handl J, Knowles J, Kell DB (2005) Computational cluster validation in post-genomic data analysis. Bioinformatics 21(15):3201–3212

    Article  Google Scholar 

  48. Rousseeuw PJ (1987) Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. J Comput Appl Math 20:53–65

    Article  MATH  Google Scholar 

  49. Dunn JC (1974) Well separated clusters and fuzzy partitions. J Cybern 4:95–104

    Article  MathSciNet  MATH  Google Scholar 

  50. Rendon E, Abundez I, Arizmendi A, Quiroz EM (2011) Internal versus external cluster validation indexes. Int J Comput Commun 5(1):27–34

    Google Scholar 

  51. Shannon CE (1948) A mathematical theory of communication. Bell Syst Tech J 27:379–423, 623–656

    Article  MathSciNet  MATH  Google Scholar 

  52. Strehl A, Ghosh J (2002) Cluster ensembles—a knowledge reuse framework for combining multiple partitions. J Mach Learn Res 3:583–617

    MathSciNet  MATH  Google Scholar 

  53. Rand WM (1971) Objective criteria for the evaluation of clustering methods. J Am Stat Assoc 66(336):846– 850

    Article  Google Scholar 

  54. Datta S, Datta S (2003) Comparisons and validation of statistical clustering techniques for microarray gene expression data. Bioinformatics 19(4):459–466

    Article  Google Scholar 

  55. Wagner S, Wagner D (2007) Comparing clusterings—an overview. [Online]. Available: http://i11www.iti.uni-karlsruhe.de/extra/publications/ww-cco-06.pdf

  56. Leskovec J (2013) Stanford large network dataset collection. [Online]. Available: http://snap.stanford.edu/data/

  57. McAuley J, Leskovec J (2012) Learning to discover social circles in ego networks. Adv Neural Inf Process Syst 25:548–556

    Google Scholar 

  58. Basu S, Micchelli CA, Olsen P (2000) Maximum entropy and maximum likelihood criteria for feature selection from multivariate data. Circuits Syst 3:267–270

    Google Scholar 

  59. Piazentin DRM, Rosa JLG (2015) A simulator for freeman k-sets in java. In: Proceedings of the IJCNN 2015—international joint conference on neural networks

  60. U. M. L. Repository (2014) Image segmentation data set. [Online]. Available: http://archive.ics.uci.edu/ml/datasets/Image+Segmentation

  61. U. M. L. Repository (2014) Wisconsin diagnostic breast cancer data set. [Online]. Available: http://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Wisconsin+(Diagnostic)

  62. U. M. L. Repository (2014) Wine quality data set. [Online]. Available: http://archive.ics.uci.edu/ml/datasets/Wine+Quality

  63. U. M. L. Repository (2014) Multiple features data set. [Online]. Available: http://archive.ics.uci.edu/ml/datasets/Multiple+Features

  64. Peng H, Long F, Ding C (2005) Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238

    Article  Google Scholar 

Download references

Acknowledgments

We thank Dr. R. Kozma for his participation in previous versions of this paper and contributions to K-models. Also, discussions with Dr. D. Dasgupta and Dr. D. Ferebee on clustering in social networks are greatly appreciated. João Luís G. Rosa is grateful to the Brazilian Agency FAPESP (process 2012/09268-3) for the financial support. Denis R. M. Piazentin is grateful to Brazilian Agencies CAPES (process DS-7902068/M) and FAPESP (process 2012/15178-7). In addition, we would like to thank the anonymous reviewers for their valuable suggestions and comments.

Author information

Authors and Affiliations

  1. Department of Computer Science, University of São Paulo, Avenida Trabalhador São-carlense, 400 - Centro, CEP 13566-590, São Carlos, SP, Brazil

    João Luís Garcia Rosa & Denis R. M. Piazentin

Authors
  1. João Luís Garcia Rosa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Denis R. M. Piazentin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to João Luís Garcia Rosa.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Garcia Rosa, J.L., M. Piazentin, D.R. A new cognitive filtering approach based on Freeman K3 Neural Networks. Appl Intell 45, 363–382 (2016). https://doi.org/10.1007/s10489-016-0772-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-016-0772-4

Keywords

Search

Navigation