Evolving Systems

, Volume 6, Issue 1, pp 1–14 | Cite as

Evolving personalized modeling system for integrated feature, neighborhood and parameter optimization utilizing gravitational search algorithm

Original Paper

Abstract

This paper introduces a new evolving personalized modeling method and system (evoPM) that integrates gravitational search inspired algorithm (GSA) for selecting informative features, optimizing neighbors and model parameters. For every individuals, evoPM creates a model that best predicts the outcome for this individual at the time of model creation. A comparative study is given for investigating the feasibility of the proposed system on several benchmark datasets using global, local and personalized modeling methods. The proposed evoPM system is capable of identifying a small group of the most informative features, optimizing the neighbors and model parameters relevant to the learning function (a classifier), which leads to improved classification performance. The experimental results show that evoPM not only outperforms several global and local modeling methods in terms of classification accuracy, but also finds the optimal or near-optimal solution to feature selection, and neighborhood, model parameters optimization in less number of iterations than many other evolutionary computational based optimizing algorithms.

Keywords

Personalized modeling Feature selection Neighborhood optimization Parameter optimization Gravitational search algorithm (GSA) 

References

  1. Alon U, Barkai N, Notterman DA, Gish K, Ybarra S, Mack D, Levine AJ (1999) Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc Natl Acad Sci USA 96:6745–6750CrossRefGoogle Scholar
  2. Chang CC, Lin CJ (2011) Libsvm: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27:1–27:27CrossRefGoogle Scholar
  3. Dudani SA (1976) The distance-weighted k-nearest-neighbor rule. IEEE Trans Syst Man Cybern 6:325–327 (1976)CrossRefGoogle Scholar
  4. Farmer JD, Packard NH, Perelson AS (1986) The immune system, adaptation and machine learning. Physica 2:187–204MathSciNetGoogle Scholar
  5. Fix E, Hodges JL (1951) Discriminatory analysis: nonparametric discrimination: consistency properties. UASF School of Aviation Medicine, Randolph FieldGoogle Scholar
  6. Formato R (2008) Central force optimization: a new nature inspired computational framework for multidimensional search and optimization. In: Krasnogor N, Nicosia G, Pavone M, Pelta D (eds) Nature inspired cooperative strategies for optimization (NICSO 2007). Studies in Computational Intelligence, vol 129. Springer, Berlin, pp 221–238Google Scholar
  7. Fung GM, Mangasarian OL (2004) A feature selection Newton method for support vector machine classification. Comput Optim Appl 28(2):185–202CrossRefMATHMathSciNetGoogle Scholar
  8. Fyfe C, Barbakh W, Ooi WC, Ko H (2008) Topological mappings of video and audio data. Int J Neural Syst 18(6):481–489CrossRefGoogle Scholar
  9. Gant V, Rodway S, Wyatt J (2001) Artificial neural networks: practical considerations for clinical applications. In: Dybowski R, Gant V (eds) Clinical applications of neural networks. Cambridge University Press, CambridgeGoogle Scholar
  10. Ghalambaz M, Noghrehabadi AR, Behrang MA, Assareh E, Ghanbarzadeh A, Hedayat N (2011) A hybrid neural network and gravitational search algorithm (HNNGSA) method to solve well known Wessinger’s equation. World Acad Sci Eng Technol 73:803–807Google Scholar
  11. Ginsburg GS, McCarthy JJ (2001) Personalized medicine: revolutionizing drug discovery and patient care. Trends Biotechnol 19(12):491–496CrossRefGoogle Scholar
  12. Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mersirov JP (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286:531–537CrossRefGoogle Scholar
  13. Gordon GJ, Jensen R, Hsiao LL, Hsiaox S, JE B (2002) Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma. Cancer Research 62:4963–4967Google Scholar
  14. Hu Y, Kasabov N (2009) Coevolutionary method for gene selection and parameter optimization in microarray data analysis. In: Leung C, Lee M, Chan J (eds) Neural information processing. Springer, Berlin, pp 483–492Google Scholar
  15. Hu Y, Song Q, Kasabov N (2009) Personalized modeling based gene selection for microarray data analysis. In: Kóppen M, Kasabov N, Coghill G (eds) Advances in neuro-information processing. Lecture Notes in Computer Science. Springer, Berlin, pp 1221–1228 Google Scholar
  16. Huang CL, Wang CJ (2006) A GA-based feature selection and parameter optimization for support vector machines. Elsevier 31:231–240Google Scholar
  17. Kasabov N (2002) Evolving connectionist systems. In: Methods and applications in bioinformatics, brain study and intelligent machines. Springer, LondonGoogle Scholar
  18. Kasabov N (2007) Evolving connectionist systems: the knowledge engineering approach. Springer, LondonGoogle Scholar
  19. Kasabov N (2007) Global, local and personalised modelling and pattern discovery in bioinformatics: an integrated approach. Pattern Recognit Lett 28:673–685CrossRefGoogle Scholar
  20. Kasabov N, Hu YJ (2010) Integrated optimisation method for personalised modelling and case studies for medical decision support. Int J Funct Inf Pers Med 3(3):236–256Google Scholar
  21. Kasabov N, Song Q (2002) DENFIS: dynamic evolving neural fuzzy inference system and its application for time series prediction.. IEEE Trans Fuzzy Syst 10(2):144–154CrossRefGoogle Scholar
  22. Kasabov N, Song Q, Benuskova L, Gottgtroy PCM, Jain V, Verma A, Havukkala I, Rush E, Pears R, Tjahjana A, Hu Y, MacDonell SG (2008) Integrating local and personalised modelling with global ontology knowledge bases for biomedical and bioinformatics decision support. In: Smolinski TG, Milanova MG, Hassanien AE (eds) Computational intelligence in biomedicine and bioinformatics. Springer, Berlin, pp 93–116Google Scholar
  23. Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, vol 4, Perth, pp 1942–1948Google Scholar
  24. Khajehzadeh M, Taha MR, El Shafie A, Eslami M (2011) Search for critical failure surface in slope stability analysis by gravitational search algorithm. Int J Phys Sci 6(21):5012–5021Google Scholar
  25. Lesko LJ (2007) Personalized medicine: elusive dream or imminent reality. Clin Pharmacol Ther 81:807–816CrossRefGoogle Scholar
  26. Li C, Zhou J (2011) Parameters identification of hydraulic turbine governing system using improved gravitational search algorithm.. Energy Convers Manage 52(1):374–381CrossRefGoogle Scholar
  27. Lin SW, Chen SC (2009) Psolda: a particle swarm optimization approach for enhancing classification accuracy rate of linear discriminant analysis. Appl Soft Comput 9:1008–1015CrossRefGoogle Scholar
  28. Omkar SN, Khandelwal R, Yathindra S, Naik GN, Gopalakrishnan S (2008) Artificial immune systems. A novel paradigm to pattern recognition. Engineering Applications of Aritificial IntelligenceGoogle Scholar
  29. Pang S, Havukala I, Hu Y, Kasabov N (2007) Classification consistency analysis for bootstrapping gene selection. Neural Comput Appl 16(6):527–539CrossRefGoogle Scholar
  30. Parrott D, Li X (2006) Locating and tracking multiple dynamic optima by a particle swarm model using speciation. IEEE Transactions on Evolutionary Computation, pp 440–458Google Scholar
  31. Personalized Medicine Coalition (2008) The case for personalized medicineGoogle Scholar
  32. Ramaswamy S, Perou C (2003) DNA microarrays in breast cancer: the promise of personalised medicine. Lancet 361(9369):1590–96CrossRefGoogle Scholar
  33. Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179:2232–2248CrossRefMATHGoogle Scholar
  34. Rashedi E, Nezamabadi-pour H, Saryazdi S (2010) BGSA: binary gravitational search algorithm. Nat Comput 9:727–745CrossRefMATHMathSciNetGoogle Scholar
  35. Sarafrazi S, Nezamabadi-pour H, Brahman M (2010) A GSA-svm hybrid system for classification of binary problems. In: 4th global conference on power control and optimization, MalaysiaGoogle Scholar
  36. Schneider NC, Graupe D (2008) A modified lamstar neural network and its applications. Int J Neural Syst 18(4):331–337CrossRefGoogle Scholar
  37. Shabo A (2007) Health record banks: integrating clinical and genomic data into patient-centric longitudinal and cross-institutional health records. Pers Med 4(4):453–455CrossRefGoogle Scholar
  38. Shipp MA, Ross KN, Tamayo P, Weng AP, Kutok JL, Aguiar RCT (2002) Diffuse large B-cell lymphoma outcome prediction by gene expression profiling and supervised machine learning. Nat Med 8(1):68–74CrossRefGoogle Scholar
  39. Song Q, Kasabov N (2006) TWNFI-a transductive neuro-fuzzy inference system with weighted data normalization for personliased modelling. Neural Netw 19:1591–1596CrossRefMATHGoogle Scholar
  40. Tang KS, Man KF, Kwong S, He Q (1996) Genetic algorithms and their applications. IEEE Signal Process Mag 13(6):22–37CrossRefGoogle Scholar
  41. Tsapatsoulis N, Rapantzikos K, Pattichis C (2007) An embedded saliency map estimator scheme: application to video encoding. Int J Neural Syst 17(4):289–304CrossRefGoogle Scholar
  42. Vapnik V (1998) Statistical learning theory. Wiley Interscience, New YorkGoogle Scholar
  43. Xiao J, Cheng Z (2011) DNA sequences optimization based on gravitational search algorithm for reliable DNA computing. In: Proceedings of the 2011 sixth international conference on bio-inspired computing: theories and applications. IEEE Computer Society, pp 103–107Google Scholar
  44. Xinchao Z (2010) A perturbed particle swarm algorithm for numerical optimization. Appl Soft Comput 10(1):119–124CrossRefGoogle Scholar
  45. Yau WC, Kumar DK, Arjunan SP (2007) Visual recognition of speech consonants using facial movement features. Integr Comput Aided Eng 14(1):49–61Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  1. 1.Knowledge Engineering and Discovery Research Institute Auckland University of TechnologyAucklandNew Zealand

Personalised recommendations