# Evolving personalized modeling system for integrated feature, neighborhood and parameter optimization utilizing gravitational search algorithm

- 192 Downloads
- 1 Citations

## Abstract

This paper introduces a new evolving personalized modeling method and system (evoPM) that integrates gravitational search inspired algorithm (GSA) for selecting informative features, optimizing neighbors and model parameters. For every individuals, evoPM creates a model that best predicts the outcome for this individual at the time of model creation. A comparative study is given for investigating the feasibility of the proposed system on several benchmark datasets using global, local and personalized modeling methods. The proposed evoPM system is capable of identifying a small group of the most informative features, optimizing the neighbors and model parameters relevant to the learning function (a classifier), which leads to improved classification performance. The experimental results show that evoPM not only outperforms several global and local modeling methods in terms of classification accuracy, but also finds the optimal or near-optimal solution to feature selection, and neighborhood, model parameters optimization in less number of iterations than many other evolutionary computational based optimizing algorithms.

## Keywords

Personalized modeling Feature selection Neighborhood optimization Parameter optimization Gravitational search algorithm (GSA)## References

- Alon U, Barkai N, Notterman DA, Gish K, Ybarra S, Mack D, Levine AJ (1999) Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arrays. Proc Natl Acad Sci USA 96:6745–6750CrossRefGoogle Scholar
- Chang CC, Lin CJ (2011) Libsvm: a library for support vector machines. ACM Trans Intell Syst Technol 2(3):27:1–27:27CrossRefGoogle Scholar
- Dudani SA (1976) The distance-weighted k-nearest-neighbor rule. IEEE Trans Syst Man Cybern 6:325–327 (1976)CrossRefGoogle Scholar
- Farmer JD, Packard NH, Perelson AS (1986) The immune system, adaptation and machine learning. Physica 2:187–204MathSciNetGoogle Scholar
- Fix E, Hodges JL (1951) Discriminatory analysis: nonparametric discrimination: consistency properties. UASF School of Aviation Medicine, Randolph FieldGoogle Scholar
- Formato R (2008) Central force optimization: a new nature inspired computational framework for multidimensional search and optimization. In: Krasnogor N, Nicosia G, Pavone M, Pelta D (eds) Nature inspired cooperative strategies for optimization (NICSO 2007). Studies in Computational Intelligence, vol 129. Springer, Berlin, pp 221–238Google Scholar
- Fung GM, Mangasarian OL (2004) A feature selection Newton method for support vector machine classification. Comput Optim Appl 28(2):185–202CrossRefMATHMathSciNetGoogle Scholar
- Fyfe C, Barbakh W, Ooi WC, Ko H (2008) Topological mappings of video and audio data. Int J Neural Syst 18(6):481–489CrossRefGoogle Scholar
- Gant V, Rodway S, Wyatt J (2001) Artificial neural networks: practical considerations for clinical applications. In: Dybowski R, Gant V (eds) Clinical applications of neural networks. Cambridge University Press, CambridgeGoogle Scholar
- Ghalambaz M, Noghrehabadi AR, Behrang MA, Assareh E, Ghanbarzadeh A, Hedayat N (2011) A hybrid neural network and gravitational search algorithm (HNNGSA) method to solve well known Wessinger’s equation. World Acad Sci Eng Technol 73:803–807Google Scholar
- Ginsburg GS, McCarthy JJ (2001) Personalized medicine: revolutionizing drug discovery and patient care. Trends Biotechnol 19(12):491–496CrossRefGoogle Scholar
- Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mersirov JP (1999) Molecular classification of cancer: class discovery and class prediction by gene expression monitoring. Science 286:531–537CrossRefGoogle Scholar
- Gordon GJ, Jensen R, Hsiao LL, Hsiaox S, JE B (2002) Translation of microarray data into clinically relevant cancer diagnostic tests using gene expression ratios in lung cancer and mesothelioma. Cancer Research 62:4963–4967Google Scholar
- Hu Y, Kasabov N (2009) Coevolutionary method for gene selection and parameter optimization in microarray data analysis. In: Leung C, Lee M, Chan J (eds) Neural information processing. Springer, Berlin, pp 483–492Google Scholar
- Hu Y, Song Q, Kasabov N (2009) Personalized modeling based gene selection for microarray data analysis. In: Kóppen M, Kasabov N, Coghill G (eds) Advances in neuro-information processing. Lecture Notes in Computer Science. Springer, Berlin, pp 1221–1228 Google Scholar
- Huang CL, Wang CJ (2006) A GA-based feature selection and parameter optimization for support vector machines. Elsevier 31:231–240Google Scholar
- Kasabov N (2002) Evolving connectionist systems. In: Methods and applications in bioinformatics, brain study and intelligent machines. Springer, LondonGoogle Scholar
- Kasabov N (2007) Evolving connectionist systems: the knowledge engineering approach. Springer, LondonGoogle Scholar
- Kasabov N (2007) Global, local and personalised modelling and pattern discovery in bioinformatics: an integrated approach. Pattern Recognit Lett 28:673–685CrossRefGoogle Scholar
- Kasabov N, Hu YJ (2010) Integrated optimisation method for personalised modelling and case studies for medical decision support. Int J Funct Inf Pers Med 3(3):236–256Google Scholar
- Kasabov N, Song Q (2002) DENFIS: dynamic evolving neural fuzzy inference system and its application for time series prediction.. IEEE Trans Fuzzy Syst 10(2):144–154CrossRefGoogle Scholar
- Kasabov N, Song Q, Benuskova L, Gottgtroy PCM, Jain V, Verma A, Havukkala I, Rush E, Pears R, Tjahjana A, Hu Y, MacDonell SG (2008) Integrating local and personalised modelling with global ontology knowledge bases for biomedical and bioinformatics decision support. In: Smolinski TG, Milanova MG, Hassanien AE (eds) Computational intelligence in biomedicine and bioinformatics. Springer, Berlin, pp 93–116Google Scholar
- Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, vol 4, Perth, pp 1942–1948Google Scholar
- Khajehzadeh M, Taha MR, El Shafie A, Eslami M (2011) Search for critical failure surface in slope stability analysis by gravitational search algorithm. Int J Phys Sci 6(21):5012–5021Google Scholar
- Lesko LJ (2007) Personalized medicine: elusive dream or imminent reality. Clin Pharmacol Ther 81:807–816CrossRefGoogle Scholar
- Li C, Zhou J (2011) Parameters identification of hydraulic turbine governing system using improved gravitational search algorithm.. Energy Convers Manage 52(1):374–381CrossRefGoogle Scholar
- Lin SW, Chen SC (2009) Psolda: a particle swarm optimization approach for enhancing classification accuracy rate of linear discriminant analysis. Appl Soft Comput 9:1008–1015CrossRefGoogle Scholar
- Omkar SN, Khandelwal R, Yathindra S, Naik GN, Gopalakrishnan S (2008) Artificial immune systems. A novel paradigm to pattern recognition. Engineering Applications of Aritificial IntelligenceGoogle Scholar
- Pang S, Havukala I, Hu Y, Kasabov N (2007) Classification consistency analysis for bootstrapping gene selection. Neural Comput Appl 16(6):527–539CrossRefGoogle Scholar
- Parrott D, Li X (2006) Locating and tracking multiple dynamic optima by a particle swarm model using speciation. IEEE Transactions on Evolutionary Computation, pp 440–458Google Scholar
- Personalized Medicine Coalition (2008) The case for personalized medicineGoogle Scholar
- Ramaswamy S, Perou C (2003) DNA microarrays in breast cancer: the promise of personalised medicine. Lancet 361(9369):1590–96CrossRefGoogle Scholar
- Rashedi E, Nezamabadi-pour H, Saryazdi S (2009) GSA: a gravitational search algorithm. Inf Sci 179:2232–2248CrossRefMATHGoogle Scholar
- Rashedi E, Nezamabadi-pour H, Saryazdi S (2010) BGSA: binary gravitational search algorithm. Nat Comput 9:727–745CrossRefMATHMathSciNetGoogle Scholar
- Sarafrazi S, Nezamabadi-pour H, Brahman M (2010) A GSA-svm hybrid system for classification of binary problems. In: 4th global conference on power control and optimization, MalaysiaGoogle Scholar
- Schneider NC, Graupe D (2008) A modified lamstar neural network and its applications. Int J Neural Syst 18(4):331–337CrossRefGoogle Scholar
- Shabo A (2007) Health record banks: integrating clinical and genomic data into patient-centric longitudinal and cross-institutional health records. Pers Med 4(4):453–455CrossRefGoogle Scholar
- Shipp MA, Ross KN, Tamayo P, Weng AP, Kutok JL, Aguiar RCT (2002) Diffuse large B-cell lymphoma outcome prediction by gene expression profiling and supervised machine learning. Nat Med 8(1):68–74CrossRefGoogle Scholar
- Song Q, Kasabov N (2006) TWNFI-a transductive neuro-fuzzy inference system with weighted data normalization for personliased modelling. Neural Netw 19:1591–1596CrossRefMATHGoogle Scholar
- Tang KS, Man KF, Kwong S, He Q (1996) Genetic algorithms and their applications. IEEE Signal Process Mag 13(6):22–37CrossRefGoogle Scholar
- Tsapatsoulis N, Rapantzikos K, Pattichis C (2007) An embedded saliency map estimator scheme: application to video encoding. Int J Neural Syst 17(4):289–304CrossRefGoogle Scholar
- Vapnik V (1998) Statistical learning theory. Wiley Interscience, New YorkGoogle Scholar
- Xiao J, Cheng Z (2011) DNA sequences optimization based on gravitational search algorithm for reliable DNA computing. In: Proceedings of the 2011 sixth international conference on bio-inspired computing: theories and applications. IEEE Computer Society, pp 103–107Google Scholar
- Xinchao Z (2010) A perturbed particle swarm algorithm for numerical optimization. Appl Soft Comput 10(1):119–124CrossRefGoogle Scholar
- Yau WC, Kumar DK, Arjunan SP (2007) Visual recognition of speech consonants using facial movement features. Integr Comput Aided Eng 14(1):49–61Google Scholar