Neural Computing and Applications

, Volume 16, Issue 3, pp 307–316 | Cite as

Ensemble of hybrid neural network learning approaches for designing pharmaceutical drugs

Original Article


Designing drugs is a current problem in the pharmaceutical research. By designing a drug we mean to choose some variables of drug formulation (inputs), for obtaining optimal characteristics of drug (outputs). To solve such a problem we propose an ensemble of three learning algorithms namely an evolutionary artificial neural network, Takagi-Sugeno neuro-fuzzy system and an artificial neural network. The ensemble combination is optimized by a particle swarm optimization algorithm. The experimental data were obtained from the Laboratory of Pharmaceutical Techniques of the Faculty of Pharmacy in Cluj-Napoca, Romania. Bootstrap techniques were used to generate more samples of data since the number of experimental data was low due to the costs and time durations of experimentations. Experiment results indicate that the proposed methods are efficient.


Hybrid learning Ensemble learning Evolutionary neural network Neuro-fuzzy Drug design 



Authors would also like to thank the colleagues of the Department of Maxillofacial Surgery, University of Medicine and Pharmacy, Iuliu Hatieganu Cluj-Napoca, for the initial contributions of this research


  1. 1.
    Parrill AL (1996) Evolutionary and genetic methods in drug design. Drug Discov Today 1(12):514–521CrossRefGoogle Scholar
  2. 2.
    Zoubir AM, Iskander DR (1998) Bootstrap MATLAB Toolbox. Software reference manualGoogle Scholar
  3. 3.
    Abraham A (2004) Meta-learning evolutionary artificial neural networks. Neurocomp J 56c:1–38CrossRefGoogle Scholar
  4. 4.
    Abraham A (2001) Neuro-fuzzy systems: state-of-the-art modeling techniques, connectionist models of neurons, learning processes, and artificial intelligence. In: Mira J, Prieto A (eds.) Lecture notes in computer science. Springer, Berlin, LNCS 2084, pp 269–276Google Scholar
  5. 5.
    Barat A, Ruskin HJ, Crane M (2006) Probabilistic models for drug dissolution. Part 1. Review of Monte Carlo and stochastic cellular automata approaches. Simul Model Pract Theory 14(7):843–856CrossRefGoogle Scholar
  6. 6.
    Laghaee A, Malcolm C, Hallam J, Ghazal P (2005) Artificial intelligence and robotics in high throughput post-genomics. Drug Discov Today 10(18):1253–1259CrossRefGoogle Scholar
  7. 7.
    Carlsson C, Fullér R (1998) Multiobjective optimization with linguistic variables. In: Proceedings of the sixth European congress on intelligent techniques and soft computing, Aachen, September 7–10, 1998, Verlag MainzGoogle Scholar
  8. 8.
    Winkler DA, Burden FR (2004) Bayesian neural nets for modeling in drug discovery. Drug Discov Today: BIOSILICO 2(3):104–111CrossRefGoogle Scholar
  9. 9.
    Aradi I, Erdi P (2006) Computational neuropharmacology: dynamical approaches in drug discovery. Trends Pharmacol Sci 27(5):240–243CrossRefGoogle Scholar
  10. 10.
    Carpenter J, Goldstein H, Rasbash J (1999) A non-parametric bootstrap for multilevel models. Multilevel Model Newsl 11:2–5Google Scholar
  11. 11.
    Jang SR, Sun CT, Mizutani E (1997) Neuro-fuzzy and soft computing: a computational approach to learning and machine intelligence. Prentice Hall, Englewood CliffsGoogle Scholar
  12. 12.
    DiMasi JA, Hansen RW, Grabowski HG (2003) The price of innovation: new estimates of drug development costs. J Health Econ 22:151–185CrossRefGoogle Scholar
  13. 13.
    Takayama K, Fujikawa M, Obata Y, Morishita M (2003) Neural network based optimization of drug formulations. Adv Drug Deliv Rev 55(9):1217–1231CrossRefGoogle Scholar
  14. 14.
    Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, Vol. IV, pp 1942–1948. IEEE service center, Piscataway, NJGoogle Scholar
  15. 15.
    Stewart KD, Shiroda M, James CA (2006) Drug Guru: a computer software program for drug design using medicinal chemistry rules. Bioorg Med Chem 14(20):7011–7022CrossRefGoogle Scholar
  16. 16.
    Hu L, Chen GH, Chau RMW (2006) A neural networks-based drug discovery approach and its application for designing aldose reductase inhibitors. J Mol Graph Model 24(4):244–253CrossRefGoogle Scholar
  17. 17.
    Teroth L, Gasteiger J (2001) Neural networks and genetic algorithms in drug design. Drug Discov Today 6(2):102–108CrossRefGoogle Scholar
  18. 18.
    Moller AF (1993) A scaled conjugate gradient algorithm for fast supervised learning. Neural Netw 6:525–533CrossRefGoogle Scholar
  19. 19.
    Meek PJ, Liu Z, Tian L, Wang CY, Welsh WJ, Zauhar RJ (2006) Shape signatures: speeding up computer aided drug discovery. Drug Discov Today 11(19–20):895–904CrossRefGoogle Scholar
  20. 20.
    Esseiva P, Anglada F, Dujourdy L, Taroni F, Margot P, Pasquier ED, Dawson M, Roux C, Doble P (2005) Chemical profiling and classification of illicit heroin by principal component analysis, calculation of inter sample correlation and artificial neural networks. Talanta 67(2):360–367CrossRefGoogle Scholar
  21. 21.
    Burbidge R, Trotter M, Buxton B, Holden S (2001) Drug design by machine learning: support vector machines for pharmaceutical data analysis. Comput Chem 26(1):5–14CrossRefGoogle Scholar
  22. 22.
    Câmpean R, Prodan A (2003) Biomatematică – aplicaţii în Excel, Editura Medicală Universitară “Iuliu Haţieganu”, Cluj-Napoca, ISBN: 973-693-016-5Google Scholar
  23. 23.
    Câmpean R, Prodan A (2003) A rating model applied for designing drugs. In: Proceedings of the 12-th IASTED international conference on applied simulation and modelling, Marbella, Spain, pp 557–561, ACTA press, ISBN: 0-88986-384-9, ISSN: 1021–8181Google Scholar
  24. 24.
    Agatonovic-Kustrin S, Beresford R (2000) Basic concepts of artificial neural network (ANN) modeling and its application in pharmaceutical research. J Pharm Biomed Anal 22(5):717–727CrossRefGoogle Scholar
  25. 25.
    Hesterberg T, Monaghan S, Moore DS, Clipson A, Epstein R (2003) Bootstrap methods and permutation tests. W. H. Freeman and Company, New YorkGoogle Scholar
  26. 25.
    Solmajer T, Zupan J (2004) Optimization algorithms and natural computing in drug discovery. Drug Discov Today: Technol 1(3):247–252CrossRefGoogle Scholar
  27. 27.
    Kiss T, Érdi P (2006) From electric patterns to drugs: perspectives of computational neuroscience in drug design. Biosystems 86(1–3):46–52CrossRefGoogle Scholar
  28. 28.
    Sun Y, Peng Y, Chen Y, Shukla AJ (2003) Application of artificial neural networks in the design of controlled release drug delivery systems. Adv Drug Deliv Rev 55(9):1201–1215CrossRefGoogle Scholar
  29. 29.
    Tang Y, Zhu W, Chen K, Jiang H (2006) New technologies in computer-aided drug design: toward target identification and new chemical entity discovery. Drug Discov Today: Technol 3(3):307–313Google Scholar
  30. 30.
    Grosan C, Abraham A, Tigan S (2006) Engineering drug design using a multi-input multi-output neuro-fuzzy system, 8th International symposium on symbolic and numeric algorithms for scientific computing (SYNASC'06), Timisoara, Romania, IEEE CS Press, pp 365–371Google Scholar
  31. 31.
    Grosan C, Abraham A, Tigan S, Chang T-G, Kim DH (2006) Evolving neural networks for pharmaceutical research, International conference on hybrid information technology (ICHIT'06), IEEE Press, Korea, pp 13–19Google Scholar

Copyright information

© Springer-Verlag London Limited 2007

Authors and Affiliations

  1. 1.Faculty of Information Technology, Mathematics and Electrical EngineeringNorwegian University of Science and TechnologyTrondheimNorway
  2. 2.Department of Computer ScienceBabes-Bolyai UniversityCluj-NapocaRomania
  3. 3.Faculty of Medicine, Department of Biostatistics and Medical InformaticsUniversity Iuliu HaţieganuCluj-NapocaRomania

Personalised recommendations