Evolving Neural Networks: Selected Medical Applications and the Effects of Variation Operators

  • David B. Fogel
Chapter

Abstract

Evolutionary algorithms can be used to train and design neural networks for medical applications. This paper reviews some recent efforts in breast cancer detection using evolutionary neural networks. The results obtained are discussed in relation to other methods for analyzing similar data. Additional basic research data are presented that investigate the use of alternative forms of variation on neural networks (e.g., mutation and recombination). Mention is given to the inspiration that Walter Karplus provided to the author in applying computational intelligence methods to practical problems in medicine and other disciplines.

Keywords

Neural Network Hide Node Crossover Operator Radial Basis Function Network Fitness Distribution 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    R. Lippmann. “An Introduction to Computing with Neural Nets”. IEEE ASSP Magazine, 4–22 April, 1987.Google Scholar
  2. [2]
    K. Hornik, M. Stinchcombe and H. White. “Multilayer Feedforward Networks are Universal Approximators”. Neural Networks, 2:359–366, 1989.CrossRefGoogle Scholar
  3. [3]
    T. Poggio and F. Girosi. “Networks for Approximation and Learning”. Proc. of the IEEE, 78:9, 1481–1497, 1990.CrossRefGoogle Scholar
  4. [4]
    D.B. Fogel. Evolutionary Computation: Toward a New Philosophy of Machine Intelligence. 2nd ed., IEEE Press, Piscataway, NJ, 1999.Google Scholar
  5. [5]
    D.B. Fogel and P.K. Simpson. “Experiments with Evolving Fuzzy Clusters”. Proc. of 2nd Ann. Conf. on Evolutionary Programming, D.B. Fogel and W. Atmar (eds.), Evolutionary Programming Society, La Jolla, CA, 90–97, 1993.Google Scholar
  6. [6]
    D. B. Fogel. System Identification through Simulated Evolution. Ginn Press, Needham, MA, 1991.Google Scholar
  7. [7]
    D.B. Fogel, L.J. Fogel and V.W. Porto. “Evolving Neural Networks”. Biological Cybernetics, 63:6, 487–493, 1990.CrossRefGoogle Scholar
  8. [8]
    V.W. Porto, D.B. Fogel and L.J. Fogel. “Experiments with Alternative Neural Network Training Methods: Back Propagation, Simulated Annealing and Evolutionary Programming”. IEEE Expert, 10(3): 16–22, 1995.CrossRefGoogle Scholar
  9. [9]
    D.B. Fogel. “An Information Criterion for Optimal Neural Network Selection”. IEEE Trans, on Neural Networks, 2:5, 490–497, 1991.CrossRefGoogle Scholar
  10. [10]
    http://breastcancer.about.com (see subpages as well).
  11. [11]
    C.C. Boring, T.S. Squires and T. Tong. “Cancer statistics”. CA: Cancer J. Clin. 43:7–26, 1993.CrossRefGoogle Scholar
  12. [12]
    P. Strax. Make Sure You Do Not Have Breast Cancer. St. Martin’s, NY, 1989.Google Scholar
  13. [13]
    Y.Z. Wu, M.L. Giger, K. Doi, C.J. Vyborny, R.A. Schmidt and C.E. Metz. “Artificial Neural Networks in Mammography: Application to Decision Making in the Diagnosis of Breast Cancer”. Radiology, 187:81–87, 1993.Google Scholar
  14. [14]
    L. Tabar and P.B. Dean. Teaching Atlas of Mammography. 2nd ed., Thieme-Stratton, NY, 1985.Google Scholar
  15. [15]
    C.E. Floyd, J.Y. Lo, A.J. Yun, D.C Sullivan and P.J. Kornguth. “Prediction of Breast Cancer Malignancy Using an Artificial Neural Network”. Cancer, 74:2944–2998, 1994.CrossRefGoogle Scholar
  16. [16]
    P. Wilding, M.A. Morgan, A.E. Grygotis, M.A. Shoffner and E.F. Rosato. “Application of Backpropagation Neural Networks to Diagnosis of Breast and Ovarian Cancer”. Cancer Lett., 77:145–153, 1994.CrossRefGoogle Scholar
  17. [17]
    D.B. Fogel, E.C. Wasson, E.M. Boughton and V.W. Porto. “A Step Toward Computer-assisted Mammography Using Evolutionary Programming and Neural Networks”. Cancer Lett., 119:93–97, 1997.CrossRefGoogle Scholar
  18. [18]
    J.A. Baker, P.J. Kornguth, J.Y. Lo, M.E. Williford and C.E. Floyd. “Breast Cancer: Prediction with Artificial Neural Networks Based on BI-RADS Standardized Lexicon”. Radiology, 196:817–822, 1995.Google Scholar
  19. [19]
    D.B. Fogel, E.C. Wasson, E.M. Boughton and V.W. Porto. “Evolving Artificial Neural Networks for Screening Features from Mammograms”. Artificial Intelligence in Medicine, 14:317–326, 1998.CrossRefGoogle Scholar
  20. [20]
    D.B. Fogel, E.C. Wasson and E.M. Boughton. “Evolving Neural Networks for Detecting Breast Cancer”. Cancer Lett., 96:49–53, 1995.CrossRefGoogle Scholar
  21. [21]
    O.L. Mangasarian and W.H. Wolberg. “Cancer diagnosis via linear programming. SIAM News, 23:1–18, 1990.Google Scholar
  22. [22]
    K.P. Bennett and O.L. Mangasarian. “Robust Linear Programming Discrimination of Two Linearly Inseparable Sets”. Optimization Methods Software, 1: 22–34, 1992.Google Scholar
  23. [23]
    W.H. Wolberg and O.L. Mangasarian. “Multisurface Method of Pattern Separation for Medical Diagnosis Applied To Breast Cytology”. PNAS, 87:9193–9196, 1990.CrossRefMATHGoogle Scholar
  24. [24]
    J. Zhang. “Selecting Typical Instances in Instance-based Learning”. Proc. 9th Int. Machine Learning Conf, D. Sleeman and P. Edwards, eds., Morgan Kaufmann, San Mateo, CA, 470–479, 1992.Google Scholar
  25. [25]
    J. Holland. Adaptation in Natural and Artificial Systems. Univ. Mich. Press, Ann Arbor, 1975.Google Scholar
  26. [26]
    D.B. Fogel and A. Ghozeil. “A Note on Representations and Variation Operators”. IEEE Trans. Evolutionary Computation, 1(2): 159–161, 1997.CrossRefGoogle Scholar
  27. [27]
    D.H. Wolpert and W.G. Macready. “No Free Lunch Theorems for Optimization”. IEEE Trans. Evolutionary Computation, 1(1): 67–82, 1997.CrossRefGoogle Scholar
  28. [28]
    G. Rudolph. “Reflections on Bandit Problems and Selection Methods in Uncertain Environments”. Proc. 7th Intern. Conf. on Genetic Algorithms, T. Baeck (ed.), Morgan Kaufmann, San Francisco, CA, 166–173, 1997.Google Scholar
  29. [29]
    W.G. Macready and D.H. Wolpert. “Bandit Problems and the Exploration/Exploitation Tradeoff”. IEEE Trans. Evolutionary Computation, 2:1, 2–22, 1998.CrossRefGoogle Scholar
  30. [30]
    L. Altenberg. “The Schema Theorem and Price’s Theorem”. Foundations of Genetic Algorithms 3, L.D. Whitley and M.D. Vose (eds.), Morgan Kaufmann, San Mateo, 23–49, 1995.Google Scholar
  31. [31]
    D.B. Fogel. “Phenotypes, Genotypes, and Operators”. Proc. 1995 IEEE International Conf. on Evolutionary Computation, Perth, Australia, IEEE, 193–198, 1995.CrossRefGoogle Scholar
  32. [32]
    K. Chellapilla and D.B. Fogel. “Fitness Distributions in Evolutionary Computation: Analysis of Noisy Functions”. Applications and Science of Computational Intelligence II, K.L. Priddy, P.E. Keller, D.B. Fogel, and J.C. Bezdek (chairs), SPIE, Bellingham, WA, 313–323, 1999.Google Scholar
  33. [33]
    K. Chellapilla and D.B. Fogel. “Fitness Distributions in Evolutionary Computation: Motivation and Examples in the Continuous Domain”. BioSystems, 54(1–2), 15–29, 1999.CrossRefGoogle Scholar
  34. [34]
    P. Nordin and W. Banzhaf. “Complexity Compression and Evolution”. Proc. 6th Intern. Conf. Genetic Algorithms, L. Eshelman (ed.), Morgan Kaufmann, San Mateo, CA, 310–317, 1995.Google Scholar
  35. [35]
    A. Jain and D.B. Fogel. “Case Studies in Applying Fitness Distributions in Evolutionary Algorithms. I. Simple Neural Networks and Gaussian Mutation”. Applications and Science of Computational Intelligence III, D.B. Fogel, K.L. Priddy, and P.E. SPIE, Bellingham, WA, 2000.Google Scholar
  36. [36]
    D.E. Rumelhart, G.E. Hinton and J.L. McClelland. “A General Framework for Parallel Distributed Processing”. Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D.E. Rumelhart and J.L. McClelland (eds.), MIT Press, Cambridge, MA, 1: 45–76, 1986.Google Scholar
  37. [37]
    P.J. Angeline, G.M. Saunders J.B. Pollack. “An Evolutionary Algorithm that Constructs Neural Networks”. IEEE Trans. Neural Networks, 5(1): 54–65, 1994.CrossRefGoogle Scholar
  38. [38]
    X. Yao. “Evolving Neural Networks”. Proc. IEEE, 87:9, 1423–1447, 1999.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2003

Authors and Affiliations

  • David B. Fogel
    • 1
  1. 1.Natural Selection, Inc.La JollaUSA

Personalised recommendations