WIRN 2002: Neural Nets pp 216-232 | Cite as

Bayesian Learning Techniques: Application to Neural Networks with Constraints on Weight Space

  • A. Eleuteri
  • R. Tagliaferri
  • L. Milano
  • F. Acernese
  • M. De Laurentiis
Conference paper
First Online:
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2486)

Abstract

In this paper the fundamentals of Bayesian learning techniques are shown, and their application to neural network modeling is illustrated. Furthermore, it is shown how constraints on weight space can easily be embedded in a Bayesian framework. Finally, the application of these techniques to a complex neural network model for survival analysis is used as a significant example.

Keywords

Bayesian learning frameworks Learning with constraints Survival analysis 
This is a preview of subscription content, log in to check access.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    W. L. Buntine, A. S. Weigend. Bayesian back-propagation. Complex Systems 5(6) (1991) 603–643MATHGoogle Scholar
  2. [2]
    R.M. Neal. Bayesian Learning for Neural Networks. Springer, New York (1996)MATHGoogle Scholar
  3. [3]
    D. J. C. MacKay. A practical Bayesian framework for backpropagation networks. Neural Computation 4(3) (1992) 448–472CrossRefGoogle Scholar
  4. [4]
    C. P. Robert. The Bayesian Choice, Second Edition. Springer, New York (2001)MATHGoogle Scholar
  5. [5]
    C. P. Robert, G. Casella. Markov Chain Monte Carlo Methods. Springer, New York (1999)Google Scholar
  6. [6]
    C. M. Bishop. Neural Networks for Pattern Recognition. Clarendon Press, Oxford (1996)MATHGoogle Scholar
  7. [7]
    A. Gelman, D.B. Rubin. Inference from iterative simulation using multiple sequences (with discussion). Statist. sci. 7 (1992) 457–511CrossRefGoogle Scholar
  8. [8]
    D.H. Wolpert, W. G. Macready. No free lunch theorems for search. Technical Report SFI-TR-95-02-010, The Santa Fe Institute (1995)Google Scholar
  9. [9]
    A. M. Walker. On the asymptotic behaviour of posterior distributions. Journal of the Royal Statistical Society B 49(3) (1969) 80–88Google Scholar
  10. [10]
    S. P. Meyn, R. L. Tweedie. Markov Chains and Stochastic Stability. Springer-Verlag, London (1993)MATHGoogle Scholar
  11. [11]
    S. Duane, A.D. Kennedy, B. J. Pendleton, D. Roweth. Hybrid Monte Carlo. Physics Letters B 195(2) (1987) 216–222CrossRefGoogle Scholar
  12. [12]
    F. E. Harrell jr. Survival and Risk Analysis-Technical Report. Duke University Medical Center (1993)Google Scholar
  13. [13]
    K. Liestøl, P. K. Andersen, U. Andersen. Survival analysis and neural nets. Statistics in medicine 13 (1994) 1189–1200CrossRefGoogle Scholar
  14. [14]
    D. Faraggi, R. Simon. A neural network model for survival data. Statistics in medicine 14 (1995) 73–82CrossRefGoogle Scholar
  15. [15]
    H. B. Burke et al. Artificial Neural Networks Improve the Accuracy of Cancer Survival Prediction. Cancer 79(4) (1997) 857–862CrossRefGoogle Scholar
  16. [16]
    B. D. Ripley, R. M. Ripley. Neural Networks as Statistical Methods in Survival Analysis. Artificial Neural Networks: Prospects for Medicine (R. Dybowsky and V. Gant eds.), Landes Biosciences Publishers (1998)Google Scholar
  17. [17]
    B. Bakker, T. Heskes. A neural-Bayesian approach to survival analysis. Proceedings IEE Artificial Neural Networks (1999) 832–837Google Scholar
  18. [18]
    G. Schwarzer, W. Vach, M. Schumacher. On the misuses of artificial neural networks for prognostic and diagnostic classification in oncology. Statistics in medicine 19 (2000) 541–561CrossRefGoogle Scholar
  19. [19]
    P. J. G. Lisboa, H. Wong. Are neural networks best used to help logistic regression? An example from breast cancer survival analysis. IEEE Transactions on Neural Networks (2001) 2472–2477Google Scholar
  20. [20]
    H. Wong, P. Harris, P. J. G. Lisboa, S. P. J. Kirby, R. Swindell. Dealing with Censorship in Neural Network Models. IEEE Transactions on Neural Networks (1999) 3702–3706Google Scholar
  21. [21]
    R. M. Neal. Survival Analysis Using a Bayesian Neural Network. Joint Statistical Meetings report, Atlanta (2001)Google Scholar
  22. [22]
    E. Biganzoli, P. Boracchi, E. Marubini. A general framework for neural network models on censored survival data. Neural Networks 15 (2002) 209–218CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • A. Eleuteri
    • 1
  • R. Tagliaferri
    • 2
    • 3
  • L. Milano
    • 4
  • F. Acernese
    • 4
  • M. De Laurentiis
    • 5
  1. 1.Dipartimento di Matematica ed Applicazioni “R. Caccioppoli”Universita di Napoli “Federico II” Napoli, and INFN sez. NapoliNapoliItalia
  2. 2.DMIUniversitá di SalernoBaronissi, SaItalia
  3. 3.INFM unitá di SalernoItalia
  4. 4.Dipartimento di Scienze FisicheUniversitá di Napoli “Federico II” and INFN sez.NapoliNapoliItalia
  5. 5.Dipartimento di Endocrinologia ed Oncologia Molecolare e ClinicaUniversitá di Napoli “Federico II”NapoliItalia

Personalised recommendations