Introducing ROC Curves as Error Measure Functions: A New Approach to Train ANN-Based Biomedical Data Classifiers

  • Raúl Ramos-Pollán
  • Miguel Ángel Guevara-López
  • Eugénio Oliveira
Conference paper

DOI: 10.1007/978-3-642-16687-7_68

Part of the Lecture Notes in Computer Science book series (LNCS, volume 6419)
Cite this paper as:
Ramos-Pollán R., Guevara-López M.Á., Oliveira E. (2010) Introducing ROC Curves as Error Measure Functions: A New Approach to Train ANN-Based Biomedical Data Classifiers. In: Bloch I., Cesar R.M. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2010. Lecture Notes in Computer Science, vol 6419. Springer, Berlin, Heidelberg

Abstract

This paper explores the usage of the area (Az) under the Receiver Operating Characteristic (ROC) curve as error measure to guide the training process to build machine learning ANN-based classifiers for biomedical data analysis. Error measures (like root mean square error, RMS) are used to guide training algorithms measuring how far solutions are from the ideal classification, whereas it is well known that optimal classification rates do not necessarily yield to optimal Az’s. Our hypothesis is that Az error measures can guide existing training algorithms to obtain better Az’s than other error measures. This was tested after training 280 different configurations of ANN-based classifiers, with simulated annealing, using five biomedical binary datasets from the UCI machine learning repository with different test/train data splits. Each ANN configuration was trained both using the Az and RMS based error measures. In average Az was improved in 7.98% in testing data (9.32% for training data) when using 70% of the datasets elements for training. Further analysis reveals interesting patterns (Az improvement is greater when Az are lower). These results encourage us to further explore the usage of Az based error measures in training methods for classifiers in a more generalized manner.

Keywords

ROC Curves Artificial Neural Networks Machine learning Classifiers Biomedical Data 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Raúl Ramos-Pollán
    • 1
  • Miguel Ángel Guevara-López
    • 2
  • Eugénio Oliveira
    • 3
  1. 1.CETA-CIEMAT Centro Extremeño de Tecnologías AvanzadasTrujilloSpain
  2. 2.INEGI Instituto de Engenharia, Mecanica e Gestão IndustrialUniversidade do PortoPortoPortugal
  3. 3.LIACC-DEI-Faculdade de EngenhariaUniversidade do PortoPortoPortugal

Personalised recommendations