Automating Biomedical Data Science Through Tree-Based Pipeline Optimization

  • Randal S. Olson
  • Ryan J. Urbanowicz
  • Peter C. Andrews
  • Nicole A. Lavender
  • La Creis Kidd
  • Jason H. Moore
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9597)

Abstract

Over the past decade, data science and machine learning has grown from a mysterious art form to a staple tool across a variety of fields in academia, business, and government. In this paper, we introduce the concept of tree-based pipeline optimization for automating one of the most tedious parts of machine learning—pipeline design. We implement a Tree-based Pipeline Optimization Tool (TPOT) and demonstrate its effectiveness on a series of simulated and real-world genetic data sets. In particular, we show that TPOT can build machine learning pipelines that achieve competitive classification accuracy and discover novel pipeline operators—such as synthetic feature constructors—that significantly improve classification accuracy on these data sets. We also highlight the current challenges to pipeline optimization, such as the tendency to produce pipelines that overfit the data, and suggest future research paths to overcome these challenges. As such, this work represents an early step toward fully automating machine learning pipeline design.

Keywords

Pipeline optimization Hyperparameter optimization Data science Machine learning Genetic programming 

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Randal S. Olson
    • 1
  • Ryan J. Urbanowicz
    • 1
  • Peter C. Andrews
    • 1
  • Nicole A. Lavender
    • 2
  • La Creis Kidd
    • 2
  • Jason H. Moore
    • 1
  1. 1.Institute for Biomedical InformaticsUniversity of PennsylvaniaPhiladelphiaUSA
  2. 2.University of LouisvilleLouisvilleUSA

Personalised recommendations