Advances in Machine Learning I pp 227-246

Part of the Studies in Computational Intelligence book series (SCI, volume 262)

An Analysis of Relevance Vector Machine Regression

  • Matti Saarela
  • Tapio Elomaa
  • Keijo Ruohonen

Abstract

The relevance vector machine (RVM) is a Bayesian framework for learning sparse regression models and classifiers. Despite of its popularity and practical success, no thorough analysis of its functionality exists. In this paper we consider the RVM in the case of regression models and present two kinds of analysis results: we derive a full characterization of the behavior of the RVM analytically when the columns of the regression matrix are orthogonal and give some results concerning scale and rotation invariance of the RVM. We also consider the practical implications of our results and present a scenario in which our results can be used to detect potential weakness in the RVM framework.

Keywords

Relevance vector machine regression sparse Bayesian learning 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Matti Saarela
    • 1
  • Tapio Elomaa
    • 1
  • Keijo Ruohonen
    • 2
  1. 1.Department of Software SystemsTampere University of Technology 
  2. 2.Department of MathematicsTampere University of TechnologyTampereFinland

Personalised recommendations