Learning monotone nonlinear models using the Choquet integral
 Ali Fallah Tehrani,
 Weiwei Cheng,
 Krzysztof Dembczyński,
 Eyke Hüllermeier
 … show all 4 hide
Abstract
The learning of predictive models that guarantee monotonicity in the input variables has received increasing attention in machine learning in recent years. By trend, the difficulty of ensuring monotonicity increases with the flexibility or, say, nonlinearity of a model. In this paper, we advocate the socalled Choquet integral as a tool for learning monotone nonlinear models. While being widely used as a flexible aggregation operator in different fields, such as multiple criteria decision making, the Choquet integral is much less known in machine learning so far. Apart from combining monotonicity and flexibility in a mathematically sound and elegant manner, the Choquet integral has additional features making it attractive from a machine learning point of view. Notably, it offers measures for quantifying the importance of individual predictor variables and the interaction between groups of variables. Analyzing the Choquet integral from a classification perspective, we provide upper and lower bounds on its VCdimension. Moreover, as a methodological contribution, we propose a generalization of logistic regression. The basic idea of our approach, referred to as choquistic regression, is to replace the linear function of predictor variables, which is commonly used in logistic regression to model the log odds of the positive class, by the Choquet integral. First experimental results are quite promising and suggest that the combination of monotonicity and flexibility offered by the Choquet integral facilitates strong performance in practical applications.
 Title
 Learning monotone nonlinear models using the Choquet integral
 Journal

Machine Learning
Volume 89, Issue 12 , pp 183211
 Cover Date
 201210
 DOI
 10.1007/s1099401253183
 Print ISSN
 08856125
 Online ISSN
 15730565
 Publisher
 Springer US
 Additional Links
 Topics
 Keywords

 Choquet integral
 Monotone learning
 Nonlinear models
 Choquistic regression
 Classification
 VC dimension
 Industry Sectors
 Authors

 Ali Fallah Tehrani ^{(1)}
 Weiwei Cheng ^{(1)}
 Krzysztof Dembczyński ^{(2)}
 Eyke Hüllermeier ^{(1)}
 Author Affiliations

 1. Department of Mathematics and Computer Science, Marburg University, Marburg, Germany
 2. Institute of Computing Science, Poznań University of Technology, Poznań, Poland