Advertisement

Table of contents

  1. Front Matter
    Pages i-viii
  2. Osamu Komori, Shinto Eguchi
    Pages 1-10
  3. Osamu Komori, Shinto Eguchi
    Pages 11-25
  4. Osamu Komori, Shinto Eguchi
    Pages 27-33
  5. Osamu Komori, Shinto Eguchi
    Pages 35-43
  6. Osamu Komori, Shinto Eguchi
    Pages 45-55
  7. Back Matter
    Pages 57-59

About this book

Introduction

This book presents a fresh, new approach in that it provides a comprehensive recent review of challenging problems caused by imbalanced data in prediction and classification, and also in that it introduces several of the latest statistical methods of dealing with these problems. The book discusses the property of the imbalance of data from two points of view. The first is quantitative imbalance, meaning that the sample size in one population highly outnumbers that in another population. It includes presence-only data as an extreme case, where the presence of a species is confirmed, whereas the information on its absence is uncertain, which is especially common in ecology in predicting habitat distribution. The second is qualitative imbalance, meaning that the data distribution of one population can be well specified whereas that of the other one shows a highly heterogeneous property. A typical case is the existence of outliers commonly observed in gene expression data, and another is heterogeneous characteristics often observed in a case group in case-control studies. The extension of the logistic regression model, maxent, and AdaBoost for imbalanced data is discussed, providing a new framework for improvement of prediction, classification, and performance of variable selection. Weights functions introduced in the methods play an important role in alleviating the imbalance of data. This book also furnishes a new perspective on these problem and shows some applications of the recently developed statistical methods to real data sets.

Keywords

Divergence and Entropy Generalized Linear Model Imbalanced Data Machine Learning Methods Maxent

Authors and affiliations

  • Osamu Komori
    • 1
  • Shinto Eguchi
    • 2
  1. 1.Seikei UniversityMusashinoJapan
  2. 2.The Institute of Statistical MathematicsTachikawaJapan

Bibliographic information

  • DOI https://doi.org/10.1007/978-4-431-55570-4
  • Copyright Information The Author(s), under exclusive licence to Springer Japan KK 2019
  • Publisher Name Springer, Tokyo
  • eBook Packages Mathematics and Statistics
  • Print ISBN 978-4-431-55569-8
  • Online ISBN 978-4-431-55570-4
  • Series Print ISSN 2191-544X
  • Series Online ISSN 2191-5458
  • Buy this book on publisher's site