Advances in Knowledge Discovery and Data Mining
Volume 3518 of the series Lecture Notes in Computer Science pp 568-577
A Framework for Incorporating Class Priors into Discriminative Classification
- Rong JinAffiliated withDepartment of Computer Science and Engineering, Michigan State University
- , Yi LiuAffiliated withDepartment of Computer Science and Engineering, Michigan State University
Abstract
Discriminative and generative methods provide two distinct approaches to machine learning classification. One advantage of generative approaches is that they naturally model the prior class distributions. In contrast, discriminative approaches directly model the conditional distribution of class given inputs, so the class priors are only implicitly obtained if the input density is known. In this paper, we propose a framework for incorporating class prior proportions into discriminative methods in order to improve their classification accuracy. The basic idea is to enforce that the distribution of class labels predicted on the test data by the discriminative model is consistent with the class priors. Therefore, the discriminative model has to not only fit the training data well but also predict class labels for the test data that are consistent with the class priors. Experiments on five different UCI datasets and one image database show that this framework is effective in improving the classification accuracy when the training data and the test data come from the same class proportions, even if the test data does not have exactly the same feature distribution as the training data.
- Title
- A Framework for Incorporating Class Priors into Discriminative Classification
- Book Title
- Advances in Knowledge Discovery and Data Mining
- Book Subtitle
- 9th Pacific-Asia Conference, PAKDD 2005, Hanoi, Vietnam, May 18-20, 2005. Proceedings
- Pages
- pp 568-577
- Copyright
- 2005
- DOI
- 10.1007/11430919_66
- Print ISBN
- 978-3-540-26076-9
- Online ISBN
- 978-3-540-31935-1
- Series Title
- Lecture Notes in Computer Science
- Series Volume
- 3518
- Series ISSN
- 0302-9743
- Publisher
- Springer Berlin Heidelberg
- Copyright Holder
- Springer-Verlag Berlin Heidelberg
- Additional Links
- Topics
- Industry Sectors
- eBook Packages
- Editors
-
- Tu Bao Ho (18)
- David Cheung (19)
- Huan Liu (20)
- Editor Affiliations
-
- 18. Japan Advanced Institute of Science and Technology
- 19. University of Hong Kong
- 20. Department of Computer Science and Engineering, Arizona State University
- Authors
- Author Affiliations
-
- 21. Department of Computer Science and Engineering, Michigan State University, East Lansing, MI48824, U.S.A.
Continue reading...
To view the rest of this content please follow the download PDF link above.