Data Mining and Knowledge Discovery

, Volume 21, Issue 2, pp 277–292

Three naive Bayes approaches for discrimination-free classification

Open Access
Article

Abstract

In this paper, we investigate how to modify the naive Bayes classifier in order to perform classification that is restricted to be independent with respect to a given sensitive attribute. Such independency restrictions occur naturally when the decision process leading to the labels in the data-set was biased; e.g., due to gender or racial discrimination. This setting is motivated by many cases in which there exist laws that disallow a decision that is partly based on discrimination. Naive application of machine learning techniques would result in huge fines for companies. We present three approaches for making the naive Bayes classifier discrimination-free: (i) modifying the probability of the decision being positive, (ii) training one model for every sensitive attribute value and balancing them, and (iii) adding a latent variable to the Bayesian model that represents the unbiased label and optimizing the model parameters for likelihood using expectation maximization. We present experiments for the three approaches on both artificial and real-life data.

Keywords

Discrimination-aware classification Naive Bayes Expectation maximization 

References

  1. Calders T, Kamiran F, Pechenizkiy M (2009) Building classifiers with independency constraints. In: IEEE ICDM workshop on domain driven data mining. IEEE pressGoogle Scholar
  2. Calders T, Kamiran F, Pechenizkiy M (2010) Constructing decision trees under independency constraints. Technical report, TU EindhovenGoogle Scholar
  3. Chan PK, Stolfo SJ (1998) Toward scalable learning with non-uniform class and cost distributions: a case study in credit card fraud detection. In: Proceedings of ACM SIGKDD, pp 164–168Google Scholar
  4. Duivesteijn W, Feelders AJ (2008) Nearest neighbour classification with monotonicity constraints. In: Proceedings of ECML/PKDD’08. Springer, Berlin, pp 301–316Google Scholar
  5. Elkan C (2001) The foundations of cost-sensitive learning. In: Proceedings of IJCAI’01, pp 973–978Google Scholar
  6. Kamiran F, Calders T (2009) Classifying without discriminating. In: Proceedings of IC409. IEEE pressGoogle Scholar
  7. Kamiran F, Calders T (2010) Classification with no discrimination by preferential sampling. In: Proc. BenelearnGoogle Scholar
  8. Kotlowski W, Dembczynski K, Greco S, Slowinski R (2007) Statistical model for rough set approach to multicriteria classification. In: Proceedings of ECML/PKDD’07. Springer, BerlinGoogle Scholar
  9. Margineantu DD, Dietterich TG (1999) Learning decision trees for loss minimization in multi-class problems. Technical report, Department Computer Science, Oregon State UniversityGoogle Scholar
  10. Nijssen S, Fromont E (2007) Mining optimal decision trees from itemset lattices. In: Proceedings of ACM SIGKDDGoogle Scholar
  11. Pedreschi D, Ruggieri S, Turini F (2008) Discrimination-aware data mining. In: Proceedings of ACM SIGKDDGoogle Scholar
  12. Pedreschi D, Ruggieri S, Turini F (2009) Measuring discrimination in socially-sensitive decision records. In: Proceedings of SIAM DMGoogle Scholar

Copyright information

© The Author(s) 2010

Authors and Affiliations

  1. 1.Eindhoven University of TechnologyEindhovenNetherlands

Personalised recommendations