Machine Learning

, Volume 98, Issue 1, pp 331–357

Probabilistic consensus clustering using evidence accumulation

  • André Lourenço
  • Samuel Rota Bulò
  • Nicola Rebagliati
  • Ana L. N. Fred
  • Mário A. T. Figueiredo
  • Marcello Pelillo
Article

DOI: 10.1007/s10994-013-5339-6

Cite this article as:
Lourenço, A., Rota Bulò, S., Rebagliati, N. et al. Mach Learn (2015) 98: 331. doi:10.1007/s10994-013-5339-6

Abstract

Clustering ensemble methods produce a consensus partition of a set of data points by combining the results of a collection of base clustering algorithms. In the evidence accumulation clustering (EAC) paradigm, the clustering ensemble is transformed into a pairwise co-association matrix, thus avoiding the label correspondence problem, which is intrinsic to other clustering ensemble schemes. In this paper, we propose a consensus clustering approach based on the EAC paradigm, which is not limited to crisp partitions and fully exploits the nature of the co-association matrix. Our solution determines probabilistic assignments of data points to clusters by minimizing a Bregman divergence between the observed co-association frequencies and the corresponding co-occurrence probabilities expressed as functions of the unknown assignments. We additionally propose an optimization algorithm to find a solution under any double-convex Bregman divergence. Experiments on both synthetic and real benchmark data show the effectiveness of the proposed approach.

Keywords

Consensus clustering Evidence Accumulation Ensemble clustering Bregman divergence 

Copyright information

© The Author(s) 2013

Authors and Affiliations

  • André Lourenço
    • 1
    • 2
  • Samuel Rota Bulò
    • 3
  • Nicola Rebagliati
    • 4
  • Ana L. N. Fred
    • 2
    • 5
  • Mário A. T. Figueiredo
    • 2
    • 5
  • Marcello Pelillo
    • 3
  1. 1.Instituto Superior de Engenharia de LisboaLisboaPortugal
  2. 2.Instituto de TelecomunicaçõesLisboaPortugal
  3. 3.DAISMestre, VeneziaItaly
  4. 4.VTT Technical Research Center of FinlandVTTFinland
  5. 5.Instituto Superior TécnicoLisboaPortugal

Personalised recommendations