Data Mining and Knowledge Discovery

, Volume 2, Issue 3, pp 283–304

Extensions to the k-Means Algorithm for Clustering Large Data Sets with Categorical Values

  • Zhexue Huang
Article

DOI: 10.1023/A:1009769707641

Cite this article as:
Huang, Z. Data Mining and Knowledge Discovery (1998) 2: 283. doi:10.1023/A:1009769707641

Abstract

The k-means algorithm is well known for its efficiency in clustering large data sets. However, working only on numeric values prohibits it from being used to cluster real world data containing categorical values. In this paper we present two algorithms which extend the k-means algorithm to categorical domains and domains with mixed numeric and categorical values. The k-modes algorithm uses a simple matching dissimilarity measure to deal with categorical objects, replaces the means of clusters with modes, and uses a frequency-based method to update modes in the clustering process to minimise the clustering cost function. With these extensions the k-modes algorithm enables the clustering of categorical data in a fashion similar to k-means. The k-prototypes algorithm, through the definition of a combined dissimilarity measure, further integrates the k-means and k-modes algorithms to allow for clustering objects described by mixed numeric and categorical attributes. We use the well known soybean disease and credit approval data sets to demonstrate the clustering performance of the two algorithms. Our experiments on two real world data sets with half a million objects each show that the two algorithms are efficient when clustering large data sets, which is critical to data mining applications.

data mining cluster analysis clustering algorithms categorical data 

Copyright information

© Kluwer Academic Publishers 1998

Authors and Affiliations

  • Zhexue Huang
    • 1
  1. 1.ACSys CRC, CSIRO Mathematical and Information SciencesCanberraAustralia