SYNOPSIS

Public Member Functions

KMeans (const size_t maxIterations=1000, const double overclusteringFactor=1.0, const MetricType metric=MetricType(), const InitialPartitionPolicy partitioner=InitialPartitionPolicy(), const EmptyClusterPolicy emptyClusterAction=EmptyClusterPolicy())

Create a K-Means object and (optionally) set the parameters which K-Means will be run with. template<typename MatType > void Cluster (const MatType &data, const size_t clusters, arma::Col< size_t > &assignments, const bool initialGuess=false) const

Perform k-means clustering on the data, returning a list of cluster assignments. template<typename MatType > void Cluster (const MatType &data, const size_t clusters, arma::Col< size_t > &assignments, MatType ¢roids, const bool initialAssignmentGuess=false, const bool initialCentroidGuess=false) const

Perform k-means clustering on the data, returning a list of cluster assignments and also the centroids of each cluster. const EmptyClusterPolicy & EmptyClusterAction () const

Get the empty cluster policy. EmptyClusterPolicy & EmptyClusterAction ()

Modify the empty cluster policy. size_t MaxIterations () const

Get the maximum number of iterations. size_t & MaxIterations ()

Set the maximum number of iterations. const MetricType & Metric () const

Get the distance metric. MetricType & Metric ()

Modify the distance metric. double OverclusteringFactor () const

Return the overclustering factor. double & OverclusteringFactor ()

Set the overclustering factor. Must be greater than 1. const InitialPartitionPolicy & Partitioner () const

Get the initial partitioning policy. InitialPartitionPolicy & Partitioner ()

Modify the initial partitioning policy. std::string ToString () const

Private Attributes

EmptyClusterPolicy emptyClusterAction

Instantiated empty cluster policy. size_t maxIterations

Maximum number of iterations before giving up. MetricType metric

Instantiated distance metric. double overclusteringFactor

Factor controlling how many clusters are actually found. InitialPartitionPolicy partitioner

Instantiated initial partitioning policy.

Detailed Description

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster>class mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >

This class implements K-Means clustering.

This implementation supports overclustering, which means that more clusters than are requested will be found; then, those clusters will be merged together to produce the desired number of clusters.

Two template parameters can (optionally) be supplied: the policy for how to find the initial partition of the data, and the actions to be taken when an empty cluster is encountered, as well as the distance metric to be used.

A simple example of how to run K-Means clustering is shown below.

extern arma::mat data; // Dataset we want to run K-Means on.
arma::Col<size_t> assignments; // Cluster assignments.

KMeans<> k; // Default options.
k.Cluster(data, 3, assignments); // 3 clusters.

// Cluster using the Manhattan distance, 100 iterations maximum, and an
// overclustering factor of 4.0.
KMeans<metric::ManhattanDistance> k(100, 4.0);
k.Cluster(data, 6, assignments); // 6 clusters.

Template Parameters:

MetricType The distance metric to use for this KMeans; see metric::LMetric for an example.

InitialPartitionPolicy Initial partitioning policy; must implement a default constructor and 'void Cluster(const arma::mat&, const size_t, arma::Col<size_t>&)'.

EmptyClusterPolicy Policy for what to do on an empty cluster; must implement a default constructor and 'void EmptyCluster(const arma::mat&, arma::Col<size_t&)'.

See also:

RandomPartition, RefinedStart, AllowEmptyClusters, MaxVarianceNewCluster

Definition at line 75 of file kmeans.hpp.

Constructor & Destructor Documentation

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::\fBKMeans\fP (const size_tmaxIterations = \fC1000\fP, const doubleoverclusteringFactor = \fC1.0\fP, const MetricTypemetric = \fCMetricType()\fP, const InitialPartitionPolicypartitioner = \fCInitialPartitionPolicy()\fP, const EmptyClusterPolicyemptyClusterAction = \fCEmptyClusterPolicy()\fP)

Create a K-Means object and (optionally) set the parameters which K-Means will be run with. This implementation allows a few strategies to improve the performance of K-Means, including 'overclustering' and disallowing empty clusters.

The overclustering factor controls how many clusters are actually found; for instance, with an overclustering factor of 4, if K-Means is run to find 3 clusters, it will actually find 12, then merge the nearest clusters until only 3 are left.

Parameters:

maxIterations Maximum number of iterations allowed before giving up (0 is valid, but the algorithm may never terminate).

overclusteringFactor Factor controlling how many extra clusters are found and then merged to get the desired number of clusters.

metric Optional MetricType object; for when the metric has state it needs to store.

partitioner Optional InitialPartitionPolicy object; for when a specially initialized partitioning policy is required.

emptyClusterAction Optional EmptyClusterPolicy object; for when a specially initialized empty cluster policy is required.

Member Function Documentation

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> template<typename MatType > void \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::Cluster (const MatType &data, const size_tclusters, arma::Col< size_t > &assignments, const boolinitialGuess = \fCfalse\fP) const

Perform k-means clustering on the data, returning a list of cluster assignments. Optionally, the vector of assignments can be set to an initial guess of the cluster assignments; to do this, set initialGuess to true.

Template Parameters:

MatType Type of matrix (arma::mat or arma::sp_mat).

Parameters:

data Dataset to cluster.

clusters Number of clusters to compute.

assignments Vector to store cluster assignments in.

initialGuess If true, then it is assumed that assignments has a list of initial cluster assignments.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> template<typename MatType > void \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::Cluster (const MatType &data, const size_tclusters, arma::Col< size_t > &assignments, MatType ¢roids, const boolinitialAssignmentGuess = \fCfalse\fP, const boolinitialCentroidGuess = \fCfalse\fP) const

Perform k-means clustering on the data, returning a list of cluster assignments and also the centroids of each cluster. Optionally, the vector of assignments can be set to an initial guess of the cluster assignments; to do this, set initialAssignmentGuess to true. Another way to set initial cluster guesses is to fill the centroids matrix with the centroid guesses, and then set initialCentroidGuess to true. initialAssignmentGuess supersedes initialCentroidGuess, so if both are set to true, the assignments vector is used.

Note that if the overclustering factor is greater than 1, the centroids matrix will be resized in the method. Regardless of the overclustering factor, the centroid guess matrix (if initialCentroidGuess is set to true) should have the same number of rows as the data matrix, and number of columns equal to 'clusters'.

Template Parameters:

MatType Type of matrix (arma::mat or arma::sp_mat).

Parameters:

data Dataset to cluster.

clusters Number of clusters to compute.

assignments Vector to store cluster assignments in.

centroids Matrix in which centroids are stored.

initialAssignmentGuess If true, then it is assumed that assignments has a list of initial cluster assignments.

initialCentroidGuess If true, then it is assumed that centroids contains the initial centroids of each cluster.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> const EmptyClusterPolicy& \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::EmptyClusterAction () const\fC [inline]\fP

Get the empty cluster policy.

Definition at line 181 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::emptyClusterAction.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> EmptyClusterPolicy& \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::EmptyClusterAction ()\fC [inline]\fP

Modify the empty cluster policy.

Definition at line 184 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::emptyClusterAction.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> size_t \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::MaxIterations () const\fC [inline]\fP

Get the maximum number of iterations.

Definition at line 166 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::maxIterations.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> size_t& \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::MaxIterations ()\fC [inline]\fP

Set the maximum number of iterations.

Definition at line 168 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::maxIterations.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> const MetricType& \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::Metric () const\fC [inline]\fP

Get the distance metric.

Definition at line 171 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::metric.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> MetricType& \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::Metric ()\fC [inline]\fP

Modify the distance metric.

Definition at line 173 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::metric.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> double \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::OverclusteringFactor () const\fC [inline]\fP

Return the overclustering factor.

Definition at line 161 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::overclusteringFactor.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> double& \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::OverclusteringFactor ()\fC [inline]\fP

Set the overclustering factor. Must be greater than 1.

Definition at line 163 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::overclusteringFactor.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> const InitialPartitionPolicy& \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::Partitioner () const\fC [inline]\fP

Get the initial partitioning policy.

Definition at line 176 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::partitioner.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> InitialPartitionPolicy& \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::Partitioner ()\fC [inline]\fP

Modify the initial partitioning policy.

Definition at line 178 of file kmeans.hpp.

References mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::partitioner.

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> std::string \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::ToString () const

Member Data Documentation

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> EmptyClusterPolicy \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::emptyClusterAction\fC [private]\fP

Instantiated empty cluster policy.

Definition at line 199 of file kmeans.hpp.

Referenced by mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::EmptyClusterAction().

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> size_t \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::maxIterations\fC [private]\fP

Maximum number of iterations before giving up.

Definition at line 193 of file kmeans.hpp.

Referenced by mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::MaxIterations().

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> MetricType \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::metric\fC [private]\fP

Instantiated distance metric.

Definition at line 195 of file kmeans.hpp.

Referenced by mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::Metric().

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> double \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::overclusteringFactor\fC [private]\fP

Factor controlling how many clusters are actually found.

Definition at line 191 of file kmeans.hpp.

Referenced by mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::OverclusteringFactor().

template<typename MetricType = metric::SquaredEuclideanDistance, typename InitialPartitionPolicy = RandomPartition, typename EmptyClusterPolicy = MaxVarianceNewCluster> InitialPartitionPolicy \fBmlpack::kmeans::KMeans\fP< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::partitioner\fC [private]\fP

Instantiated initial partitioning policy.

Definition at line 197 of file kmeans.hpp.

Referenced by mlpack::kmeans::KMeans< MetricType, InitialPartitionPolicy, EmptyClusterPolicy >::Partitioner().

Author

Generated automatically by Doxygen for MLPACK from the source code.