{"Package":"CEC","Title":"Cross-Entropy Clustering","Version":"0.9.4","Date":"2016-04-23","Author":"Konrad Kamieniecki [aut, cre], Przemyslaw Spurek [ctb]","Maintainer":"Konrad Kamieniecki ","Description":"Cross-Entropy Clustering (CEC) divides the data into Gaussian type clusters. It performs the automatic reduction of unnecessary clusters, while at the same time allows the simultaneous use of various type Gaussian mixture models.","ByteCompile":"true","URL":"https://github.com/azureblue/cec","Encoding":"UTF-8","NeedsCompilation":"yes","License":"GPL-3","Imports":"graphics, methods, stats, utils","Packaged":"2016-04-23 20:35:40 UTC; Konrad","Repository":"CRAN","Date/Publication":"2016-04-24 16:40:14","repoType":"cran","tarballUrl":"ftp://cran.r-project.org/pub/R/src/contrib/CEC_0.9.4.tar.gz","readme":"CEC\n===\n\nThe R Package CEC performs clustering based on the cross–entropy clustering (CEC) method, which was recently developed with the use of information theory. The main advantage of CEC is that it combines the speed and simplicity of k-means with the ability to use various Gaussian mixture models and reduce unnecessary clusters.\n\nThe CEC package is a part of CRAN repository and it can be installed by the following command:\n\n```R\ninstall.packages(\"CEC\")\nlibrary(\"CEC\")\n```\n\nThe basic usage comes down to the function `cec` with two required arguments: input data (`x`) and the initial number of centers (`centers`):\n\n```R\ncec(x = ..., centers = ...)\n```\nBelow, a simple session with **R** is presented, where the component\n(waiting) of the Old Faithful dataset is split into two clusters:\n\n```R\nlibrary(\"CEC\")\nattach(faithful)\ncec <- cec(matrix(faithful$waiting), 2)\nprint(cec)\n```\n\nAs the main result, CEC returns data cluster membership `cec$cluster`. The following parameters of \nclusters can be obtained as well:\n\n- means (`cec$centers`)\n- covariances (`cec$covariances.model`)\n- probabilities (`cec$probability`)\n\nAdditional information concerning the number of iterations, cost (energy) function and the number of clusters at each iteration are also available.\n\nBelow, a session of **R** is presented which shows how to use the above parameters for plotting the data and the Gaussian models corresponding to the clusters.\n\n```R\nhist(faithful$waiting, prob = T, main = \"Time between Old Faithful eruptions\", xlab = \"Minutes\", \n col = \"lightgray\", border = 0, ylim = c(0, 0.05))\n \nfor(i in c(1:2))\n curve(cec$probability[i] * dnorm(x, mean = cec$centers[i], sd = sqrt(cec$covariances[[i]][1])),\n add = T, col = i + 1, lwd = 2) \n```\n![](https://azureblue.github.io/cec/static/old.png)\n\nThe CEC method, analogously to k-means, depends on the initial clusters memberships. Therefore, the initialization should be started a few times, which can be achieved using the `nstart` parameter.\n```R\ncec <- cec(x = ..., centers = ..., nstart = ...)\n```\nThe initial locations of the centers can be chosen either **randomly** or using the **k-means++** method and it's driven by the `centers.init` parameter which can take one of the two values: `\"random\"` or `\"kmeans++\"`.\n\nIn the context multiple starts, it is worth to mention the `iter.max` parameter which limits the number of iterations in each start.\n\nAn essential parameter, in the context of CEC method, is `card.min` which expresses minimal cluster size - the number of points, below which, the cluster is removed. Since each cluster is described by a covariance matrix, the number of elements in the cluster must be larger than the dimension of the data.\n\nOne of the most important properties of the CEC algorithm is that it can be applied to various Gaussian models. The CEC package includes the implementation of six Gaussian models, which can be specified by the parameter `type`.\n\nImplemented Gaussian models (families)\n--------------------------------------\n\n### General Gaussian distributions\n**`type = \"all\"`**\n\nThe general Gaussian CEC algorithm gives similar results to those obtained by the Gaussian Mixture Models. However, the CEC does not use the EM (Expectation Maximization) approach for minimization but a simple iteration process (Hartigan method). Consequently, larger datasets can be processed in shorter time.\n\nThe clustering will have a tendency to divide the data into clusters in the shape of ellipses (ellipsoids in higher dimensions). \n \n```R\ndata(\"fourGaussians\")\n\ncec <- cec(fourGaussians, centers = 10, type = \"all\", nstart = 20)\n\nplot(cec, asp = 1)\ncec.plot.cost.function(cec)\n```\n![](https://azureblue.github.io/cec/static/all.png)![](https://azureblue.github.io/cec/static/allcost.png)\n\n### Spherical CEC \n**`type = \"spherical\"`**\n\nThe original distribution will be estimated by spherical (radial) densities, which will result in splitting the data into circle-like clusters of arbitrary sizes (balls in higher dimensions). \n\n```R\ndata(\"Tset\")\n\ncec <- cec(x = Tset, centers = 10, type = \"spherical\", nstart = 5)\n\nplot(cec, asp = 1)\n```\n![](https://azureblue.github.io/cec/static/spherical.png)\n\n### Spherical CEC with fixed radius\n**`type = \"fixedr\"`**\n\nSimilarly to the general spherical model, the dataset will be divided into clusters resembling full circles, but with the radius determined by the `param` argument.\n\n```R\ndata(\"Tset\")\n\ncec <- cec(x = Tset, centers = 10, type = \"fixedr\", param = 0.01, nstart = 20)\n\nplot(cec, asp = 1)\n```\n![](https://azureblue.github.io/cec/static/fixedr.png)\n\n### Diagonal CEC\n**`type = \"diagonal\"`**\n\nIn this case, the data will be described by ellipses for which the main semi-major axes are parallel to the axes of the coordinate system. \n\n```R\ndata(\"Tset\")\n\ncec <- cec(x = Tset, centers = 10, type = \"diagonal\", nstart = 5)\n\nplot(cec, asp = 1)\n```\n![](https://azureblue.github.io/cec/static/diagonal.png) \n\n### Fixed covariance CEC\n**`type = \"covariance\"`**\n\nThis model contains Gaussians with an arbitrary fixed covariance matrix.\n\n```R\ndata(\"Tset\")\n\ncec <- cec(x = Tset, centers = 10, card.min = '10%', type = \"covariance\", \n param = matrix(c(0.04, 0, 0, 0.01), 2))\n\nplot(cec, asp = 1)\n```\n![](https://azureblue.github.io/cec/static/cov.png)\n\nIn the above example, the following covariance matrix has been used, which results in covering the data by fixed shape ellipses:\n```\n0.04 0.00\n0.00 0.01 \n```\n\n### Fixed eigenvalues CEC\n**`type = \"eigenvalues\"`**\n\nThe last model is based on Gaussians with arbitrary fixed eigenvalues.\n\n```R\ndata(\"Tset\")\n\ncec <- cec(x = Tset, centers = 10, type = \"eigenvalues\", param = c(0.01, 0.001), nstart = 5)\n\nplot(cec, asp = 1)\n```\n![](https://azureblue.github.io/cec/static/eigen.png)\n\nIn the above example, two eigenvalues: **λ₁=0.01** and **λ₂=0.001** are used, which results in covering the data with ellipses having fixed semi axes (corresponding to the eigenvalues). \n\nA mix of the Gaussian models\n----------------------------\n\nOne of the most powerful properties of the CEC algorithm is the possibility of mixing models. More precisely, the mixed models can be specified by giving a list of cluster types (and a list of parameters if needed).\n\n```R\ncec(x = ..., centers = ..., type = c(\"all\", \"diagonal\", ...), param = ...).\n```\n\n```R\ndata(\"mixShapes\")\n\ncec <- cec(mixShapes, 7, iter.max = 3, \n type = c(\"fixedr\", \"fixedr\", \"eigen\", \"eigen\", \"eigen\", \"eigen\", \"eigen\"), \n param = list(350, 350, c(9000, 8), c(9000, 8), c(9000, 8), c(9000, 8), c(9000, 8)), nstart = 500)\n\nplot(cec, asp = 1)\n```\n![](https://azureblue.github.io/cec/static/mix.png)\n","jobInfo":{"package":"CEC","version":"0.9.4","parsingStatus":"success","parserVersion":1,"parsedAt":"2018-07-09T20:30:04+0000"}}

Description

Usage

Arguments

See Also

Examples