Estimating cluster validity using compactness measure and overlap measure for fuzzy clustering
Bindu Rani, Shri Kant · International Journal of Business Intelligence and Data Mining · 2022
Cluster analysis discovers valuable patterns in data by partitioning n data points into valid number of clusters. The cluster validity index (CVI) helps in selecting the best partitions that fits the underlying structure of data. After presenting brief review on existing CVIs, this study formulates a competent overlap-compactness validity index (OCVI). The proposed index considers Kim et al.'s (2004b) overlap measure with compactness measure. Compactness measure considers the geometrical aspects of membership matrix (U) through cluster centres with an approach to reduce its monotonic tendency. Overlap measure calculates the average value of the overlapping degree of all probable fuzzy cluster pairs. Experiments are implemented on two artificial, two real and one biological dataset. Comparison results of partition coefficient, partition entropy, modified partition coefficient, Xie-Beni and Kim indices with the suggested index (OCVI) imply that suggested index outperforms with maximum compactness and minimum overlap than other validity indices.