TY - GEN
T1 - Convergence problems of Mahalanobis distance-based k-means clustering
AU - Lapidot, Itshak
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/7/2
Y1 - 2018/7/2
N2 - Mahalanobis distance is used for clustering and appears in different scenarios. Sometimes the same covariance is shared for all the clusters. This assumption is very restricted and it might be more meaningful that each cluster will be defined not only by its centroid but also with the covariance matrix. However, its use for k-means algorithm is not appropriate for optimization. It might lead to a good and meaningful clustering, but this is a fact of empirical observation and is not due to the algorithm's convergence. In this study we will show that the overall distance may not decrease from one iteration to another, and that, to ensure convergence, some constraints must be added. Moreover, we will show that in an unconstrained clustering, the cluster covariance matrix is not a solution of the optimization process, but a constraint.
AB - Mahalanobis distance is used for clustering and appears in different scenarios. Sometimes the same covariance is shared for all the clusters. This assumption is very restricted and it might be more meaningful that each cluster will be defined not only by its centroid but also with the covariance matrix. However, its use for k-means algorithm is not appropriate for optimization. It might lead to a good and meaningful clustering, but this is a fact of empirical observation and is not due to the algorithm's convergence. In this study we will show that the overall distance may not decrease from one iteration to another, and that, to ensure convergence, some constraints must be added. Moreover, we will show that in an unconstrained clustering, the cluster covariance matrix is not a solution of the optimization process, but a constraint.
KW - Clustering
KW - Convergence
KW - Cosine distance
KW - Stochastic training
KW - Vector Quantization (VQ)
UR - https://www.scopus.com/pages/publications/85063147121
U2 - 10.1109/ICSEE.2018.8646138
DO - 10.1109/ICSEE.2018.8646138
M3 - Conference contribution
AN - SCOPUS:85063147121
T3 - 2018 IEEE International Conference on the Science of Electrical Engineering in Israel, ICSEE 2018
BT - 2018 IEEE International Conference on the Science of Electrical Engineering in Israel, ICSEE 2018
PB - Institute of Electrical and Electronics Engineers
T2 - 2018 IEEE International Conference on the Science of Electrical Engineering in Israel, ICSEE 2018
Y2 - 12 December 2018 through 14 December 2018
ER -