Deep Fuzzy Clustering Network With Matrix Norm Regularization

Recently, deep clustering networks, which able to learn latent embedding and clustering assignment simultaneously, attract lots of attention. Among the deep clustering networks, the suitable regularization term is not only beneficial to training of neural network, but also enhancing clustering perfo...

Full description

Bibliographic Details
Main Authors: Feiyu Chen, Yan Li, Wei Wang
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10443360/
Description
Summary:Recently, deep clustering networks, which able to learn latent embedding and clustering assignment simultaneously, attract lots of attention. Among the deep clustering networks, the suitable regularization term is not only beneficial to training of neural network, but also enhancing clustering performance. In the paper, we propose a deep fuzzy clustering network with mixed matrix norm regularization (DFCNR). Specifically, DFCNR uses the weighted intra-class variance as clustering loss, <inline-formula> <tex-math notation="LaTeX">$\ell _{1,2}$ </tex-math></inline-formula> norm and the Frobenius norm of soft assignment matrix as regularization term, where the minimization of <inline-formula> <tex-math notation="LaTeX">$\ell _{1,2}$ </tex-math></inline-formula> norm aims to achieve balanced assignment, and maximization of Frobenius norm aims to achieve discriminative assignment. Moreover, by solving the quadratic convex constraint optimization problem about soft assignment, we derive the activation function of clustering layer. Extensive experiments conducted on several datasets illustrate the superiority of the proposed approach in comparison with current methods.
ISSN:2169-3536