Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views
Most existing deep image clustering methods use only class-level representations for clustering. However, the class-level representation alone is not sufficient to describe the differences between images belonging to the same cluster. This may lead to high intra-class representation differences, whi...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2023-01-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/13/1/674 |
_version_ | 1797626228984774656 |
---|---|
author | Feng Peng Kai Li |
author_facet | Feng Peng Kai Li |
author_sort | Feng Peng |
collection | DOAJ |
description | Most existing deep image clustering methods use only class-level representations for clustering. However, the class-level representation alone is not sufficient to describe the differences between images belonging to the same cluster. This may lead to high intra-class representation differences, which will harm the clustering performance. To address this problem, this paper proposes a clustering model named Deep Image Clustering based on Label Similarity and Maximizing Mutual Information Across Views (DCSM). DCSM consists of a backbone network, class-level and instance-level mapping block. The class-level mapping block learns discriminative class-level features by selecting similar (dissimilar) pairs of samples. The proposed extended mutual information is to maximize the mutual information between features extracted from views that were obtained by using data augmentation on the same image and as a constraint on the instance-level mapping block. This forces the instance-level mapping block to capture high-level features that affect multiple views of the same image, thus reducing intra-class differences. Four representative datasets are selected for our experiments, and the results show that the proposed model is superior to the current advanced image clustering models. |
first_indexed | 2024-03-11T10:07:26Z |
format | Article |
id | doaj.art-fdc209ac38504fccb6e3bfa12e2457ba |
institution | Directory Open Access Journal |
issn | 2076-3417 |
language | English |
last_indexed | 2024-03-11T10:07:26Z |
publishDate | 2023-01-01 |
publisher | MDPI AG |
record_format | Article |
series | Applied Sciences |
spelling | doaj.art-fdc209ac38504fccb6e3bfa12e2457ba2023-11-16T15:00:13ZengMDPI AGApplied Sciences2076-34172023-01-0113167410.3390/app13010674Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across ViewsFeng Peng0Kai Li1School of Cyber Security and Computer, Hebei University, Baoding 071000, ChinaSchool of Cyber Security and Computer, Hebei University, Baoding 071000, ChinaMost existing deep image clustering methods use only class-level representations for clustering. However, the class-level representation alone is not sufficient to describe the differences between images belonging to the same cluster. This may lead to high intra-class representation differences, which will harm the clustering performance. To address this problem, this paper proposes a clustering model named Deep Image Clustering based on Label Similarity and Maximizing Mutual Information Across Views (DCSM). DCSM consists of a backbone network, class-level and instance-level mapping block. The class-level mapping block learns discriminative class-level features by selecting similar (dissimilar) pairs of samples. The proposed extended mutual information is to maximize the mutual information between features extracted from views that were obtained by using data augmentation on the same image and as a constraint on the instance-level mapping block. This forces the instance-level mapping block to capture high-level features that affect multiple views of the same image, thus reducing intra-class differences. Four representative datasets are selected for our experiments, and the results show that the proposed model is superior to the current advanced image clustering models.https://www.mdpi.com/2076-3417/13/1/674image clusteringextended mutual informationunsupervised learning |
spellingShingle | Feng Peng Kai Li Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views Applied Sciences image clustering extended mutual information unsupervised learning |
title | Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views |
title_full | Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views |
title_fullStr | Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views |
title_full_unstemmed | Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views |
title_short | Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views |
title_sort | deep image clustering based on label similarity and maximizing mutual information across views |
topic | image clustering extended mutual information unsupervised learning |
url | https://www.mdpi.com/2076-3417/13/1/674 |
work_keys_str_mv | AT fengpeng deepimageclusteringbasedonlabelsimilarityandmaximizingmutualinformationacrossviews AT kaili deepimageclusteringbasedonlabelsimilarityandmaximizingmutualinformationacrossviews |