Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views

Most existing deep image clustering methods use only class-level representations for clustering. However, the class-level representation alone is not sufficient to describe the differences between images belonging to the same cluster. This may lead to high intra-class representation differences, whi...

Full description

Bibliographic Details
Main Authors: Feng Peng, Kai Li
Format: Article
Language:English
Published: MDPI AG 2023-01-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/13/1/674
_version_ 1797626228984774656
author Feng Peng
Kai Li
author_facet Feng Peng
Kai Li
author_sort Feng Peng
collection DOAJ
description Most existing deep image clustering methods use only class-level representations for clustering. However, the class-level representation alone is not sufficient to describe the differences between images belonging to the same cluster. This may lead to high intra-class representation differences, which will harm the clustering performance. To address this problem, this paper proposes a clustering model named Deep Image Clustering based on Label Similarity and Maximizing Mutual Information Across Views (DCSM). DCSM consists of a backbone network, class-level and instance-level mapping block. The class-level mapping block learns discriminative class-level features by selecting similar (dissimilar) pairs of samples. The proposed extended mutual information is to maximize the mutual information between features extracted from views that were obtained by using data augmentation on the same image and as a constraint on the instance-level mapping block. This forces the instance-level mapping block to capture high-level features that affect multiple views of the same image, thus reducing intra-class differences. Four representative datasets are selected for our experiments, and the results show that the proposed model is superior to the current advanced image clustering models.
first_indexed 2024-03-11T10:07:26Z
format Article
id doaj.art-fdc209ac38504fccb6e3bfa12e2457ba
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-11T10:07:26Z
publishDate 2023-01-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-fdc209ac38504fccb6e3bfa12e2457ba2023-11-16T15:00:13ZengMDPI AGApplied Sciences2076-34172023-01-0113167410.3390/app13010674Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across ViewsFeng Peng0Kai Li1School of Cyber Security and Computer, Hebei University, Baoding 071000, ChinaSchool of Cyber Security and Computer, Hebei University, Baoding 071000, ChinaMost existing deep image clustering methods use only class-level representations for clustering. However, the class-level representation alone is not sufficient to describe the differences between images belonging to the same cluster. This may lead to high intra-class representation differences, which will harm the clustering performance. To address this problem, this paper proposes a clustering model named Deep Image Clustering based on Label Similarity and Maximizing Mutual Information Across Views (DCSM). DCSM consists of a backbone network, class-level and instance-level mapping block. The class-level mapping block learns discriminative class-level features by selecting similar (dissimilar) pairs of samples. The proposed extended mutual information is to maximize the mutual information between features extracted from views that were obtained by using data augmentation on the same image and as a constraint on the instance-level mapping block. This forces the instance-level mapping block to capture high-level features that affect multiple views of the same image, thus reducing intra-class differences. Four representative datasets are selected for our experiments, and the results show that the proposed model is superior to the current advanced image clustering models.https://www.mdpi.com/2076-3417/13/1/674image clusteringextended mutual informationunsupervised learning
spellingShingle Feng Peng
Kai Li
Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views
Applied Sciences
image clustering
extended mutual information
unsupervised learning
title Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views
title_full Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views
title_fullStr Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views
title_full_unstemmed Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views
title_short Deep Image Clustering Based on Label Similarity and Maximizing Mutual Information across Views
title_sort deep image clustering based on label similarity and maximizing mutual information across views
topic image clustering
extended mutual information
unsupervised learning
url https://www.mdpi.com/2076-3417/13/1/674
work_keys_str_mv AT fengpeng deepimageclusteringbasedonlabelsimilarityandmaximizingmutualinformationacrossviews
AT kaili deepimageclusteringbasedonlabelsimilarityandmaximizingmutualinformationacrossviews