Representation Learning Method for Circular Seal Based on Modified MLP-Mixer

This study proposes Stamp-MLP, an enhanced seal impression representation learning technique based on MLP-Mixer. Instead of using the patch linear mapping preprocessing method, this technique uses circular seal remapping, which reserves the seals’ underlying pixel-level information. In the proposed...

Full description

Bibliographic Details
Main Authors: Yuan Cao, You Zhou, Zhiwen Zhang, Enyi Yao
Format: Article
Language:English
Published: MDPI AG 2023-11-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/25/11/1521
_version_ 1827639894465314816
author Yuan Cao
You Zhou
Zhiwen Zhang
Enyi Yao
author_facet Yuan Cao
You Zhou
Zhiwen Zhang
Enyi Yao
author_sort Yuan Cao
collection DOAJ
description This study proposes Stamp-MLP, an enhanced seal impression representation learning technique based on MLP-Mixer. Instead of using the patch linear mapping preprocessing method, this technique uses circular seal remapping, which reserves the seals’ underlying pixel-level information. In the proposed Stamp-MLP, the average pooling is replaced by a global pooling of attention to extract the information more comprehensively. There were three classification tasks in our proposed method: categorizing the seal surface, identifying the product type, and distinguishing individual seals. The three tasks shared an identical dataset comprising 81 seals, encompassing 16 distinct seal surfaces, with each surface featuring six diverse product types. The experiment results showed that, in comparison to MLP-Mixer, VGG16, and ResNet50, the proposed Stamp-MLP achieved the highest classification accuracy (89.61%) in seal surface classification tasks with fewer training samples. Meanwhile, Stamp-MLP outperformed the others with accuracy rates of 90.68% and 91.96% in the product type and seal impression classification tasks, respectively. Moreover, Stamp-MLP had the fewest model parameters (2.67 M).
first_indexed 2024-03-09T16:50:27Z
format Article
id doaj.art-056fda4effc543a8b1ec25d5910f33b3
institution Directory Open Access Journal
issn 1099-4300
language English
last_indexed 2024-03-09T16:50:27Z
publishDate 2023-11-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj.art-056fda4effc543a8b1ec25d5910f33b32023-11-24T14:41:00ZengMDPI AGEntropy1099-43002023-11-012511152110.3390/e25111521Representation Learning Method for Circular Seal Based on Modified MLP-MixerYuan Cao0You Zhou1Zhiwen Zhang2Enyi Yao3College of Information Science and Engineering, Hohai University, Changzhou 213022, ChinaCollege of Information Science and Engineering, Hohai University, Changzhou 213022, ChinaCollege of Information Science and Engineering, Hohai University, Changzhou 213022, ChinaSchool of Microelectronics, South China University of Technology, Guangzhou 511442, ChinaThis study proposes Stamp-MLP, an enhanced seal impression representation learning technique based on MLP-Mixer. Instead of using the patch linear mapping preprocessing method, this technique uses circular seal remapping, which reserves the seals’ underlying pixel-level information. In the proposed Stamp-MLP, the average pooling is replaced by a global pooling of attention to extract the information more comprehensively. There were three classification tasks in our proposed method: categorizing the seal surface, identifying the product type, and distinguishing individual seals. The three tasks shared an identical dataset comprising 81 seals, encompassing 16 distinct seal surfaces, with each surface featuring six diverse product types. The experiment results showed that, in comparison to MLP-Mixer, VGG16, and ResNet50, the proposed Stamp-MLP achieved the highest classification accuracy (89.61%) in seal surface classification tasks with fewer training samples. Meanwhile, Stamp-MLP outperformed the others with accuracy rates of 90.68% and 91.96% in the product type and seal impression classification tasks, respectively. Moreover, Stamp-MLP had the fewest model parameters (2.67 M).https://www.mdpi.com/1099-4300/25/11/1521seal recognitionMLP-Mixerrepresentation learning
spellingShingle Yuan Cao
You Zhou
Zhiwen Zhang
Enyi Yao
Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
Entropy
seal recognition
MLP-Mixer
representation learning
title Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_full Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_fullStr Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_full_unstemmed Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_short Representation Learning Method for Circular Seal Based on Modified MLP-Mixer
title_sort representation learning method for circular seal based on modified mlp mixer
topic seal recognition
MLP-Mixer
representation learning
url https://www.mdpi.com/1099-4300/25/11/1521
work_keys_str_mv AT yuancao representationlearningmethodforcircularsealbasedonmodifiedmlpmixer
AT youzhou representationlearningmethodforcircularsealbasedonmodifiedmlpmixer
AT zhiwenzhang representationlearningmethodforcircularsealbasedonmodifiedmlpmixer
AT enyiyao representationlearningmethodforcircularsealbasedonmodifiedmlpmixer