Adaptively Fused Attention Module for the Fabric Defect Detection

In the fabric manufacturing industry, fabric defect detection is a practical yet challenging task, due to the problem of defects with small sizes or unremarkable appearances distributed in fabric images with high resolution. Some deep‐learning‐based solutions try to tackle the aforementioned problem...

Full description

Bibliographic Details
Main Authors: Jin Wang, Jingru Yang, Guodong Lu, Cheng Zhang, Zhiyong Yu, Ying Yang
Format: Article
Language:English
Published: Wiley 2023-02-01
Series:Advanced Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1002/aisy.202200151
_version_ 1797902650592722944
author Jin Wang
Jingru Yang
Guodong Lu
Cheng Zhang
Zhiyong Yu
Ying Yang
author_facet Jin Wang
Jingru Yang
Guodong Lu
Cheng Zhang
Zhiyong Yu
Ying Yang
author_sort Jin Wang
collection DOAJ
description In the fabric manufacturing industry, fabric defect detection is a practical yet challenging task, due to the problem of defects with small sizes or unremarkable appearances distributed in fabric images with high resolution. Some deep‐learning‐based solutions try to tackle the aforementioned problem but with limited achievements. Herein, a brand new module called adaptively fused attention module (AFAM) is proposed to improve the detection performance by enabling the network to concentrate more on the small or unremarkable defects in terms of 1) enhancing the feature maps both spatial‐wise and channel‐wise, 2) enhancing the attention information flow between the channel‐attention feature map and the spatial‐attention feature map, and 3) enriching background information. Experiments on the MS‐COCO dataset show that AFAM reaches higher AP than other state‐of‐the‐art (SOTA) attention modules (e.g., squeeze‐and‐excitation network [SE], efficient channel attention [ECA], convolutional block attention module [CBAM]). Meanwhile, on the Smart Diagnosis of Cloth Flaw Dataset (CloF), the Cascade R‐CNN (Resnext101) + AFAM outperforms the SOTA in the official leaderboard of the CloF dataset. Speed‐wisely, the solution achieves a 12.19‐FPS on RTX 3090, thus making it practical to be applied in the industry of fabric defect detection.
first_indexed 2024-04-10T09:21:02Z
format Article
id doaj.art-950cf839299b47cd90b6b0032115dbf3
institution Directory Open Access Journal
issn 2640-4567
language English
last_indexed 2024-04-10T09:21:02Z
publishDate 2023-02-01
publisher Wiley
record_format Article
series Advanced Intelligent Systems
spelling doaj.art-950cf839299b47cd90b6b0032115dbf32023-02-20T12:54:10ZengWileyAdvanced Intelligent Systems2640-45672023-02-0152n/an/a10.1002/aisy.202200151Adaptively Fused Attention Module for the Fabric Defect DetectionJin Wang0Jingru Yang1Guodong Lu2Cheng Zhang3Zhiyong Yu4Ying Yang5State Key Laboratory of Fluid Power & Mechatronic Systems Zhejiang University Hangzhou Zhejiang 310027 ChinaState Key Laboratory of Fluid Power & Mechatronic Systems Zhejiang University Hangzhou Zhejiang 310027 ChinaState Key Laboratory of Fluid Power & Mechatronic Systems Zhejiang University Hangzhou Zhejiang 310027 ChinaState Key Laboratory of Fluid Power & Mechatronic Systems Zhejiang University Hangzhou Zhejiang 310027 ChinaState Key Laboratory of Fluid Power & Mechatronic Systems Zhejiang University Hangzhou Zhejiang 310027 ChinaZhejiang Academy of Surveying & Mapping Hangzhou Zhejiang 311100 ChinaIn the fabric manufacturing industry, fabric defect detection is a practical yet challenging task, due to the problem of defects with small sizes or unremarkable appearances distributed in fabric images with high resolution. Some deep‐learning‐based solutions try to tackle the aforementioned problem but with limited achievements. Herein, a brand new module called adaptively fused attention module (AFAM) is proposed to improve the detection performance by enabling the network to concentrate more on the small or unremarkable defects in terms of 1) enhancing the feature maps both spatial‐wise and channel‐wise, 2) enhancing the attention information flow between the channel‐attention feature map and the spatial‐attention feature map, and 3) enriching background information. Experiments on the MS‐COCO dataset show that AFAM reaches higher AP than other state‐of‐the‐art (SOTA) attention modules (e.g., squeeze‐and‐excitation network [SE], efficient channel attention [ECA], convolutional block attention module [CBAM]). Meanwhile, on the Smart Diagnosis of Cloth Flaw Dataset (CloF), the Cascade R‐CNN (Resnext101) + AFAM outperforms the SOTA in the official leaderboard of the CloF dataset. Speed‐wisely, the solution achieves a 12.19‐FPS on RTX 3090, thus making it practical to be applied in the industry of fabric defect detection.https://doi.org/10.1002/aisy.202200151adaptively fused attention modulefabric defect detectionfeature pyramid networkssmall object detectionsmart diagnosis of cloth flaw dataset
spellingShingle Jin Wang
Jingru Yang
Guodong Lu
Cheng Zhang
Zhiyong Yu
Ying Yang
Adaptively Fused Attention Module for the Fabric Defect Detection
Advanced Intelligent Systems
adaptively fused attention module
fabric defect detection
feature pyramid networks
small object detection
smart diagnosis of cloth flaw dataset
title Adaptively Fused Attention Module for the Fabric Defect Detection
title_full Adaptively Fused Attention Module for the Fabric Defect Detection
title_fullStr Adaptively Fused Attention Module for the Fabric Defect Detection
title_full_unstemmed Adaptively Fused Attention Module for the Fabric Defect Detection
title_short Adaptively Fused Attention Module for the Fabric Defect Detection
title_sort adaptively fused attention module for the fabric defect detection
topic adaptively fused attention module
fabric defect detection
feature pyramid networks
small object detection
smart diagnosis of cloth flaw dataset
url https://doi.org/10.1002/aisy.202200151
work_keys_str_mv AT jinwang adaptivelyfusedattentionmoduleforthefabricdefectdetection
AT jingruyang adaptivelyfusedattentionmoduleforthefabricdefectdetection
AT guodonglu adaptivelyfusedattentionmoduleforthefabricdefectdetection
AT chengzhang adaptivelyfusedattentionmoduleforthefabricdefectdetection
AT zhiyongyu adaptivelyfusedattentionmoduleforthefabricdefectdetection
AT yingyang adaptivelyfusedattentionmoduleforthefabricdefectdetection