Multi-Scale Feature Fusion with Adaptive Weighting for Diabetic Retinopathy Severity Classification

Diabetic retinopathy (DR) is the prime cause of blindness in people who suffer from diabetes. Automation of DR diagnosis could help a lot of patients avoid the risk of blindness by identifying the disease and making judgments at an early stage. The main focus of the present work is to propose a feas...

Full description

Bibliographic Details
Main Authors: Runze Fan, Yuhong Liu, Rongfen Zhang
Format: Article
Language:English
Published: MDPI AG 2021-06-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/10/12/1369
_version_ 1797531025428971520
author Runze Fan
Yuhong Liu
Rongfen Zhang
author_facet Runze Fan
Yuhong Liu
Rongfen Zhang
author_sort Runze Fan
collection DOAJ
description Diabetic retinopathy (DR) is the prime cause of blindness in people who suffer from diabetes. Automation of DR diagnosis could help a lot of patients avoid the risk of blindness by identifying the disease and making judgments at an early stage. The main focus of the present work is to propose a feasible scheme of DR severity level detection under the MobileNetV3 backbone network based on a multi-scale feature of the retinal fundus image and improve the classification performance of the model. Firstly, a special residual attention module RCAM for multi-scale feature extraction from different convolution layers was designed. Then, the feature fusion by an innovative operation of adaptive weighting was carried out in each layer. The corresponding weight of the convolution block is updated in the model training automatically, with further global average pooling (GAP) and division process to avoid over-fitting of the model and removing non-critical features. In addition, Focal Loss is used as a loss function due to the data imbalance of DR images. The experimental results based on Kaggle APTOS 2019 contest dataset show that our proposed method for DR severity classification achieves an accuracy of 85.32%, a kappa statistic of 77.26%, and an AUC of 0.97. The comparison results also indicate that the model obtained is superior to the existing models and presents superior classification performance on the dataset.
first_indexed 2024-03-10T10:38:15Z
format Article
id doaj.art-9d71056acab14f3398003d3701da8f68
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-10T10:38:15Z
publishDate 2021-06-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-9d71056acab14f3398003d3701da8f682023-11-21T23:10:56ZengMDPI AGElectronics2079-92922021-06-011012136910.3390/electronics10121369Multi-Scale Feature Fusion with Adaptive Weighting for Diabetic Retinopathy Severity ClassificationRunze Fan0Yuhong Liu1Rongfen Zhang2College of Big Data and Information Engineering, Guizhou University, Guiyang 550025, ChinaCollege of Big Data and Information Engineering, Guizhou University, Guiyang 550025, ChinaCollege of Big Data and Information Engineering, Guizhou University, Guiyang 550025, ChinaDiabetic retinopathy (DR) is the prime cause of blindness in people who suffer from diabetes. Automation of DR diagnosis could help a lot of patients avoid the risk of blindness by identifying the disease and making judgments at an early stage. The main focus of the present work is to propose a feasible scheme of DR severity level detection under the MobileNetV3 backbone network based on a multi-scale feature of the retinal fundus image and improve the classification performance of the model. Firstly, a special residual attention module RCAM for multi-scale feature extraction from different convolution layers was designed. Then, the feature fusion by an innovative operation of adaptive weighting was carried out in each layer. The corresponding weight of the convolution block is updated in the model training automatically, with further global average pooling (GAP) and division process to avoid over-fitting of the model and removing non-critical features. In addition, Focal Loss is used as a loss function due to the data imbalance of DR images. The experimental results based on Kaggle APTOS 2019 contest dataset show that our proposed method for DR severity classification achieves an accuracy of 85.32%, a kappa statistic of 77.26%, and an AUC of 0.97. The comparison results also indicate that the model obtained is superior to the existing models and presents superior classification performance on the dataset.https://www.mdpi.com/2079-9292/10/12/1369diabetic retinopathymulti-scale featureattention moduleadaptive weightingfeature fusion
spellingShingle Runze Fan
Yuhong Liu
Rongfen Zhang
Multi-Scale Feature Fusion with Adaptive Weighting for Diabetic Retinopathy Severity Classification
Electronics
diabetic retinopathy
multi-scale feature
attention module
adaptive weighting
feature fusion
title Multi-Scale Feature Fusion with Adaptive Weighting for Diabetic Retinopathy Severity Classification
title_full Multi-Scale Feature Fusion with Adaptive Weighting for Diabetic Retinopathy Severity Classification
title_fullStr Multi-Scale Feature Fusion with Adaptive Weighting for Diabetic Retinopathy Severity Classification
title_full_unstemmed Multi-Scale Feature Fusion with Adaptive Weighting for Diabetic Retinopathy Severity Classification
title_short Multi-Scale Feature Fusion with Adaptive Weighting for Diabetic Retinopathy Severity Classification
title_sort multi scale feature fusion with adaptive weighting for diabetic retinopathy severity classification
topic diabetic retinopathy
multi-scale feature
attention module
adaptive weighting
feature fusion
url https://www.mdpi.com/2079-9292/10/12/1369
work_keys_str_mv AT runzefan multiscalefeaturefusionwithadaptiveweightingfordiabeticretinopathyseverityclassification
AT yuhongliu multiscalefeaturefusionwithadaptiveweightingfordiabeticretinopathyseverityclassification
AT rongfenzhang multiscalefeaturefusionwithadaptiveweightingfordiabeticretinopathyseverityclassification