Advancing bag-of-visual-words representations for lesion classification in retinal images.

Diabetic Retinopathy (DR) is a complication of diabetes that can lead to blindness if not readily discovered. Automated screening algorithms have the potential to improve identification of patients who need further medical attention. However, the identification of lesions must be accurate to be usef...

Full description

Bibliographic Details
Main Authors: Ramon Pires, Herbert F Jelinek, Jacques Wainer, Eduardo Valle, Anderson Rocha
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2014-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC4041723?pdf=render
_version_ 1818279567148711936
author Ramon Pires
Herbert F Jelinek
Jacques Wainer
Eduardo Valle
Anderson Rocha
author_facet Ramon Pires
Herbert F Jelinek
Jacques Wainer
Eduardo Valle
Anderson Rocha
author_sort Ramon Pires
collection DOAJ
description Diabetic Retinopathy (DR) is a complication of diabetes that can lead to blindness if not readily discovered. Automated screening algorithms have the potential to improve identification of patients who need further medical attention. However, the identification of lesions must be accurate to be useful for clinical application. The bag-of-visual-words (BoVW) algorithm employs a maximum-margin classifier in a flexible framework that is able to detect the most common DR-related lesions such as microaneurysms, cotton-wool spots and hard exudates. BoVW allows to bypass the need for pre- and post-processing of the retinographic images, as well as the need of specific ad hoc techniques for identification of each type of lesion. An extensive evaluation of the BoVW model, using three large retinograph datasets (DR1, DR2 and Messidor) with different resolution and collected by different healthcare personnel, was performed. The results demonstrate that the BoVW classification approach can identify different lesions within an image without having to utilize different algorithms for each lesion reducing processing time and providing a more flexible diagnostic system. Our BoVW scheme is based on sparse low-level feature detection with a Speeded-Up Robust Features (SURF) local descriptor, and mid-level features based on semi-soft coding with max pooling. The best BoVW representation for retinal image classification was an area under the receiver operating characteristic curve (AUC-ROC) of 97.8% (exudates) and 93.5% (red lesions), applying a cross-dataset validation protocol. To assess the accuracy for detecting cases that require referral within one year, the sparse extraction technique associated with semi-soft coding and max pooling obtained an AUC of 94.2 ± 2.0%, outperforming current methods. Those results indicate that, for retinal image classification tasks in clinical practice, BoVW is equal and, in some instances, surpasses results obtained using dense detection (widely believed to be the best choice in many vision problems) for the low-level descriptors.
first_indexed 2024-12-12T23:35:23Z
format Article
id doaj.art-ff412abecd854ec2aa5d4c8e53e6b7d0
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-12-12T23:35:23Z
publishDate 2014-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-ff412abecd854ec2aa5d4c8e53e6b7d02022-12-22T00:07:31ZengPublic Library of Science (PLoS)PLoS ONE1932-62032014-01-0196e9681410.1371/journal.pone.0096814Advancing bag-of-visual-words representations for lesion classification in retinal images.Ramon PiresHerbert F JelinekJacques WainerEduardo ValleAnderson RochaDiabetic Retinopathy (DR) is a complication of diabetes that can lead to blindness if not readily discovered. Automated screening algorithms have the potential to improve identification of patients who need further medical attention. However, the identification of lesions must be accurate to be useful for clinical application. The bag-of-visual-words (BoVW) algorithm employs a maximum-margin classifier in a flexible framework that is able to detect the most common DR-related lesions such as microaneurysms, cotton-wool spots and hard exudates. BoVW allows to bypass the need for pre- and post-processing of the retinographic images, as well as the need of specific ad hoc techniques for identification of each type of lesion. An extensive evaluation of the BoVW model, using three large retinograph datasets (DR1, DR2 and Messidor) with different resolution and collected by different healthcare personnel, was performed. The results demonstrate that the BoVW classification approach can identify different lesions within an image without having to utilize different algorithms for each lesion reducing processing time and providing a more flexible diagnostic system. Our BoVW scheme is based on sparse low-level feature detection with a Speeded-Up Robust Features (SURF) local descriptor, and mid-level features based on semi-soft coding with max pooling. The best BoVW representation for retinal image classification was an area under the receiver operating characteristic curve (AUC-ROC) of 97.8% (exudates) and 93.5% (red lesions), applying a cross-dataset validation protocol. To assess the accuracy for detecting cases that require referral within one year, the sparse extraction technique associated with semi-soft coding and max pooling obtained an AUC of 94.2 ± 2.0%, outperforming current methods. Those results indicate that, for retinal image classification tasks in clinical practice, BoVW is equal and, in some instances, surpasses results obtained using dense detection (widely believed to be the best choice in many vision problems) for the low-level descriptors.http://europepmc.org/articles/PMC4041723?pdf=render
spellingShingle Ramon Pires
Herbert F Jelinek
Jacques Wainer
Eduardo Valle
Anderson Rocha
Advancing bag-of-visual-words representations for lesion classification in retinal images.
PLoS ONE
title Advancing bag-of-visual-words representations for lesion classification in retinal images.
title_full Advancing bag-of-visual-words representations for lesion classification in retinal images.
title_fullStr Advancing bag-of-visual-words representations for lesion classification in retinal images.
title_full_unstemmed Advancing bag-of-visual-words representations for lesion classification in retinal images.
title_short Advancing bag-of-visual-words representations for lesion classification in retinal images.
title_sort advancing bag of visual words representations for lesion classification in retinal images
url http://europepmc.org/articles/PMC4041723?pdf=render
work_keys_str_mv AT ramonpires advancingbagofvisualwordsrepresentationsforlesionclassificationinretinalimages
AT herbertfjelinek advancingbagofvisualwordsrepresentationsforlesionclassificationinretinalimages
AT jacqueswainer advancingbagofvisualwordsrepresentationsforlesionclassificationinretinalimages
AT eduardovalle advancingbagofvisualwordsrepresentationsforlesionclassificationinretinalimages
AT andersonrocha advancingbagofvisualwordsrepresentationsforlesionclassificationinretinalimages