Generative Adversarial Networks for Anomaly Detection in Biomedical Imaging: A Study on Seven Medical Image Datasets

Anomaly detection (AD) is a challenging problem in computer vision. Particularly in the field of medical imaging, AD poses even more challenges due to a number of reasons, including insufficient availability of ground truth (annotated) data. In recent years, AD models based on generative adversarial...

Full description

Bibliographic Details
Main Authors: Marzieh Esmaeili, Amirhosein Toosi, Arash Roshanpoor, Vahid Changizi, Marjan Ghazisaeedi, Arman Rahmim, Mohammad Sabokrou
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10043696/
_version_ 1797894937375670272
author Marzieh Esmaeili
Amirhosein Toosi
Arash Roshanpoor
Vahid Changizi
Marjan Ghazisaeedi
Arman Rahmim
Mohammad Sabokrou
author_facet Marzieh Esmaeili
Amirhosein Toosi
Arash Roshanpoor
Vahid Changizi
Marjan Ghazisaeedi
Arman Rahmim
Mohammad Sabokrou
author_sort Marzieh Esmaeili
collection DOAJ
description Anomaly detection (AD) is a challenging problem in computer vision. Particularly in the field of medical imaging, AD poses even more challenges due to a number of reasons, including insufficient availability of ground truth (annotated) data. In recent years, AD models based on generative adversarial networks (GANs) have made significant progress. However, their effectiveness in biomedical imaging remains underexplored. In this paper, we present an overview of using GANs for AD, as well as an investigation of state-of-the-art GAN-based AD methods for biomedical imaging and the challenges encountered in detail. We have also specifically investigated the advantages and limitations of AD methods on medical image datasets, conducting experiments using 3 AD methods on 7 medical imaging datasets from different modalities and organs/tissues. Given the highly different findings achieved across these experiments, we further analyzed the results from both data-centric and model-centric points of view. The results showed that none of the methods had a reliable performance for detecting abnormalities in medical images. Factors such as the number of training samples, the subtlety of the anomaly, and the dispersion of the anomaly in the images are among the phenomena that highly impact the performance of the AD models. The obtained results were highly variable (AUC: 0.475-0.991; Sensitivity: 0.17-0.98; Specificity: 0.14-0.97). In addition, we provide recommendations for the deployment of AD models in medical imaging and foresee important research directions.
first_indexed 2024-04-10T07:18:29Z
format Article
id doaj.art-5d1205963ab149fe8fea25a72efe6ad8
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-10T07:18:29Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-5d1205963ab149fe8fea25a72efe6ad82023-02-25T00:01:47ZengIEEEIEEE Access2169-35362023-01-0111179061792110.1109/ACCESS.2023.324474110043696Generative Adversarial Networks for Anomaly Detection in Biomedical Imaging: A Study on Seven Medical Image DatasetsMarzieh Esmaeili0https://orcid.org/0000-0002-3559-4852Amirhosein Toosi1Arash Roshanpoor2Vahid Changizi3Marjan Ghazisaeedi4https://orcid.org/0000-0002-2400-209XArman Rahmim5https://orcid.org/0000-0002-9980-2403Mohammad Sabokrou6https://orcid.org/0000-0002-9409-2799Department of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, IranDepartment of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, CanadaDepartment of Computer, Yadegar-e-Imam Khomeini, Janat-Abad Branch, Islamic Azad University, Tehran, IranDepartment of Radiology and Radiotherapy Technology, School of Allied Health Sciences, Tehran University of Medical Sciences, Tehran, IranDepartment of Health Information Management, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, IranDepartment of Integrative Oncology, BC Cancer Research Institute, Vancouver, BC, CanadaSchool of Computer Science, Institute for Research in Fundamental Sciences (IPM), Tehran, IranAnomaly detection (AD) is a challenging problem in computer vision. Particularly in the field of medical imaging, AD poses even more challenges due to a number of reasons, including insufficient availability of ground truth (annotated) data. In recent years, AD models based on generative adversarial networks (GANs) have made significant progress. However, their effectiveness in biomedical imaging remains underexplored. In this paper, we present an overview of using GANs for AD, as well as an investigation of state-of-the-art GAN-based AD methods for biomedical imaging and the challenges encountered in detail. We have also specifically investigated the advantages and limitations of AD methods on medical image datasets, conducting experiments using 3 AD methods on 7 medical imaging datasets from different modalities and organs/tissues. Given the highly different findings achieved across these experiments, we further analyzed the results from both data-centric and model-centric points of view. The results showed that none of the methods had a reliable performance for detecting abnormalities in medical images. Factors such as the number of training samples, the subtlety of the anomaly, and the dispersion of the anomaly in the images are among the phenomena that highly impact the performance of the AD models. The obtained results were highly variable (AUC: 0.475-0.991; Sensitivity: 0.17-0.98; Specificity: 0.14-0.97). In addition, we provide recommendations for the deployment of AD models in medical imaging and foresee important research directions.https://ieeexplore.ieee.org/document/10043696/Anomaly detectionartificial intelligencemachine learningdeep learningunsupervised anomaly detectiongenerative adversarial networks
spellingShingle Marzieh Esmaeili
Amirhosein Toosi
Arash Roshanpoor
Vahid Changizi
Marjan Ghazisaeedi
Arman Rahmim
Mohammad Sabokrou
Generative Adversarial Networks for Anomaly Detection in Biomedical Imaging: A Study on Seven Medical Image Datasets
IEEE Access
Anomaly detection
artificial intelligence
machine learning
deep learning
unsupervised anomaly detection
generative adversarial networks
title Generative Adversarial Networks for Anomaly Detection in Biomedical Imaging: A Study on Seven Medical Image Datasets
title_full Generative Adversarial Networks for Anomaly Detection in Biomedical Imaging: A Study on Seven Medical Image Datasets
title_fullStr Generative Adversarial Networks for Anomaly Detection in Biomedical Imaging: A Study on Seven Medical Image Datasets
title_full_unstemmed Generative Adversarial Networks for Anomaly Detection in Biomedical Imaging: A Study on Seven Medical Image Datasets
title_short Generative Adversarial Networks for Anomaly Detection in Biomedical Imaging: A Study on Seven Medical Image Datasets
title_sort generative adversarial networks for anomaly detection in biomedical imaging a study on seven medical image datasets
topic Anomaly detection
artificial intelligence
machine learning
deep learning
unsupervised anomaly detection
generative adversarial networks
url https://ieeexplore.ieee.org/document/10043696/
work_keys_str_mv AT marziehesmaeili generativeadversarialnetworksforanomalydetectioninbiomedicalimagingastudyonsevenmedicalimagedatasets
AT amirhoseintoosi generativeadversarialnetworksforanomalydetectioninbiomedicalimagingastudyonsevenmedicalimagedatasets
AT arashroshanpoor generativeadversarialnetworksforanomalydetectioninbiomedicalimagingastudyonsevenmedicalimagedatasets
AT vahidchangizi generativeadversarialnetworksforanomalydetectioninbiomedicalimagingastudyonsevenmedicalimagedatasets
AT marjanghazisaeedi generativeadversarialnetworksforanomalydetectioninbiomedicalimagingastudyonsevenmedicalimagedatasets
AT armanrahmim generativeadversarialnetworksforanomalydetectioninbiomedicalimagingastudyonsevenmedicalimagedatasets
AT mohammadsabokrou generativeadversarialnetworksforanomalydetectioninbiomedicalimagingastudyonsevenmedicalimagedatasets