TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network

Visual attribution (VA) methods play a crucial role in tuberculosis (TB) research by providing valuable insights into disease patterns and aiding in diagnostic interpretation. The advent of generative adversarial network (GAN)-based VA methods has gained significant attention from researchers due...

Full description

Bibliographic Details
Main Authors: Ding, Zeyu, Yaakob, Razali, Azman, Azreen, Mohd Rum, Siti Nurulain, Zakaria, Norfadhlina, Ahmad Nazri, Azree Shahril
Format: Article
Published: Little Lion Scientific 2023
_version_ 1817927623205978112
author Ding, Zeyu
Yaakob, Razali
Azman, Azreen
Mohd Rum, Siti Nurulain
Zakaria, Norfadhlina
Ahmad Nazri, Azree Shahril
author_facet Ding, Zeyu
Yaakob, Razali
Azman, Azreen
Mohd Rum, Siti Nurulain
Zakaria, Norfadhlina
Ahmad Nazri, Azree Shahril
author_sort Ding, Zeyu
collection UPM
description Visual attribution (VA) methods play a crucial role in tuberculosis (TB) research by providing valuable insights into disease patterns and aiding in diagnostic interpretation. The advent of generative adversarial network (GAN)-based VA methods has gained significant attention from researchers due to their ability to generate fine-grained feature maps that accurately reflect the location of lesions. These methods localize lesions by converting chest X-ray (CXR) images containing lesions into normal CXR images and analyzing the differences between the two. However, current methods only perform surface-level transformations, neglecting the vital information of whether lesions are present. Moreover, the transformation process assigns equal weights to the entire image, without specifically prioritizing the regions with a higher probability of lesions occurrence. In this study, a novel framework is proposed, namely the class activation mapping-guided tuberculosis visual attribution generative adversarial network (TBVA-GAN). This innovative model leverages the informative regions derived from class activation mapping to effectively guide the GAN in prioritizing the transformation of these crucial areas. Moreover, to guarantee the precision of TB localization, an auxiliary TB detection model is incorporated, ensuring that the converted CXR images are devoid of TB pathology. By employing this additional verification step, the accuracy of TB localization is significantly enhanced. The proposed TBVA-GAN in this study achieves promising VA results on the TBX11K dataset, surpassing existing GAN-based TB VA models.
first_indexed 2024-12-09T02:21:23Z
format Article
id upm.eprints-109108
institution Universiti Putra Malaysia
last_indexed 2024-12-09T02:21:23Z
publishDate 2023
publisher Little Lion Scientific
record_format dspace
spelling upm.eprints-1091082024-10-14T07:48:21Z http://psasir.upm.edu.my/id/eprint/109108/ TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network Ding, Zeyu Yaakob, Razali Azman, Azreen Mohd Rum, Siti Nurulain Zakaria, Norfadhlina Ahmad Nazri, Azree Shahril Visual attribution (VA) methods play a crucial role in tuberculosis (TB) research by providing valuable insights into disease patterns and aiding in diagnostic interpretation. The advent of generative adversarial network (GAN)-based VA methods has gained significant attention from researchers due to their ability to generate fine-grained feature maps that accurately reflect the location of lesions. These methods localize lesions by converting chest X-ray (CXR) images containing lesions into normal CXR images and analyzing the differences between the two. However, current methods only perform surface-level transformations, neglecting the vital information of whether lesions are present. Moreover, the transformation process assigns equal weights to the entire image, without specifically prioritizing the regions with a higher probability of lesions occurrence. In this study, a novel framework is proposed, namely the class activation mapping-guided tuberculosis visual attribution generative adversarial network (TBVA-GAN). This innovative model leverages the informative regions derived from class activation mapping to effectively guide the GAN in prioritizing the transformation of these crucial areas. Moreover, to guarantee the precision of TB localization, an auxiliary TB detection model is incorporated, ensuring that the converted CXR images are devoid of TB pathology. By employing this additional verification step, the accuracy of TB localization is significantly enhanced. The proposed TBVA-GAN in this study achieves promising VA results on the TBX11K dataset, surpassing existing GAN-based TB VA models. Little Lion Scientific 2023 Article PeerReviewed Ding, Zeyu and Yaakob, Razali and Azman, Azreen and Mohd Rum, Siti Nurulain and Zakaria, Norfadhlina and Ahmad Nazri, Azree Shahril (2023) TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network. Journal of Theoretical and Applied Information Technology, 101 (22). pp. 7275-7286. ISSN 1992-8645; ESSN: 1817-3195 https://www.jatit.org/volumes/hundredone22.php
spellingShingle Ding, Zeyu
Yaakob, Razali
Azman, Azreen
Mohd Rum, Siti Nurulain
Zakaria, Norfadhlina
Ahmad Nazri, Azree Shahril
TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network
title TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network
title_full TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network
title_fullStr TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network
title_full_unstemmed TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network
title_short TBVA-GAN: a class activation mapping-guided tuberculosis visual attribution generative adversarial network
title_sort tbva gan a class activation mapping guided tuberculosis visual attribution generative adversarial network
work_keys_str_mv AT dingzeyu tbvaganaclassactivationmappingguidedtuberculosisvisualattributiongenerativeadversarialnetwork
AT yaakobrazali tbvaganaclassactivationmappingguidedtuberculosisvisualattributiongenerativeadversarialnetwork
AT azmanazreen tbvaganaclassactivationmappingguidedtuberculosisvisualattributiongenerativeadversarialnetwork
AT mohdrumsitinurulain tbvaganaclassactivationmappingguidedtuberculosisvisualattributiongenerativeadversarialnetwork
AT zakarianorfadhlina tbvaganaclassactivationmappingguidedtuberculosisvisualattributiongenerativeadversarialnetwork
AT ahmadnazriazreeshahril tbvaganaclassactivationmappingguidedtuberculosisvisualattributiongenerativeadversarialnetwork