Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural Network
Breast cancer profoundly affects women’s lives; its early diagnosis and treatment increase patient survival chances. Mammography is a common screening method for breast cancer, and many methods have been proposed for automatic diagnosis. However, most of them focus on single-label classification and...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-12-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/24/12995 |
| _version_ | 1797382157738442752 |
|---|---|
| author | Ebtihal Al-Mansour Muhammad Hussain Hatim A. Aboalsamh Saad A. Al-Ahmadi |
| author_facet | Ebtihal Al-Mansour Muhammad Hussain Hatim A. Aboalsamh Saad A. Al-Ahmadi |
| author_sort | Ebtihal Al-Mansour |
| collection | DOAJ |
| description | Breast cancer profoundly affects women’s lives; its early diagnosis and treatment increase patient survival chances. Mammography is a common screening method for breast cancer, and many methods have been proposed for automatic diagnosis. However, most of them focus on single-label classification and do not provide a comprehensive analysis concerning density, abnormality, and severity levels. We propose a method based on the multi-label classification of two-view mammography images to comprehensively diagnose a patient’s condition. It leverages the correlation between density type, lesion type, and states of lesions, which radiologists usually perform. It simultaneously classifies mammograms into the corresponding density, abnormality type, and severity level. It takes two-view mammograms (with craniocaudal and mediolateral oblique views) as input, analyzes them using ConvNeXt and the channel attention mechanism, and integrates the information from the two views. Finally, the fused information is passed to task-specific multi-branches, which learn task-specific representations and predict the relevant state. The system was trained, validated, and tested using two public domain benchmark datasets, INBreast and the Curated Breast Imaging Subset of DDSM (CBIS-DDSM), and achieved state-of-the-art results. The proposed computer-aided diagnosis (CAD) system provides a holistic observation of a patient’s condition. It gives the radiologists a comprehensive analysis of the mammograms to prepare a full report of the patient’s condition, thereby increasing the diagnostic precision. |
| first_indexed | 2024-03-08T21:02:18Z |
| format | Article |
| id | doaj.art-2b25d9bec66f4cfd94d2c6dc56458ccf |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-08T21:02:18Z |
| publishDate | 2023-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-2b25d9bec66f4cfd94d2c6dc56458ccf2023-12-22T13:50:03ZengMDPI AGApplied Sciences2076-34172023-12-0113241299510.3390/app132412995Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural NetworkEbtihal Al-Mansour0Muhammad Hussain1Hatim A. Aboalsamh2Saad A. Al-Ahmadi3Department of Computer Science, CCIS, King Saud University, Riyadh 11451, Saudi ArabiaDepartment of Computer Science, CCIS, King Saud University, Riyadh 11451, Saudi ArabiaDepartment of Computer Science, CCIS, King Saud University, Riyadh 11451, Saudi ArabiaDepartment of Computer Science, CCIS, King Saud University, Riyadh 11451, Saudi ArabiaBreast cancer profoundly affects women’s lives; its early diagnosis and treatment increase patient survival chances. Mammography is a common screening method for breast cancer, and many methods have been proposed for automatic diagnosis. However, most of them focus on single-label classification and do not provide a comprehensive analysis concerning density, abnormality, and severity levels. We propose a method based on the multi-label classification of two-view mammography images to comprehensively diagnose a patient’s condition. It leverages the correlation between density type, lesion type, and states of lesions, which radiologists usually perform. It simultaneously classifies mammograms into the corresponding density, abnormality type, and severity level. It takes two-view mammograms (with craniocaudal and mediolateral oblique views) as input, analyzes them using ConvNeXt and the channel attention mechanism, and integrates the information from the two views. Finally, the fused information is passed to task-specific multi-branches, which learn task-specific representations and predict the relevant state. The system was trained, validated, and tested using two public domain benchmark datasets, INBreast and the Curated Breast Imaging Subset of DDSM (CBIS-DDSM), and achieved state-of-the-art results. The proposed computer-aided diagnosis (CAD) system provides a holistic observation of a patient’s condition. It gives the radiologists a comprehensive analysis of the mammograms to prepare a full report of the patient’s condition, thereby increasing the diagnostic precision.https://www.mdpi.com/2076-3417/13/24/12995breast cancermammographydeep learningmulti-label classificationconvolutional neural network (CNN) |
| spellingShingle | Ebtihal Al-Mansour Muhammad Hussain Hatim A. Aboalsamh Saad A. Al-Ahmadi Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural Network Applied Sciences breast cancer mammography deep learning multi-label classification convolutional neural network (CNN) |
| title | Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural Network |
| title_full | Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural Network |
| title_fullStr | Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural Network |
| title_full_unstemmed | Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural Network |
| title_short | Comprehensive Analysis of Mammography Images Using Multi-Branch Attention Convolutional Neural Network |
| title_sort | comprehensive analysis of mammography images using multi branch attention convolutional neural network |
| topic | breast cancer mammography deep learning multi-label classification convolutional neural network (CNN) |
| url | https://www.mdpi.com/2076-3417/13/24/12995 |
| work_keys_str_mv | AT ebtihalalmansour comprehensiveanalysisofmammographyimagesusingmultibranchattentionconvolutionalneuralnetwork AT muhammadhussain comprehensiveanalysisofmammographyimagesusingmultibranchattentionconvolutionalneuralnetwork AT hatimaaboalsamh comprehensiveanalysisofmammographyimagesusingmultibranchattentionconvolutionalneuralnetwork AT saadaalahmadi comprehensiveanalysisofmammographyimagesusingmultibranchattentionconvolutionalneuralnetwork |