Deep Learning Network with Spatial Attention Module for Detecting Acute Bilirubin Encephalopathy in Newborns Based on Multimodal MRI
Background: Acute bilirubin encephalopathy (ABE) is a significant cause of neonatal mortality and disability. Early detection and treatment of ABE can prevent the further development of ABE and its long-term complications. Due to the limited classification ability of single-modal magnetic resonance...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-04-01
|
| Series: | Diagnostics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2075-4418/13/9/1577 |
| _version_ | 1797602841817251840 |
|---|---|
| author | Huan Zhang Yi Zhuang Shunren Xia Haoxiang Jiang |
| author_facet | Huan Zhang Yi Zhuang Shunren Xia Haoxiang Jiang |
| author_sort | Huan Zhang |
| collection | DOAJ |
| description | Background: Acute bilirubin encephalopathy (ABE) is a significant cause of neonatal mortality and disability. Early detection and treatment of ABE can prevent the further development of ABE and its long-term complications. Due to the limited classification ability of single-modal magnetic resonance imaging (MRI), this study aimed to validate the classification performance of a new deep learning model based on multimodal MRI images. Additionally, the study evaluated the effect of a spatial attention module (SAM) on improving the model’s diagnostic performance in distinguishing ABE. Methods: This study enrolled a total of 97 neonates diagnosed with ABE and 80 neonates diagnosed with hyperbilirubinemia (HB, non-ABE). Each patient underwent three types of multimodal imaging, which included T1-weighted imaging (T1WI), T2-weighted imaging (T2WI), and an apparent diffusion coefficient (ADC) map. A multimodal MRI classification model based on the ResNet18 network with spatial attention modules was built to distinguish ABE from non-ABE. All combinations of the three types of images were used as inputs to test the model’s classification performance, and we also analyzed the prediction performance of models with SAMs through comparative experiments. Results: The results indicated that the diagnostic performance of the multimodal image combination was better than any single-modal image, and the combination of T1WI and T2WI achieved the best classification performance (accuracy = 0.808 ± 0.069, area under the curve = 0.808 ± 0.057). The ADC images performed the worst among the three modalities’ images. Adding spatial attention modules significantly improved the model’s classification performance. Conclusion: Our experiment showed that a multimodal image classification network with spatial attention modules significantly improved the accuracy of ABE classification. |
| first_indexed | 2024-03-11T04:21:08Z |
| format | Article |
| id | doaj.art-62f04245f8ee4639aea07992c999771f |
| institution | Directory Open Access Journal |
| issn | 2075-4418 |
| language | English |
| last_indexed | 2024-03-11T04:21:08Z |
| publishDate | 2023-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Diagnostics |
| spelling | doaj.art-62f04245f8ee4639aea07992c999771f2023-11-17T22:45:35ZengMDPI AGDiagnostics2075-44182023-04-01139157710.3390/diagnostics13091577Deep Learning Network with Spatial Attention Module for Detecting Acute Bilirubin Encephalopathy in Newborns Based on Multimodal MRIHuan Zhang0Yi Zhuang1Shunren Xia2Haoxiang Jiang3Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, ChinaDepartment of Radiology, Affiliated Children’s Hospital of Jiangnan University, Wuxi 214036, ChinaKey Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou 310027, ChinaDepartment of Radiology, Affiliated Children’s Hospital of Jiangnan University, Wuxi 214036, ChinaBackground: Acute bilirubin encephalopathy (ABE) is a significant cause of neonatal mortality and disability. Early detection and treatment of ABE can prevent the further development of ABE and its long-term complications. Due to the limited classification ability of single-modal magnetic resonance imaging (MRI), this study aimed to validate the classification performance of a new deep learning model based on multimodal MRI images. Additionally, the study evaluated the effect of a spatial attention module (SAM) on improving the model’s diagnostic performance in distinguishing ABE. Methods: This study enrolled a total of 97 neonates diagnosed with ABE and 80 neonates diagnosed with hyperbilirubinemia (HB, non-ABE). Each patient underwent three types of multimodal imaging, which included T1-weighted imaging (T1WI), T2-weighted imaging (T2WI), and an apparent diffusion coefficient (ADC) map. A multimodal MRI classification model based on the ResNet18 network with spatial attention modules was built to distinguish ABE from non-ABE. All combinations of the three types of images were used as inputs to test the model’s classification performance, and we also analyzed the prediction performance of models with SAMs through comparative experiments. Results: The results indicated that the diagnostic performance of the multimodal image combination was better than any single-modal image, and the combination of T1WI and T2WI achieved the best classification performance (accuracy = 0.808 ± 0.069, area under the curve = 0.808 ± 0.057). The ADC images performed the worst among the three modalities’ images. Adding spatial attention modules significantly improved the model’s classification performance. Conclusion: Our experiment showed that a multimodal image classification network with spatial attention modules significantly improved the accuracy of ABE classification.https://www.mdpi.com/2075-4418/13/9/1577residual networkspatial attention moduleacute bilirubin encephalopathynewborn |
| spellingShingle | Huan Zhang Yi Zhuang Shunren Xia Haoxiang Jiang Deep Learning Network with Spatial Attention Module for Detecting Acute Bilirubin Encephalopathy in Newborns Based on Multimodal MRI Diagnostics residual network spatial attention module acute bilirubin encephalopathy newborn |
| title | Deep Learning Network with Spatial Attention Module for Detecting Acute Bilirubin Encephalopathy in Newborns Based on Multimodal MRI |
| title_full | Deep Learning Network with Spatial Attention Module for Detecting Acute Bilirubin Encephalopathy in Newborns Based on Multimodal MRI |
| title_fullStr | Deep Learning Network with Spatial Attention Module for Detecting Acute Bilirubin Encephalopathy in Newborns Based on Multimodal MRI |
| title_full_unstemmed | Deep Learning Network with Spatial Attention Module for Detecting Acute Bilirubin Encephalopathy in Newborns Based on Multimodal MRI |
| title_short | Deep Learning Network with Spatial Attention Module for Detecting Acute Bilirubin Encephalopathy in Newborns Based on Multimodal MRI |
| title_sort | deep learning network with spatial attention module for detecting acute bilirubin encephalopathy in newborns based on multimodal mri |
| topic | residual network spatial attention module acute bilirubin encephalopathy newborn |
| url | https://www.mdpi.com/2075-4418/13/9/1577 |
| work_keys_str_mv | AT huanzhang deeplearningnetworkwithspatialattentionmodulefordetectingacutebilirubinencephalopathyinnewbornsbasedonmultimodalmri AT yizhuang deeplearningnetworkwithspatialattentionmodulefordetectingacutebilirubinencephalopathyinnewbornsbasedonmultimodalmri AT shunrenxia deeplearningnetworkwithspatialattentionmodulefordetectingacutebilirubinencephalopathyinnewbornsbasedonmultimodalmri AT haoxiangjiang deeplearningnetworkwithspatialattentionmodulefordetectingacutebilirubinencephalopathyinnewbornsbasedonmultimodalmri |