TAGU-Net: Transformer Convolution Hybrid-Based U-Net With Attention Gate for Atypical Meningioma Segmentation
Meningioma is derived from the cap cells that reside on the arachnoid membrane. The atypical meninges of Grade II, a classification established by the World Health Organization, are included in one of the grades of meningioma. It has been discovered that early surgical resection significantly reduce...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10113859/ |
| _version_ | 1827931211942592512 |
|---|---|
| author | Hong Huang Panpan Liu Jie Liu |
| author_facet | Hong Huang Panpan Liu Jie Liu |
| author_sort | Hong Huang |
| collection | DOAJ |
| description | Meningioma is derived from the cap cells that reside on the arachnoid membrane. The atypical meninges of Grade II, a classification established by the World Health Organization, are included in one of the grades of meningioma. It has been discovered that early surgical resection significantly reduces the recurrence rate and mortality of tumors. Accurate segmentation of magnetic resonance images of brain tumors is crucial for diagnosing and treating atypical meningiomas. However, the traditional automatic segmentation framework heavily relies on convolution. The convolution-based segmentation network has limitations such as the size of the convolution kernels, a restricted receptive field, and a lack of spatial aggregation ability. To overcome these limitations, this paper presents a novel hybrid architecture named TAGU-Net, which combines Transformer and convolution based on U-Net with an attention gate. The TAGU-Net architecture extracts features of different resolution feature scales using convolutional neural network and Transformer. This approach effectively captures the image’s long-distance dependency and global characteristics in the encoder stage, relying on the global self-attention mechanism of the Transformer. Additionally, the inductive bias of the convolution neural network is combined to enhance the local modeling information and improve the model’s overall modeling ability. In the decoder phase, the attention gate is introduced to adaptively learn the skip connection information and up-sampling information in the network. This information is weighted and fused to highlight important features and suppress irrelevant features. To obtain better model training and avoid the vanishing gradient, deep supervision technology is used in the training process. Supplementary loss is added in some stages to supervise the training and achieve the best effect of atypical meningioma segmentation. The proposed method is evaluated on both the private atypical meningioma dataset and the publicly available BraTs2018 dataset.TAGU-Net has achieved Dice Scores of 97.67% and 97.62% and Jaccard index of 96.35% and 95.35% on the private atypical meningioma dataset and BraTs2018 dataset respectively, which is a state-of-the-art segmentation result beyond existing methods. According to the research results, the TAGU-Net model significantly improves atypical meningioma segmentation and can effectively assist doctors in processing MRI images. |
| first_indexed | 2024-03-13T06:48:05Z |
| format | Article |
| id | doaj.art-1b6fc2ea39a44603a2bb49607fb649e0 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T06:48:05Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-1b6fc2ea39a44603a2bb49607fb649e02023-06-07T23:00:19ZengIEEEIEEE Access2169-35362023-01-0111532075322310.1109/ACCESS.2023.327235210113859TAGU-Net: Transformer Convolution Hybrid-Based U-Net With Attention Gate for Atypical Meningioma SegmentationHong Huang0https://orcid.org/0000-0001-8157-7714Panpan Liu1https://orcid.org/0009-0003-9559-2351Jie Liu2https://orcid.org/0009-0003-2917-0070School of Mechanical, Electrical and Information Engineering, Shandong University, Shandong, Weihai, ChinaDepartment of Neurosurgery, Weihai Municipal Hospital, Shandong University, Shandong, Weihai, ChinaSchool of Mechanical, Electrical and Information Engineering, Shandong University, Shandong, Weihai, ChinaMeningioma is derived from the cap cells that reside on the arachnoid membrane. The atypical meninges of Grade II, a classification established by the World Health Organization, are included in one of the grades of meningioma. It has been discovered that early surgical resection significantly reduces the recurrence rate and mortality of tumors. Accurate segmentation of magnetic resonance images of brain tumors is crucial for diagnosing and treating atypical meningiomas. However, the traditional automatic segmentation framework heavily relies on convolution. The convolution-based segmentation network has limitations such as the size of the convolution kernels, a restricted receptive field, and a lack of spatial aggregation ability. To overcome these limitations, this paper presents a novel hybrid architecture named TAGU-Net, which combines Transformer and convolution based on U-Net with an attention gate. The TAGU-Net architecture extracts features of different resolution feature scales using convolutional neural network and Transformer. This approach effectively captures the image’s long-distance dependency and global characteristics in the encoder stage, relying on the global self-attention mechanism of the Transformer. Additionally, the inductive bias of the convolution neural network is combined to enhance the local modeling information and improve the model’s overall modeling ability. In the decoder phase, the attention gate is introduced to adaptively learn the skip connection information and up-sampling information in the network. This information is weighted and fused to highlight important features and suppress irrelevant features. To obtain better model training and avoid the vanishing gradient, deep supervision technology is used in the training process. Supplementary loss is added in some stages to supervise the training and achieve the best effect of atypical meningioma segmentation. The proposed method is evaluated on both the private atypical meningioma dataset and the publicly available BraTs2018 dataset.TAGU-Net has achieved Dice Scores of 97.67% and 97.62% and Jaccard index of 96.35% and 95.35% on the private atypical meningioma dataset and BraTs2018 dataset respectively, which is a state-of-the-art segmentation result beyond existing methods. According to the research results, the TAGU-Net model significantly improves atypical meningioma segmentation and can effectively assist doctors in processing MRI images.https://ieeexplore.ieee.org/document/10113859/U-Netatypical meningioma segmentationtransformerMRIattention gate |
| spellingShingle | Hong Huang Panpan Liu Jie Liu TAGU-Net: Transformer Convolution Hybrid-Based U-Net With Attention Gate for Atypical Meningioma Segmentation IEEE Access U-Net atypical meningioma segmentation transformer MRI attention gate |
| title | TAGU-Net: Transformer Convolution Hybrid-Based U-Net With Attention Gate for Atypical Meningioma Segmentation |
| title_full | TAGU-Net: Transformer Convolution Hybrid-Based U-Net With Attention Gate for Atypical Meningioma Segmentation |
| title_fullStr | TAGU-Net: Transformer Convolution Hybrid-Based U-Net With Attention Gate for Atypical Meningioma Segmentation |
| title_full_unstemmed | TAGU-Net: Transformer Convolution Hybrid-Based U-Net With Attention Gate for Atypical Meningioma Segmentation |
| title_short | TAGU-Net: Transformer Convolution Hybrid-Based U-Net With Attention Gate for Atypical Meningioma Segmentation |
| title_sort | tagu net transformer convolution hybrid based u net with attention gate for atypical meningioma segmentation |
| topic | U-Net atypical meningioma segmentation transformer MRI attention gate |
| url | https://ieeexplore.ieee.org/document/10113859/ |
| work_keys_str_mv | AT honghuang tagunettransformerconvolutionhybridbasedunetwithattentiongateforatypicalmeningiomasegmentation AT panpanliu tagunettransformerconvolutionhybridbasedunetwithattentiongateforatypicalmeningiomasegmentation AT jieliu tagunettransformerconvolutionhybridbasedunetwithattentiongateforatypicalmeningiomasegmentation |