GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn
Burns constitute one of the most common injuries in the world, and they can be very painful for the patient. Especially in the judgment of superficial partial thickness burns and deep partial thickness burns, many inexperienced clinicians are easily confused. Therefore, in order to make burn depth c...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
AIMS Press
2023-03-01
|
| Series: | Mathematical Biosciences and Engineering |
| Subjects: | |
| Online Access: | https://www.aimspress.com/article/doi/10.3934/mbe.2023445?viewType=HTML |
| _version_ | 1797842345788440576 |
|---|---|
| author | Zhiwei Li Jie Huang Xirui Tong Chenbei Zhang Jianyu Lu Wei Zhang Anping Song Shizhao Ji |
| author_facet | Zhiwei Li Jie Huang Xirui Tong Chenbei Zhang Jianyu Lu Wei Zhang Anping Song Shizhao Ji |
| author_sort | Zhiwei Li |
| collection | DOAJ |
| description | Burns constitute one of the most common injuries in the world, and they can be very painful for the patient. Especially in the judgment of superficial partial thickness burns and deep partial thickness burns, many inexperienced clinicians are easily confused. Therefore, in order to make burn depth classification automated as well as accurate, we have introduced the deep learning method. This methodology uses a U-Net to segment burn wounds. On this basis, a new thickness burn classification model that fuses global and local features (GL-FusionNet) is proposed. For the thickness burn classification model, we use a ResNet50 to extract local features, use a ResNet101 to extract global features, and finally implement the add method to perform feature fusion and obtain the deep partial or superficial partial thickness burn classification results. Burns images are collected clinically, and they are segmented and labeled by professional physicians. Among the segmentation methods, the U-Net used achieved a Dice score of 85.352 and IoU score of 83.916, which are the best results among all of the comparative experiments. In the classification model, different existing classification networks are mainly used, as well as a fusion strategy and feature extraction method that are adjusted to conduct experiments; the proposed fusion network model also achieved the best results. Our method yielded the following: accuracy of 93.523, recall of 93.67, precision of 93.51, and F1-score of 93.513. In addition, the proposed method can quickly complete the auxiliary diagnosis of the wound in the clinic, which can greatly improve the efficiency of the initial diagnosis of burns and the nursing care of clinical medical staff. |
| first_indexed | 2024-04-09T16:46:23Z |
| format | Article |
| id | doaj.art-f157bedafda24541a8c9f49dd6c96603 |
| institution | Directory Open Access Journal |
| issn | 1551-0018 |
| language | English |
| last_indexed | 2024-04-09T16:46:23Z |
| publishDate | 2023-03-01 |
| publisher | AIMS Press |
| record_format | Article |
| series | Mathematical Biosciences and Engineering |
| spelling | doaj.art-f157bedafda24541a8c9f49dd6c966032023-04-23T01:12:20ZengAIMS PressMathematical Biosciences and Engineering1551-00182023-03-01206101531017310.3934/mbe.2023445GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burnZhiwei Li0Jie Huang1Xirui Tong2Chenbei Zhang3Jianyu Lu4Wei Zhang5Anping Song6Shizhao Ji71. School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China2. Department of Burn Surgery, the First Affiliated Hospital of Naval Medical University, Shanghai 200444, China2. Department of Burn Surgery, the First Affiliated Hospital of Naval Medical University, Shanghai 200444, China1. School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China2. Department of Burn Surgery, the First Affiliated Hospital of Naval Medical University, Shanghai 200444, China2. Department of Burn Surgery, the First Affiliated Hospital of Naval Medical University, Shanghai 200444, China1. School of Computer Engineering and Science, Shanghai University, Shanghai 200444, China2. Department of Burn Surgery, the First Affiliated Hospital of Naval Medical University, Shanghai 200444, ChinaBurns constitute one of the most common injuries in the world, and they can be very painful for the patient. Especially in the judgment of superficial partial thickness burns and deep partial thickness burns, many inexperienced clinicians are easily confused. Therefore, in order to make burn depth classification automated as well as accurate, we have introduced the deep learning method. This methodology uses a U-Net to segment burn wounds. On this basis, a new thickness burn classification model that fuses global and local features (GL-FusionNet) is proposed. For the thickness burn classification model, we use a ResNet50 to extract local features, use a ResNet101 to extract global features, and finally implement the add method to perform feature fusion and obtain the deep partial or superficial partial thickness burn classification results. Burns images are collected clinically, and they are segmented and labeled by professional physicians. Among the segmentation methods, the U-Net used achieved a Dice score of 85.352 and IoU score of 83.916, which are the best results among all of the comparative experiments. In the classification model, different existing classification networks are mainly used, as well as a fusion strategy and feature extraction method that are adjusted to conduct experiments; the proposed fusion network model also achieved the best results. Our method yielded the following: accuracy of 93.523, recall of 93.67, precision of 93.51, and F1-score of 93.513. In addition, the proposed method can quickly complete the auxiliary diagnosis of the wound in the clinic, which can greatly improve the efficiency of the initial diagnosis of burns and the nursing care of clinical medical staff.https://www.aimspress.com/article/doi/10.3934/mbe.2023445?viewType=HTMLburn depthdeep learningpartial thickness burnsfeature fusionimage classification |
| spellingShingle | Zhiwei Li Jie Huang Xirui Tong Chenbei Zhang Jianyu Lu Wei Zhang Anping Song Shizhao Ji GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn Mathematical Biosciences and Engineering burn depth deep learning partial thickness burns feature fusion image classification |
| title | GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn |
| title_full | GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn |
| title_fullStr | GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn |
| title_full_unstemmed | GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn |
| title_short | GL-FusionNet: Fusing global and local features to classify deep and superficial partial thickness burn |
| title_sort | gl fusionnet fusing global and local features to classify deep and superficial partial thickness burn |
| topic | burn depth deep learning partial thickness burns feature fusion image classification |
| url | https://www.aimspress.com/article/doi/10.3934/mbe.2023445?viewType=HTML |
| work_keys_str_mv | AT zhiweili glfusionnetfusingglobalandlocalfeaturestoclassifydeepandsuperficialpartialthicknessburn AT jiehuang glfusionnetfusingglobalandlocalfeaturestoclassifydeepandsuperficialpartialthicknessburn AT xiruitong glfusionnetfusingglobalandlocalfeaturestoclassifydeepandsuperficialpartialthicknessburn AT chenbeizhang glfusionnetfusingglobalandlocalfeaturestoclassifydeepandsuperficialpartialthicknessburn AT jianyulu glfusionnetfusingglobalandlocalfeaturestoclassifydeepandsuperficialpartialthicknessburn AT weizhang glfusionnetfusingglobalandlocalfeaturestoclassifydeepandsuperficialpartialthicknessburn AT anpingsong glfusionnetfusingglobalandlocalfeaturestoclassifydeepandsuperficialpartialthicknessburn AT shizhaoji glfusionnetfusingglobalandlocalfeaturestoclassifydeepandsuperficialpartialthicknessburn |