Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark Detection
Pelvic landmark detection is a significant pre-task to measure the clinical measurement in pelvic abnormality analysis. Accurate pelvic landmark detection could provide reliable clinical parameter measurement results, which are helpful for doctors to diagnose and treat pelvic diseases. However, the...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10335173/ |
| _version_ | 1797392269012107264 |
|---|---|
| author | Chenyang Lu Jiageng Zhao Wei Chen Xu Qiao Qingyun Zeng |
| author_facet | Chenyang Lu Jiageng Zhao Wei Chen Xu Qiao Qingyun Zeng |
| author_sort | Chenyang Lu |
| collection | DOAJ |
| description | Pelvic landmark detection is a significant pre-task to measure the clinical measurement in pelvic abnormality analysis. Accurate pelvic landmark detection could provide reliable clinical parameter measurement results, which are helpful for doctors to diagnose and treat pelvic diseases. However, the multi-scale characteristics, temporal diversity, and pathological abnormalities of different pelvic X-rays bring enormous challenges to the landmark detection task. In order to retain strong robustness in irregular pelvic X-rays, we propose a novel, flexible two-stage framework. In the initial stage, a single neural network is employed to estimate the locations of every landmark simultaneously, enabling the identification of potential landmark regions. Then, the receptive field of candidate region proposals is expanded by 4 times through the receptive field amplification module. In the second stage, the landmark detection module fuses semantically rich features at different scales through a multi-scale semantic fusion module. So that the framework can fully learn the strongly relevant semantic information around the landmark at high resolution. We collected a data set of 430 pelvic X-rays, including a large number of irregular pelvic X-rays, to evaluate our framework. The experimental results demonstrate that our framework achieves a state-of-the-art detection mean radial error of 3.724 ± 4.247-mm. The experimental results show that the proposed method can help doctors quickly and accurately find the characteristic points of the pelvis and could be applied to clinical diagnosis. |
| first_indexed | 2024-03-08T23:44:48Z |
| format | Article |
| id | doaj.art-85d7da69294143d4b27e3348a03e559a |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T23:44:48Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-85d7da69294143d4b27e3348a03e559a2023-12-14T00:01:54ZengIEEEIEEE Access2169-35362023-01-011113639513640910.1109/ACCESS.2023.333782410335173Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark DetectionChenyang Lu0https://orcid.org/0009-0005-8896-8853Jiageng Zhao1Wei Chen2https://orcid.org/0000-0002-1281-3389Xu Qiao3https://orcid.org/0000-0001-6854-7270Qingyun Zeng4https://orcid.org/0009-0008-0680-8402School of Control Science and Engineering, Shandong University, Jinan, ChinaMassage Department, Affiliated Hospital of Shandong University of Traditional Chinese Medicine, Jinan, ChinaDepartment of Radiology, Shandong First Medical University, Taian, ChinaSchool of Control Science and Engineering, Shandong University, Jinan, ChinaMassage Department, Affiliated Hospital of Shandong University of Traditional Chinese Medicine, Jinan, ChinaPelvic landmark detection is a significant pre-task to measure the clinical measurement in pelvic abnormality analysis. Accurate pelvic landmark detection could provide reliable clinical parameter measurement results, which are helpful for doctors to diagnose and treat pelvic diseases. However, the multi-scale characteristics, temporal diversity, and pathological abnormalities of different pelvic X-rays bring enormous challenges to the landmark detection task. In order to retain strong robustness in irregular pelvic X-rays, we propose a novel, flexible two-stage framework. In the initial stage, a single neural network is employed to estimate the locations of every landmark simultaneously, enabling the identification of potential landmark regions. Then, the receptive field of candidate region proposals is expanded by 4 times through the receptive field amplification module. In the second stage, the landmark detection module fuses semantically rich features at different scales through a multi-scale semantic fusion module. So that the framework can fully learn the strongly relevant semantic information around the landmark at high resolution. We collected a data set of 430 pelvic X-rays, including a large number of irregular pelvic X-rays, to evaluate our framework. The experimental results demonstrate that our framework achieves a state-of-the-art detection mean radial error of 3.724 ± 4.247-mm. The experimental results show that the proposed method can help doctors quickly and accurately find the characteristic points of the pelvis and could be applied to clinical diagnosis.https://ieeexplore.ieee.org/document/10335173/Landmark detectionirregular pelvic X-rayreceptive field amplificationmulti-scale semantic fusion |
| spellingShingle | Chenyang Lu Jiageng Zhao Wei Chen Xu Qiao Qingyun Zeng Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark Detection IEEE Access Landmark detection irregular pelvic X-ray receptive field amplification multi-scale semantic fusion |
| title | Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark Detection |
| title_full | Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark Detection |
| title_fullStr | Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark Detection |
| title_full_unstemmed | Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark Detection |
| title_short | Multi-Scale Semantic Fusion of a Large Receptive Field for Irregular Pelvic X-Ray Landmark Detection |
| title_sort | multi scale semantic fusion of a large receptive field for irregular pelvic x ray landmark detection |
| topic | Landmark detection irregular pelvic X-ray receptive field amplification multi-scale semantic fusion |
| url | https://ieeexplore.ieee.org/document/10335173/ |
| work_keys_str_mv | AT chenyanglu multiscalesemanticfusionofalargereceptivefieldforirregularpelvicxraylandmarkdetection AT jiagengzhao multiscalesemanticfusionofalargereceptivefieldforirregularpelvicxraylandmarkdetection AT weichen multiscalesemanticfusionofalargereceptivefieldforirregularpelvicxraylandmarkdetection AT xuqiao multiscalesemanticfusionofalargereceptivefieldforirregularpelvicxraylandmarkdetection AT qingyunzeng multiscalesemanticfusionofalargereceptivefieldforirregularpelvicxraylandmarkdetection |