Lightweight Real-Time Detection and Recognition Model of Intraocular Foreign Bodies Fused With a Feature Pyramid Mechanism
Accurate detection of target location and type is crucial for treating ocular trauma caused by foreign bodies intrusion. However, the traditional method of manually marking CT image targets has slow recognition speed and poor detection accuracy, which cannot meet the real-time and accuracy requireme...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10323458/ |
| _version_ | 1827631147359666176 |
|---|---|
| author | Yiran Liu Yiting Zheng Xiaoyu Zhu Junzhe Chen Suyan Li Zhaolin Lu |
| author_facet | Yiran Liu Yiting Zheng Xiaoyu Zhu Junzhe Chen Suyan Li Zhaolin Lu |
| author_sort | Yiran Liu |
| collection | DOAJ |
| description | Accurate detection of target location and type is crucial for treating ocular trauma caused by foreign bodies intrusion. However, the traditional method of manually marking CT image targets has slow recognition speed and poor detection accuracy, which cannot meet the real-time and accuracy requirements for detecting foreign bodies in clinical diagnosis. To address this issue, we propose a lightweight detection and recognition model based on feature extraction and fusion. Firstly, the normalization-based attention module and the sigmoid linear unit activation function are introduced into the inverted residual block of the backbone network to enhance the model’s attention to salient features and improve the detection accuracy. Then, the path aggregation feature pyramid network is utilized to fuse multiscale features, enabling the information interaction between different levels of the network and enhancing the accuracy foreign bodies classification. In particular, the incorporation of the space-to-depth convolution and convolutional mixing modules into the feature pyramid network significantly reduce the computational overhead while effectively capturing the key semantic features in both space and channel directions, thereby improving the lightweight level of the model. Finally, the location and type information of the foreign intraocular bodies are obtained by this model. The experimental results demonstrate the superior performance of the proposed model in terms of mAP@0.5, accuracy, sensitivity and specificity, achieving 97.2, 93.5, 98.0 and 88.0, respectively. Furthermore, the smaller number of parameters and faster detection time allow the proposed model run in real-time on poorly configured hardware, making it more suitable for clinical applications. |
| first_indexed | 2024-03-09T14:16:56Z |
| format | Article |
| id | doaj.art-98190dee992d430f8e154ef89347fcc5 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-09T14:16:56Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-98190dee992d430f8e154ef89347fcc52023-11-29T00:01:26ZengIEEEIEEE Access2169-35362023-01-011113080313081410.1109/ACCESS.2023.333523010323458Lightweight Real-Time Detection and Recognition Model of Intraocular Foreign Bodies Fused With a Feature Pyramid MechanismYiran Liu0Yiting Zheng1https://orcid.org/0009-0008-6164-8616Xiaoyu Zhu2Junzhe Chen3Suyan Li4Zhaolin Lu5https://orcid.org/0000-0002-9251-0758The Second Clinical Medical College, Nanjing Medical University, Nanjing, ChinaSchool of Information and Control Engineering, China University of Mining and Technology, Xuzhou, ChinaSchool of Information and Control Engineering, China University of Mining and Technology, Xuzhou, ChinaSchool of Information and Control Engineering, China University of Mining and Technology, Xuzhou, ChinaXuzhou No. 1 People's Hospital, Xuzhou, ChinaXuzhou No. 1 People's Hospital, Xuzhou, ChinaAccurate detection of target location and type is crucial for treating ocular trauma caused by foreign bodies intrusion. However, the traditional method of manually marking CT image targets has slow recognition speed and poor detection accuracy, which cannot meet the real-time and accuracy requirements for detecting foreign bodies in clinical diagnosis. To address this issue, we propose a lightweight detection and recognition model based on feature extraction and fusion. Firstly, the normalization-based attention module and the sigmoid linear unit activation function are introduced into the inverted residual block of the backbone network to enhance the model’s attention to salient features and improve the detection accuracy. Then, the path aggregation feature pyramid network is utilized to fuse multiscale features, enabling the information interaction between different levels of the network and enhancing the accuracy foreign bodies classification. In particular, the incorporation of the space-to-depth convolution and convolutional mixing modules into the feature pyramid network significantly reduce the computational overhead while effectively capturing the key semantic features in both space and channel directions, thereby improving the lightweight level of the model. Finally, the location and type information of the foreign intraocular bodies are obtained by this model. The experimental results demonstrate the superior performance of the proposed model in terms of mAP@0.5, accuracy, sensitivity and specificity, achieving 97.2, 93.5, 98.0 and 88.0, respectively. Furthermore, the smaller number of parameters and faster detection time allow the proposed model run in real-time on poorly configured hardware, making it more suitable for clinical applications.https://ieeexplore.ieee.org/document/10323458/Intraocular foreign bodyfeature pyramidlightweightreal-time detection |
| spellingShingle | Yiran Liu Yiting Zheng Xiaoyu Zhu Junzhe Chen Suyan Li Zhaolin Lu Lightweight Real-Time Detection and Recognition Model of Intraocular Foreign Bodies Fused With a Feature Pyramid Mechanism IEEE Access Intraocular foreign body feature pyramid lightweight real-time detection |
| title | Lightweight Real-Time Detection and Recognition Model of Intraocular Foreign Bodies Fused With a Feature Pyramid Mechanism |
| title_full | Lightweight Real-Time Detection and Recognition Model of Intraocular Foreign Bodies Fused With a Feature Pyramid Mechanism |
| title_fullStr | Lightweight Real-Time Detection and Recognition Model of Intraocular Foreign Bodies Fused With a Feature Pyramid Mechanism |
| title_full_unstemmed | Lightweight Real-Time Detection and Recognition Model of Intraocular Foreign Bodies Fused With a Feature Pyramid Mechanism |
| title_short | Lightweight Real-Time Detection and Recognition Model of Intraocular Foreign Bodies Fused With a Feature Pyramid Mechanism |
| title_sort | lightweight real time detection and recognition model of intraocular foreign bodies fused with a feature pyramid mechanism |
| topic | Intraocular foreign body feature pyramid lightweight real-time detection |
| url | https://ieeexplore.ieee.org/document/10323458/ |
| work_keys_str_mv | AT yiranliu lightweightrealtimedetectionandrecognitionmodelofintraocularforeignbodiesfusedwithafeaturepyramidmechanism AT yitingzheng lightweightrealtimedetectionandrecognitionmodelofintraocularforeignbodiesfusedwithafeaturepyramidmechanism AT xiaoyuzhu lightweightrealtimedetectionandrecognitionmodelofintraocularforeignbodiesfusedwithafeaturepyramidmechanism AT junzhechen lightweightrealtimedetectionandrecognitionmodelofintraocularforeignbodiesfusedwithafeaturepyramidmechanism AT suyanli lightweightrealtimedetectionandrecognitionmodelofintraocularforeignbodiesfusedwithafeaturepyramidmechanism AT zhaolinlu lightweightrealtimedetectionandrecognitionmodelofintraocularforeignbodiesfusedwithafeaturepyramidmechanism |