A lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self-attention
In robot-assisted surgical systems, surgical instrument segmentation is a critical task that provides important information for surgeons to make informed decisions and ensure surgical safety. However, current mainstream models often lack precise segmentation edges and suffer from an excess of parame...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
PeerJ Inc.
2023-12-01
|
| Series: | PeerJ Computer Science |
| Subjects: | |
| Online Access: | https://peerj.com/articles/cs-1746.pdf |
| _version_ | 1797392494795685888 |
|---|---|
| author | Mengyu Zhou Xiaoxiang Han Zhoujin Liu Yitong Chen Liping Sun |
| author_facet | Mengyu Zhou Xiaoxiang Han Zhoujin Liu Yitong Chen Liping Sun |
| author_sort | Mengyu Zhou |
| collection | DOAJ |
| description | In robot-assisted surgical systems, surgical instrument segmentation is a critical task that provides important information for surgeons to make informed decisions and ensure surgical safety. However, current mainstream models often lack precise segmentation edges and suffer from an excess of parameters, rendering their deployment challenging. To address these issues, this article proposes a lightweight semantic segmentation model based on edge refinement and efficient self-attention. The proposed model utilizes a lightweight densely connected network for feature extraction, which is able to extract high-quality semantic information with fewer parameters. The decoder combines a feature pyramid module with an efficient criss-cross self-attention module. This fusion integrates multi-scale data, strengthens focus on surgical instrument details, and enhances edge segmentation accuracy. To train and evaluate the proposed model, the authors developed a private dataset of endoscopic surgical instruments. It containing 1,406 images for training, 469 images for validation and 469 images for testing. The proposed model performs well on this dataset with only 466 K parameters, achieving a mean Intersection over Union (mIoU) of 97.11%. In addition, the model was trained on public datasets Kvasir-instrument and Endovis2017. Excellent results of 93.24% and 95.83% were achieved on the indicator mIoU, respectively. The superiority and effectiveness of the method are proved. Experimental results show that the proposed model has lower parameters and higher accuracy than other state-of-the-art models. The proposed model thus lays the foundation for further research in the field of surgical instrument segmentation. |
| first_indexed | 2024-03-08T23:48:13Z |
| format | Article |
| id | doaj.art-da91c55c5e0844ac862de999b842bee6 |
| institution | Directory Open Access Journal |
| issn | 2376-5992 |
| language | English |
| last_indexed | 2024-03-08T23:48:13Z |
| publishDate | 2023-12-01 |
| publisher | PeerJ Inc. |
| record_format | Article |
| series | PeerJ Computer Science |
| spelling | doaj.art-da91c55c5e0844ac862de999b842bee62023-12-13T15:05:27ZengPeerJ Inc.PeerJ Computer Science2376-59922023-12-019e174610.7717/peerj-cs.1746A lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self-attentionMengyu Zhou0Xiaoxiang Han1Zhoujin Liu2Yitong Chen3Liping Sun4School of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai, P.R.ChinaSchool of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, ChinaSchool of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai, P.R.ChinaSchool of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai, P.R.ChinaSchool of Medical Instruments, Shanghai University of Medicine & Health Sciences, Shanghai, P.R.ChinaIn robot-assisted surgical systems, surgical instrument segmentation is a critical task that provides important information for surgeons to make informed decisions and ensure surgical safety. However, current mainstream models often lack precise segmentation edges and suffer from an excess of parameters, rendering their deployment challenging. To address these issues, this article proposes a lightweight semantic segmentation model based on edge refinement and efficient self-attention. The proposed model utilizes a lightweight densely connected network for feature extraction, which is able to extract high-quality semantic information with fewer parameters. The decoder combines a feature pyramid module with an efficient criss-cross self-attention module. This fusion integrates multi-scale data, strengthens focus on surgical instrument details, and enhances edge segmentation accuracy. To train and evaluate the proposed model, the authors developed a private dataset of endoscopic surgical instruments. It containing 1,406 images for training, 469 images for validation and 469 images for testing. The proposed model performs well on this dataset with only 466 K parameters, achieving a mean Intersection over Union (mIoU) of 97.11%. In addition, the model was trained on public datasets Kvasir-instrument and Endovis2017. Excellent results of 93.24% and 95.83% were achieved on the indicator mIoU, respectively. The superiority and effectiveness of the method are proved. Experimental results show that the proposed model has lower parameters and higher accuracy than other state-of-the-art models. The proposed model thus lays the foundation for further research in the field of surgical instrument segmentation.https://peerj.com/articles/cs-1746.pdfSurgical instrumentsSemantic segmentationLightweight networkEfficient self-attention |
| spellingShingle | Mengyu Zhou Xiaoxiang Han Zhoujin Liu Yitong Chen Liping Sun A lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self-attention PeerJ Computer Science Surgical instruments Semantic segmentation Lightweight network Efficient self-attention |
| title | A lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self-attention |
| title_full | A lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self-attention |
| title_fullStr | A lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self-attention |
| title_full_unstemmed | A lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self-attention |
| title_short | A lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self-attention |
| title_sort | lightweight segmentation network for endoscopic surgical instruments based on edge refinement and efficient self attention |
| topic | Surgical instruments Semantic segmentation Lightweight network Efficient self-attention |
| url | https://peerj.com/articles/cs-1746.pdf |
| work_keys_str_mv | AT mengyuzhou alightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT xiaoxianghan alightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT zhoujinliu alightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT yitongchen alightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT lipingsun alightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT mengyuzhou lightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT xiaoxianghan lightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT zhoujinliu lightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT yitongchen lightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention AT lipingsun lightweightsegmentationnetworkforendoscopicsurgicalinstrumentsbasedonedgerefinementandefficientselfattention |