WDTISeg: One-Stage Interactive Segmentation for Breast Ultrasound Image Using Weighted Distance Transform and Shape-Aware Compound Loss
Accurate tumor segmentation is important for aided diagnosis using breast ultrasound. Interactive segmentation methods can obtain highly accurate results by continuously optimizing the segmentation result via user interactions. However, traditional interactive segmentation methods usually require a...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-07-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/11/14/6279 |
| _version_ | 1797527765881192448 |
|---|---|
| author | Xiaokang Li Mengyun Qiao Yi Guo Jin Zhou Shichong Zhou Cai Chang Yuanyuan Wang |
| author_facet | Xiaokang Li Mengyun Qiao Yi Guo Jin Zhou Shichong Zhou Cai Chang Yuanyuan Wang |
| author_sort | Xiaokang Li |
| collection | DOAJ |
| description | Accurate tumor segmentation is important for aided diagnosis using breast ultrasound. Interactive segmentation methods can obtain highly accurate results by continuously optimizing the segmentation result via user interactions. However, traditional interactive segmentation methods usually require a large number of interactions to make the result meet the requirements due to the performance limitations of the underlying model. With greater ability in extracting image information, convolutional neural network (CNN)-based interactive segmentation methods have been shown to effectively reduce the number of user interactions. In this paper, we proposed a one-stage interactive segmentation framework (interactive segmentation using weighted distance transform, WDTISeg) for breast ultrasound image using weighted distance transform and shape-aware compound loss. First, we used a pre-trained CNN to attain an initial automatic segmentation, based on which the user provided interaction points of mis-segmented areas. Then, we combined Euclidean distance transform and geodesic distance transform to convert interaction points into weighted distance maps to transfer segmentation guidance information to the model. The same CNN accepted the input image, the initial segmentation, and weighted distance maps as a concatenation input and provided a refined result, without another additional segmentation network. In addition, a shape-aware compound loss function using prior knowledge was designed to reduce the number of user interactions. In the testing phase on 200 cases, our method achieved a dice of 82.86 ± 16.22 (%) for automatic segmentation task and a dice of 94.45 ± 3.26 (%) for interactive segmentation task after 8 interactions. The results of comparative experiments proved that our method could obtain higher accuracy with fewer simple interactions than other interactive segmentation methods. |
| first_indexed | 2024-03-10T09:47:29Z |
| format | Article |
| id | doaj.art-f340d512598c453a8dff1f896c1fa903 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-10T09:47:29Z |
| publishDate | 2021-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-f340d512598c453a8dff1f896c1fa9032023-11-22T03:07:04ZengMDPI AGApplied Sciences2076-34172021-07-011114627910.3390/app11146279WDTISeg: One-Stage Interactive Segmentation for Breast Ultrasound Image Using Weighted Distance Transform and Shape-Aware Compound LossXiaokang Li0Mengyun Qiao1Yi Guo2Jin Zhou3Shichong Zhou4Cai Chang5Yuanyuan Wang6Department of Electronic Engineering, Fudan University, Shanghai 200433, ChinaDepartment of Electronic Engineering, Fudan University, Shanghai 200433, ChinaDepartment of Electronic Engineering, Fudan University, Shanghai 200433, ChinaFudan University Shanghai Cancer Center, Shanghai 200032, ChinaFudan University Shanghai Cancer Center, Shanghai 200032, ChinaFudan University Shanghai Cancer Center, Shanghai 200032, ChinaDepartment of Electronic Engineering, Fudan University, Shanghai 200433, ChinaAccurate tumor segmentation is important for aided diagnosis using breast ultrasound. Interactive segmentation methods can obtain highly accurate results by continuously optimizing the segmentation result via user interactions. However, traditional interactive segmentation methods usually require a large number of interactions to make the result meet the requirements due to the performance limitations of the underlying model. With greater ability in extracting image information, convolutional neural network (CNN)-based interactive segmentation methods have been shown to effectively reduce the number of user interactions. In this paper, we proposed a one-stage interactive segmentation framework (interactive segmentation using weighted distance transform, WDTISeg) for breast ultrasound image using weighted distance transform and shape-aware compound loss. First, we used a pre-trained CNN to attain an initial automatic segmentation, based on which the user provided interaction points of mis-segmented areas. Then, we combined Euclidean distance transform and geodesic distance transform to convert interaction points into weighted distance maps to transfer segmentation guidance information to the model. The same CNN accepted the input image, the initial segmentation, and weighted distance maps as a concatenation input and provided a refined result, without another additional segmentation network. In addition, a shape-aware compound loss function using prior knowledge was designed to reduce the number of user interactions. In the testing phase on 200 cases, our method achieved a dice of 82.86 ± 16.22 (%) for automatic segmentation task and a dice of 94.45 ± 3.26 (%) for interactive segmentation task after 8 interactions. The results of comparative experiments proved that our method could obtain higher accuracy with fewer simple interactions than other interactive segmentation methods.https://www.mdpi.com/2076-3417/11/14/6279interactive image segmentationbreast ultrasoundweighted distance transformprior knowledge |
| spellingShingle | Xiaokang Li Mengyun Qiao Yi Guo Jin Zhou Shichong Zhou Cai Chang Yuanyuan Wang WDTISeg: One-Stage Interactive Segmentation for Breast Ultrasound Image Using Weighted Distance Transform and Shape-Aware Compound Loss Applied Sciences interactive image segmentation breast ultrasound weighted distance transform prior knowledge |
| title | WDTISeg: One-Stage Interactive Segmentation for Breast Ultrasound Image Using Weighted Distance Transform and Shape-Aware Compound Loss |
| title_full | WDTISeg: One-Stage Interactive Segmentation for Breast Ultrasound Image Using Weighted Distance Transform and Shape-Aware Compound Loss |
| title_fullStr | WDTISeg: One-Stage Interactive Segmentation for Breast Ultrasound Image Using Weighted Distance Transform and Shape-Aware Compound Loss |
| title_full_unstemmed | WDTISeg: One-Stage Interactive Segmentation for Breast Ultrasound Image Using Weighted Distance Transform and Shape-Aware Compound Loss |
| title_short | WDTISeg: One-Stage Interactive Segmentation for Breast Ultrasound Image Using Weighted Distance Transform and Shape-Aware Compound Loss |
| title_sort | wdtiseg one stage interactive segmentation for breast ultrasound image using weighted distance transform and shape aware compound loss |
| topic | interactive image segmentation breast ultrasound weighted distance transform prior knowledge |
| url | https://www.mdpi.com/2076-3417/11/14/6279 |
| work_keys_str_mv | AT xiaokangli wdtisegonestageinteractivesegmentationforbreastultrasoundimageusingweighteddistancetransformandshapeawarecompoundloss AT mengyunqiao wdtisegonestageinteractivesegmentationforbreastultrasoundimageusingweighteddistancetransformandshapeawarecompoundloss AT yiguo wdtisegonestageinteractivesegmentationforbreastultrasoundimageusingweighteddistancetransformandshapeawarecompoundloss AT jinzhou wdtisegonestageinteractivesegmentationforbreastultrasoundimageusingweighteddistancetransformandshapeawarecompoundloss AT shichongzhou wdtisegonestageinteractivesegmentationforbreastultrasoundimageusingweighteddistancetransformandshapeawarecompoundloss AT caichang wdtisegonestageinteractivesegmentationforbreastultrasoundimageusingweighteddistancetransformandshapeawarecompoundloss AT yuanyuanwang wdtisegonestageinteractivesegmentationforbreastultrasoundimageusingweighteddistancetransformandshapeawarecompoundloss |