3D Reconstruction of Gastrointestinal Regions Using Single-View Methods
Capsule endoscopy is about to become an alternative to traditional colonoscopy. One uses a wireless camera to visualize the gastrointestinal (GI) tract. A 3D model based on image sequences obtained from wireless capsule endoscopy (WCE) can be helpful to diagnose or analyse areas of interests. We hav...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10154004/ |
| _version_ | 1827918603555438592 |
|---|---|
| author | Bilal Ahmad Pal Anders Floor Ivar Farup Oistein Hovde |
| author_facet | Bilal Ahmad Pal Anders Floor Ivar Farup Oistein Hovde |
| author_sort | Bilal Ahmad |
| collection | DOAJ |
| description | Capsule endoscopy is about to become an alternative to traditional colonoscopy. One uses a wireless camera to visualize the gastrointestinal (GI) tract. A 3D model based on image sequences obtained from wireless capsule endoscopy (WCE) can be helpful to diagnose or analyse areas of interests. We have therefore investigated the possibility to provide enhanced viewing for gastroenterologists by reconstructing 3D shapes from WCE images. The study is done on virtual graphics-based models of human GI regions. The shape from shading (SFS) method is applied to colon images and the quality of the reconstructed shapes is compared with ground truth models. WCE images suffer from uneven and dim illumination due to point light source. Therefore, we provide a method based on surface normals from reconstructed 3D models to enhance contrast particularity in images capturing larger depths by changing the illumination from point light to directional light. Images of different resolution are also tested to evaluate their effect on the quality of the 3D reconstruction. We have also tested the shape from focus (SFF) method, a possibility for future WCEs, and compared the results with SFS. Finally, enhanced images and 3D shapes recovered with both methods have been evaluated by gastroenterologists through subjective experiments. Objective experiments indicate that both methods are capable of reconstructing the 3D shapes of colon images successfully, but the SFF method is better at retaining details in the reconstructed models than the SFS method. Subjective experiments show that contrast enhanced images are highly preferred over original images. Also, having the reconstructed 3D models in addition to the images during evaluation is found to be very useful by gastroenterologists and sometimes even being preferred over the original image. |
| first_indexed | 2024-03-13T03:45:57Z |
| format | Article |
| id | doaj.art-c3207efdb621446f9805707427399474 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T03:45:57Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-c3207efdb621446f98057074273994742023-06-22T23:00:50ZengIEEEIEEE Access2169-35362023-01-0111611036111710.1109/ACCESS.2023.3286937101540043D Reconstruction of Gastrointestinal Regions Using Single-View MethodsBilal Ahmad0https://orcid.org/0000-0001-8811-0404Pal Anders Floor1https://orcid.org/0000-0001-6328-7414Ivar Farup2https://orcid.org/0000-0003-3473-1138Oistein Hovde3Department of Computer Science, Norwegian University of Science and Technology, Gjøvik, NorwayDepartment of Computer Science, Norwegian University of Science and Technology, Gjøvik, NorwayDepartment of Computer Science, Norwegian University of Science and Technology, Gjøvik, NorwayDepartment of Computer Science, Norwegian University of Science and Technology, Gjøvik, NorwayCapsule endoscopy is about to become an alternative to traditional colonoscopy. One uses a wireless camera to visualize the gastrointestinal (GI) tract. A 3D model based on image sequences obtained from wireless capsule endoscopy (WCE) can be helpful to diagnose or analyse areas of interests. We have therefore investigated the possibility to provide enhanced viewing for gastroenterologists by reconstructing 3D shapes from WCE images. The study is done on virtual graphics-based models of human GI regions. The shape from shading (SFS) method is applied to colon images and the quality of the reconstructed shapes is compared with ground truth models. WCE images suffer from uneven and dim illumination due to point light source. Therefore, we provide a method based on surface normals from reconstructed 3D models to enhance contrast particularity in images capturing larger depths by changing the illumination from point light to directional light. Images of different resolution are also tested to evaluate their effect on the quality of the 3D reconstruction. We have also tested the shape from focus (SFF) method, a possibility for future WCEs, and compared the results with SFS. Finally, enhanced images and 3D shapes recovered with both methods have been evaluated by gastroenterologists through subjective experiments. Objective experiments indicate that both methods are capable of reconstructing the 3D shapes of colon images successfully, but the SFF method is better at retaining details in the reconstructed models than the SFS method. Subjective experiments show that contrast enhanced images are highly preferred over original images. Also, having the reconstructed 3D models in addition to the images during evaluation is found to be very useful by gastroenterologists and sometimes even being preferred over the original image.https://ieeexplore.ieee.org/document/10154004/3D reconstructionshape from shadingshape from focuscapsule endoscopy |
| spellingShingle | Bilal Ahmad Pal Anders Floor Ivar Farup Oistein Hovde 3D Reconstruction of Gastrointestinal Regions Using Single-View Methods IEEE Access 3D reconstruction shape from shading shape from focus capsule endoscopy |
| title | 3D Reconstruction of Gastrointestinal Regions Using Single-View Methods |
| title_full | 3D Reconstruction of Gastrointestinal Regions Using Single-View Methods |
| title_fullStr | 3D Reconstruction of Gastrointestinal Regions Using Single-View Methods |
| title_full_unstemmed | 3D Reconstruction of Gastrointestinal Regions Using Single-View Methods |
| title_short | 3D Reconstruction of Gastrointestinal Regions Using Single-View Methods |
| title_sort | 3d reconstruction of gastrointestinal regions using single view methods |
| topic | 3D reconstruction shape from shading shape from focus capsule endoscopy |
| url | https://ieeexplore.ieee.org/document/10154004/ |
| work_keys_str_mv | AT bilalahmad 3dreconstructionofgastrointestinalregionsusingsingleviewmethods AT palandersfloor 3dreconstructionofgastrointestinalregionsusingsingleviewmethods AT ivarfarup 3dreconstructionofgastrointestinalregionsusingsingleviewmethods AT oisteinhovde 3dreconstructionofgastrointestinalregionsusingsingleviewmethods |