Real-time polyp detection, localization and segmentation in colonoscopy using deep learning

Computer-aided detection, localisation, and segmentation methods can help improve colonoscopy procedures. Even though many methods have been built to tackle automatic detection and segmentation of polyps, benchmarking of state-of-the-art methods still remains an open problem. This is due to the incr...

Full description

Bibliographic Details
Main Authors: Jha, D, Ali, S, Tomar, NK, Johansen, HD, Johansen, D, Rittscher, J, Riegler, MA, Halvorsen, P
Format: Journal article
Language:English
Published: IEEE 2021
_version_ 1826302611102367744
author Jha, D
Ali, S
Tomar, NK
Johansen, HD
Johansen, D
Rittscher, J
Riegler, MA
Halvorsen, P
author_facet Jha, D
Ali, S
Tomar, NK
Johansen, HD
Johansen, D
Rittscher, J
Riegler, MA
Halvorsen, P
author_sort Jha, D
collection OXFORD
description Computer-aided detection, localisation, and segmentation methods can help improve colonoscopy procedures. Even though many methods have been built to tackle automatic detection and segmentation of polyps, benchmarking of state-of-the-art methods still remains an open problem. This is due to the increasing number of researched computer vision methods that can be applied to polyp datasets. Benchmarking of novel methods can provide a direction to the development of automated polyp detection and segmentation tasks. Furthermore, it ensures that the produced results in the community are reproducible and provide a fair comparison of developed methods. In this paper, we benchmark several recent state-of-the-art methods using Kvasir-SEG, an open-access dataset of colonoscopy images for polyp detection, localisation, and segmentation evaluating both method accuracy and speed. Whilst, most methods in literature have competitive performance over accuracy, we show that the proposed ColonSegNet achieved a better trade-off between an average precision of 0.8000 and mean IoU of 0.8100, and the fastest speed of 180 frames per second for the detection and localisation task. Likewise, the proposed ColonSegNet achieved a competitive dice coefficient of 0.8206 and the best average speed of 182.38 frames per second for the segmentation task. Our comprehensive comparison with various state-of-the-art methods reveals the importance of benchmarking the deep learning methods for automated real-time polyp identification and delineations that can potentially transform current clinical practices and minimise miss-detection rates.
first_indexed 2024-03-07T05:50:12Z
format Journal article
id oxford-uuid:e89b6b1c-4b01-491a-86a4-03adba78baf3
institution University of Oxford
language English
last_indexed 2024-03-07T05:50:12Z
publishDate 2021
publisher IEEE
record_format dspace
spelling oxford-uuid:e89b6b1c-4b01-491a-86a4-03adba78baf32022-03-27T10:48:04ZReal-time polyp detection, localization and segmentation in colonoscopy using deep learning Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:e89b6b1c-4b01-491a-86a4-03adba78baf3EnglishSymplectic ElementsIEEE2021Jha, DAli, STomar, NKJohansen, HDJohansen, DRittscher, JRiegler, MAHalvorsen, PComputer-aided detection, localisation, and segmentation methods can help improve colonoscopy procedures. Even though many methods have been built to tackle automatic detection and segmentation of polyps, benchmarking of state-of-the-art methods still remains an open problem. This is due to the increasing number of researched computer vision methods that can be applied to polyp datasets. Benchmarking of novel methods can provide a direction to the development of automated polyp detection and segmentation tasks. Furthermore, it ensures that the produced results in the community are reproducible and provide a fair comparison of developed methods. In this paper, we benchmark several recent state-of-the-art methods using Kvasir-SEG, an open-access dataset of colonoscopy images for polyp detection, localisation, and segmentation evaluating both method accuracy and speed. Whilst, most methods in literature have competitive performance over accuracy, we show that the proposed ColonSegNet achieved a better trade-off between an average precision of 0.8000 and mean IoU of 0.8100, and the fastest speed of 180 frames per second for the detection and localisation task. Likewise, the proposed ColonSegNet achieved a competitive dice coefficient of 0.8206 and the best average speed of 182.38 frames per second for the segmentation task. Our comprehensive comparison with various state-of-the-art methods reveals the importance of benchmarking the deep learning methods for automated real-time polyp identification and delineations that can potentially transform current clinical practices and minimise miss-detection rates.
spellingShingle Jha, D
Ali, S
Tomar, NK
Johansen, HD
Johansen, D
Rittscher, J
Riegler, MA
Halvorsen, P
Real-time polyp detection, localization and segmentation in colonoscopy using deep learning
title Real-time polyp detection, localization and segmentation in colonoscopy using deep learning
title_full Real-time polyp detection, localization and segmentation in colonoscopy using deep learning
title_fullStr Real-time polyp detection, localization and segmentation in colonoscopy using deep learning
title_full_unstemmed Real-time polyp detection, localization and segmentation in colonoscopy using deep learning
title_short Real-time polyp detection, localization and segmentation in colonoscopy using deep learning
title_sort real time polyp detection localization and segmentation in colonoscopy using deep learning
work_keys_str_mv AT jhad realtimepolypdetectionlocalizationandsegmentationincolonoscopyusingdeeplearning
AT alis realtimepolypdetectionlocalizationandsegmentationincolonoscopyusingdeeplearning
AT tomarnk realtimepolypdetectionlocalizationandsegmentationincolonoscopyusingdeeplearning
AT johansenhd realtimepolypdetectionlocalizationandsegmentationincolonoscopyusingdeeplearning
AT johansend realtimepolypdetectionlocalizationandsegmentationincolonoscopyusingdeeplearning
AT rittscherj realtimepolypdetectionlocalizationandsegmentationincolonoscopyusingdeeplearning
AT rieglerma realtimepolypdetectionlocalizationandsegmentationincolonoscopyusingdeeplearning
AT halvorsenp realtimepolypdetectionlocalizationandsegmentationincolonoscopyusingdeeplearning