Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract
Endoscopy is a routine imaging technique used for both diagnosis and minimally invasive surgical treatment. While the endoscopy video contains a wealth of information, tools to capture this information for the purpose of clinical reporting are rather poor. In date, endoscopists do not have any acces...
| Main Authors: | , |
|---|---|
| Format: | Conference item |
| Published: |
Institute of Electrical and Electronics Engineers
2019
|
| _version_ | 1797099956325056512 |
|---|---|
| author | Ali, S Rittscher, J |
| author_facet | Ali, S Rittscher, J |
| author_sort | Ali, S |
| collection | OXFORD |
| description | Endoscopy is a routine imaging technique used for both diagnosis and minimally invasive surgical treatment. While the endoscopy video contains a wealth of information, tools to capture this information for the purpose of clinical reporting are rather poor. In date, endoscopists do not have any access to tools that enable them to browse the video data in an efficient and user friendly manner. Fast and reliable video retrieval methods could for example, allow them to review data from previous exams and therefore improve their ability to monitor disease progression. Deep learning provides new avenues of compressing and indexing video in an extremely efficient manner. In this study, we propose to use an autoencoder for efficient video compression and fast retrieval of video images. To boost the accuracy of video image retrieval and to address data variability like multi-modality and view-point changes, we propose the integration of a Siamese network. We demonstrate that our approach is competitive in retrieving images from 3 large scale videos of 3 different patients obtained against the query samples of their previous diagnosis. Quantitative validation shows that the combined approach yield an overall improvement of 5% and 8% over classical and variational autoencoders, respectively. |
| first_indexed | 2024-03-07T05:30:52Z |
| format | Conference item |
| id | oxford-uuid:e239e4ca-825e-4c93-a99a-019b355fa244 |
| institution | University of Oxford |
| last_indexed | 2024-03-07T05:30:52Z |
| publishDate | 2019 |
| publisher | Institute of Electrical and Electronics Engineers |
| record_format | dspace |
| spelling | oxford-uuid:e239e4ca-825e-4c93-a99a-019b355fa2442022-03-27T09:59:34ZEfficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tractConference itemhttp://purl.org/coar/resource_type/c_5794uuid:e239e4ca-825e-4c93-a99a-019b355fa244Symplectic Elements at OxfordInstitute of Electrical and Electronics Engineers2019Ali, SRittscher, JEndoscopy is a routine imaging technique used for both diagnosis and minimally invasive surgical treatment. While the endoscopy video contains a wealth of information, tools to capture this information for the purpose of clinical reporting are rather poor. In date, endoscopists do not have any access to tools that enable them to browse the video data in an efficient and user friendly manner. Fast and reliable video retrieval methods could for example, allow them to review data from previous exams and therefore improve their ability to monitor disease progression. Deep learning provides new avenues of compressing and indexing video in an extremely efficient manner. In this study, we propose to use an autoencoder for efficient video compression and fast retrieval of video images. To boost the accuracy of video image retrieval and to address data variability like multi-modality and view-point changes, we propose the integration of a Siamese network. We demonstrate that our approach is competitive in retrieving images from 3 large scale videos of 3 different patients obtained against the query samples of their previous diagnosis. Quantitative validation shows that the combined approach yield an overall improvement of 5% and 8% over classical and variational autoencoders, respectively. |
| spellingShingle | Ali, S Rittscher, J Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract |
| title | Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract |
| title_full | Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract |
| title_fullStr | Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract |
| title_full_unstemmed | Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract |
| title_short | Efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract |
| title_sort | efficient video indexing for monitoring disease activity and progression in the upper gastrointestinal tract |
| work_keys_str_mv | AT alis efficientvideoindexingformonitoringdiseaseactivityandprogressionintheuppergastrointestinaltract AT rittscherj efficientvideoindexingformonitoringdiseaseactivityandprogressionintheuppergastrointestinaltract |