Qualitative Comparison of Image Stitching Algorithms for Multi-Camera Systems in Laparoscopy
Multi-camera systems were recently introduced into laparoscopy to increase the narrow field of view of the surgeon. The video streams are stitched together to create a panorama that is easier for the surgeon to comprehend. Multi-camera prototypes for laparoscopy use quite basic algorithms and have o...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-02-01
|
| Series: | Journal of Imaging |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2313-433X/8/3/52 |
| _version_ | 1797470344400863232 |
|---|---|
| author | Sylvain Guy Jean-Loup Haberbusch Emmanuel Promayon Stéphane Mancini Sandrine Voros |
| author_facet | Sylvain Guy Jean-Loup Haberbusch Emmanuel Promayon Stéphane Mancini Sandrine Voros |
| author_sort | Sylvain Guy |
| collection | DOAJ |
| description | Multi-camera systems were recently introduced into laparoscopy to increase the narrow field of view of the surgeon. The video streams are stitched together to create a panorama that is easier for the surgeon to comprehend. Multi-camera prototypes for laparoscopy use quite basic algorithms and have only been evaluated on simple laparoscopic scenarios. The more recent state-of-the-art algorithms, mainly designed for the smartphone industry, have not yet been evaluated in laparoscopic conditions. We developed a simulated environment to generate a dataset of multi-view images displaying a wide range of laparoscopic situations, which is adaptable to any multi-camera system. We evaluated classical and state-of-the-art image stitching techniques used in non-medical applications on this dataset, including one unsupervised deep learning approach. We show that classical techniques that use global homography fail to provide a clinically satisfactory rendering and that even the most recent techniques, despite providing high quality panorama images in non-medical situations, may suffer from poor alignment or severe distortions in simulated laparoscopic scenarios. We highlight the main advantages and flaws of each algorithm within a laparoscopic context, identify the main remaining challenges that are specific to laparoscopy, and propose methods to improve these approaches. We provide public access to the simulated environment and dataset. |
| first_indexed | 2024-03-09T19:35:15Z |
| format | Article |
| id | doaj.art-1439f7de24b54d4e968ea2281430db56 |
| institution | Directory Open Access Journal |
| issn | 2313-433X |
| language | English |
| last_indexed | 2024-03-09T19:35:15Z |
| publishDate | 2022-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Journal of Imaging |
| spelling | doaj.art-1439f7de24b54d4e968ea2281430db562023-11-24T01:54:39ZengMDPI AGJournal of Imaging2313-433X2022-02-01835210.3390/jimaging8030052Qualitative Comparison of Image Stitching Algorithms for Multi-Camera Systems in LaparoscopySylvain Guy0Jean-Loup Haberbusch1Emmanuel Promayon2Stéphane Mancini3Sandrine Voros4University Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, FranceUniversity Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, FranceUniversity Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, FranceUniversity Grenoble Alpes, TIMA, 38031 Grenoble, FranceUniversity Grenoble Alpes, CNRS, UMR 5525, VetAgro Sup, Grenoble INP, TIMC, 38000 Grenoble, FranceMulti-camera systems were recently introduced into laparoscopy to increase the narrow field of view of the surgeon. The video streams are stitched together to create a panorama that is easier for the surgeon to comprehend. Multi-camera prototypes for laparoscopy use quite basic algorithms and have only been evaluated on simple laparoscopic scenarios. The more recent state-of-the-art algorithms, mainly designed for the smartphone industry, have not yet been evaluated in laparoscopic conditions. We developed a simulated environment to generate a dataset of multi-view images displaying a wide range of laparoscopic situations, which is adaptable to any multi-camera system. We evaluated classical and state-of-the-art image stitching techniques used in non-medical applications on this dataset, including one unsupervised deep learning approach. We show that classical techniques that use global homography fail to provide a clinically satisfactory rendering and that even the most recent techniques, despite providing high quality panorama images in non-medical situations, may suffer from poor alignment or severe distortions in simulated laparoscopic scenarios. We highlight the main advantages and flaws of each algorithm within a laparoscopic context, identify the main remaining challenges that are specific to laparoscopy, and propose methods to improve these approaches. We provide public access to the simulated environment and dataset.https://www.mdpi.com/2313-433X/8/3/52laparoscopic surgerydistributed vision systemimage stitchingpanoramasimulated environment |
| spellingShingle | Sylvain Guy Jean-Loup Haberbusch Emmanuel Promayon Stéphane Mancini Sandrine Voros Qualitative Comparison of Image Stitching Algorithms for Multi-Camera Systems in Laparoscopy Journal of Imaging laparoscopic surgery distributed vision system image stitching panorama simulated environment |
| title | Qualitative Comparison of Image Stitching Algorithms for Multi-Camera Systems in Laparoscopy |
| title_full | Qualitative Comparison of Image Stitching Algorithms for Multi-Camera Systems in Laparoscopy |
| title_fullStr | Qualitative Comparison of Image Stitching Algorithms for Multi-Camera Systems in Laparoscopy |
| title_full_unstemmed | Qualitative Comparison of Image Stitching Algorithms for Multi-Camera Systems in Laparoscopy |
| title_short | Qualitative Comparison of Image Stitching Algorithms for Multi-Camera Systems in Laparoscopy |
| title_sort | qualitative comparison of image stitching algorithms for multi camera systems in laparoscopy |
| topic | laparoscopic surgery distributed vision system image stitching panorama simulated environment |
| url | https://www.mdpi.com/2313-433X/8/3/52 |
| work_keys_str_mv | AT sylvainguy qualitativecomparisonofimagestitchingalgorithmsformulticamerasystemsinlaparoscopy AT jeanlouphaberbusch qualitativecomparisonofimagestitchingalgorithmsformulticamerasystemsinlaparoscopy AT emmanuelpromayon qualitativecomparisonofimagestitchingalgorithmsformulticamerasystemsinlaparoscopy AT stephanemancini qualitativecomparisonofimagestitchingalgorithmsformulticamerasystemsinlaparoscopy AT sandrinevoros qualitativecomparisonofimagestitchingalgorithmsformulticamerasystemsinlaparoscopy |