Current applications of artificial intelligence-based computer vision in laparoscopic surgery

Recent advances in artificial intelligence (AI) have sparked a surge in the application of computer vision (CV) in surgical video analysis. Laparoscopic surgery produces a large number of surgical videos, which provides a new opportunity for improving of CV technology in laparoscopic surgery. AI-bas...

Full description

Bibliographic Details
Main Authors: Kangwei Guo, Haisu Tao, Yilin Zhu, Baihong Li, Chihua Fang, Yinling Qian, Jian Yang
Format: Article
Language:English
Published: KeAi Communications Co., Ltd. 2023-09-01
Series:Laparoscopic, Endoscopic and Robotic Surgery
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2468900923000403
_version_ 1797670284318212096
author Kangwei Guo
Haisu Tao
Yilin Zhu
Baihong Li
Chihua Fang
Yinling Qian
Jian Yang
author_facet Kangwei Guo
Haisu Tao
Yilin Zhu
Baihong Li
Chihua Fang
Yinling Qian
Jian Yang
author_sort Kangwei Guo
collection DOAJ
description Recent advances in artificial intelligence (AI) have sparked a surge in the application of computer vision (CV) in surgical video analysis. Laparoscopic surgery produces a large number of surgical videos, which provides a new opportunity for improving of CV technology in laparoscopic surgery. AI-based CV techniques may leverage these surgical video data to develop real-time automated decision support tools and surgeon training systems, which shows a new direction in dealing with the shortcomings of laparoscopic surgery. The effectiveness of CV applications in surgical procedures is still under early evaluation, so it is necessary to discuss challenges and obstacles. The review introduced the commonly used deep learning algorithms in CV and described their usage in detail in four application scenes, including phase recognition, anatomy detection, instrument detection and action recognition in laparoscopic surgery. The currently described applications of CV in laparoscopic surgery are limited. Most of the current research focuses on the identification of workflow and anatomical structure, while the identification of instruments and surgical actions is still awaiting further breakthroughs. Future research on the use of CV in laparoscopic surgery should focus on applications in more scenarios, such as surgeon skill assessment and the development of more efficient models.
first_indexed 2024-03-11T20:57:28Z
format Article
id doaj.art-2740b23e82f749bea5750e03617f5703
institution Directory Open Access Journal
issn 2468-9009
language English
last_indexed 2024-03-11T20:57:28Z
publishDate 2023-09-01
publisher KeAi Communications Co., Ltd.
record_format Article
series Laparoscopic, Endoscopic and Robotic Surgery
spelling doaj.art-2740b23e82f749bea5750e03617f57032023-09-30T04:55:21ZengKeAi Communications Co., Ltd.Laparoscopic, Endoscopic and Robotic Surgery2468-90092023-09-01639196Current applications of artificial intelligence-based computer vision in laparoscopic surgeryKangwei Guo0Haisu Tao1Yilin Zhu2Baihong Li3Chihua Fang4Yinling Qian5Jian Yang6The First Department of Hepatobiliary Surgery, Zhujiang Hospital, Southern Medical University, Guangzhou 510280, China; Guangdong Provincial Clinical and Engineering Center of Digital Medicine, Guangzhou 510280, ChinaThe First Department of Hepatobiliary Surgery, Zhujiang Hospital, Southern Medical University, Guangzhou 510280, China; Guangdong Provincial Clinical and Engineering Center of Digital Medicine, Guangzhou 510280, ChinaThe Second Clinical Medical College of Southern Medical University, Guangzhou 510280, ChinaThe First Department of Hepatobiliary Surgery, Zhujiang Hospital, Southern Medical University, Guangzhou 510280, China; Guangdong Provincial Clinical and Engineering Center of Digital Medicine, Guangzhou 510280, ChinaThe First Department of Hepatobiliary Surgery, Zhujiang Hospital, Southern Medical University, Guangzhou 510280, China; Guangdong Provincial Clinical and Engineering Center of Digital Medicine, Guangzhou 510280, ChinaShenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; Corresponding author: Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China.The First Department of Hepatobiliary Surgery, Zhujiang Hospital, Southern Medical University, Guangzhou 510280, China; Guangdong Provincial Clinical and Engineering Center of Digital Medicine, Guangzhou 510280, China; Corresponding author: The First Department of Hepatobiliary Surgery, Zhujiang Hospital, Southern Medical University, Guangzhou 510280, China.Recent advances in artificial intelligence (AI) have sparked a surge in the application of computer vision (CV) in surgical video analysis. Laparoscopic surgery produces a large number of surgical videos, which provides a new opportunity for improving of CV technology in laparoscopic surgery. AI-based CV techniques may leverage these surgical video data to develop real-time automated decision support tools and surgeon training systems, which shows a new direction in dealing with the shortcomings of laparoscopic surgery. The effectiveness of CV applications in surgical procedures is still under early evaluation, so it is necessary to discuss challenges and obstacles. The review introduced the commonly used deep learning algorithms in CV and described their usage in detail in four application scenes, including phase recognition, anatomy detection, instrument detection and action recognition in laparoscopic surgery. The currently described applications of CV in laparoscopic surgery are limited. Most of the current research focuses on the identification of workflow and anatomical structure, while the identification of instruments and surgical actions is still awaiting further breakthroughs. Future research on the use of CV in laparoscopic surgery should focus on applications in more scenarios, such as surgeon skill assessment and the development of more efficient models.http://www.sciencedirect.com/science/article/pii/S2468900923000403Artificial intelligenceComputer visionDeep learningLaparoscopic surgery
spellingShingle Kangwei Guo
Haisu Tao
Yilin Zhu
Baihong Li
Chihua Fang
Yinling Qian
Jian Yang
Current applications of artificial intelligence-based computer vision in laparoscopic surgery
Laparoscopic, Endoscopic and Robotic Surgery
Artificial intelligence
Computer vision
Deep learning
Laparoscopic surgery
title Current applications of artificial intelligence-based computer vision in laparoscopic surgery
title_full Current applications of artificial intelligence-based computer vision in laparoscopic surgery
title_fullStr Current applications of artificial intelligence-based computer vision in laparoscopic surgery
title_full_unstemmed Current applications of artificial intelligence-based computer vision in laparoscopic surgery
title_short Current applications of artificial intelligence-based computer vision in laparoscopic surgery
title_sort current applications of artificial intelligence based computer vision in laparoscopic surgery
topic Artificial intelligence
Computer vision
Deep learning
Laparoscopic surgery
url http://www.sciencedirect.com/science/article/pii/S2468900923000403
work_keys_str_mv AT kangweiguo currentapplicationsofartificialintelligencebasedcomputervisioninlaparoscopicsurgery
AT haisutao currentapplicationsofartificialintelligencebasedcomputervisioninlaparoscopicsurgery
AT yilinzhu currentapplicationsofartificialintelligencebasedcomputervisioninlaparoscopicsurgery
AT baihongli currentapplicationsofartificialintelligencebasedcomputervisioninlaparoscopicsurgery
AT chihuafang currentapplicationsofartificialintelligencebasedcomputervisioninlaparoscopicsurgery
AT yinlingqian currentapplicationsofartificialintelligencebasedcomputervisioninlaparoscopicsurgery
AT jianyang currentapplicationsofartificialintelligencebasedcomputervisioninlaparoscopicsurgery