Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot
Robotic surgery involves significant task switching between tool control and camera control, which can be a source of distraction and error. This study evaluated the performance of a voice-enabled autonomous camera control system compared to a human-operated camera for the da Vinci surgical robot. T...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-01-01
|
| Series: | Robotics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2218-6581/13/1/10 |
| _version_ | 1797342591595839488 |
|---|---|
| author | Reenu Arikkat Paul Luay Jawad Abhishek Shankar Maitreyee Majumdar Troy Herrick-Thomason Abhilash Pandya |
| author_facet | Reenu Arikkat Paul Luay Jawad Abhishek Shankar Maitreyee Majumdar Troy Herrick-Thomason Abhilash Pandya |
| author_sort | Reenu Arikkat Paul |
| collection | DOAJ |
| description | Robotic surgery involves significant task switching between tool control and camera control, which can be a source of distraction and error. This study evaluated the performance of a voice-enabled autonomous camera control system compared to a human-operated camera for the da Vinci surgical robot. Twenty subjects performed a series of tasks that required them to instruct the camera to move to specific locations to complete the tasks. The subjects performed the tasks (1) using an automated camera system that could be tailored based on keywords; and (2) directing a human camera operator using voice commands. The data were analyzed using task completion measures and the NASA Task Load Index (TLX) human performance metrics. The human-operated camera control method was able to outperform an automated algorithm in terms of task completion (6.96 vs. 7.71 correct insertions; <i>p</i>-value = 0.044). However, subjective feedback suggests that a voice-enabled autonomous camera control system is comparable to a human-operated camera control system. Based on the subjects’ feedback, thirteen out of the twenty subjects preferred the voice-enabled autonomous camera control system including the surgeon. This study is a step towards a more natural language interface for surgical robotics as these systems become better partners during surgery. |
| first_indexed | 2024-03-08T10:35:30Z |
| format | Article |
| id | doaj.art-7ba98f9d364a48c88804da275978514b |
| institution | Directory Open Access Journal |
| issn | 2218-6581 |
| language | English |
| last_indexed | 2024-03-08T10:35:30Z |
| publishDate | 2024-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Robotics |
| spelling | doaj.art-7ba98f9d364a48c88804da275978514b2024-01-26T18:21:38ZengMDPI AGRobotics2218-65812024-01-011311010.3390/robotics13010010Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical RobotReenu Arikkat Paul0Luay Jawad1Abhishek Shankar2Maitreyee Majumdar3Troy Herrick-Thomason4Abhilash Pandya5Department of Electrical and Computer Engineering, Wayne State University, Detroit, MI 48202, USADepartment of Computer Science, Wayne State University, Detroit, MI 48202, USADepartment of Computer Science, Wayne State University, Detroit, MI 48202, USADepartment of Electrical and Computer Engineering, Wayne State University, Detroit, MI 48202, USADepartment of Psychology, Wayne State University, Detroit, MI 48202, USADepartment of Electrical and Computer Engineering, Wayne State University, Detroit, MI 48202, USARobotic surgery involves significant task switching between tool control and camera control, which can be a source of distraction and error. This study evaluated the performance of a voice-enabled autonomous camera control system compared to a human-operated camera for the da Vinci surgical robot. Twenty subjects performed a series of tasks that required them to instruct the camera to move to specific locations to complete the tasks. The subjects performed the tasks (1) using an automated camera system that could be tailored based on keywords; and (2) directing a human camera operator using voice commands. The data were analyzed using task completion measures and the NASA Task Load Index (TLX) human performance metrics. The human-operated camera control method was able to outperform an automated algorithm in terms of task completion (6.96 vs. 7.71 correct insertions; <i>p</i>-value = 0.044). However, subjective feedback suggests that a voice-enabled autonomous camera control system is comparable to a human-operated camera control system. Based on the subjects’ feedback, thirteen out of the twenty subjects preferred the voice-enabled autonomous camera control system including the surgeon. This study is a step towards a more natural language interface for surgical robotics as these systems become better partners during surgery.https://www.mdpi.com/2218-6581/13/1/10robotic surgeryautomated camerada Vinci systemnatural language processing |
| spellingShingle | Reenu Arikkat Paul Luay Jawad Abhishek Shankar Maitreyee Majumdar Troy Herrick-Thomason Abhilash Pandya Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot Robotics robotic surgery automated camera da Vinci system natural language processing |
| title | Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot |
| title_full | Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot |
| title_fullStr | Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot |
| title_full_unstemmed | Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot |
| title_short | Evaluation of a Voice-Enabled Autonomous Camera Control System for the da Vinci Surgical Robot |
| title_sort | evaluation of a voice enabled autonomous camera control system for the da vinci surgical robot |
| topic | robotic surgery automated camera da Vinci system natural language processing |
| url | https://www.mdpi.com/2218-6581/13/1/10 |
| work_keys_str_mv | AT reenuarikkatpaul evaluationofavoiceenabledautonomouscameracontrolsystemforthedavincisurgicalrobot AT luayjawad evaluationofavoiceenabledautonomouscameracontrolsystemforthedavincisurgicalrobot AT abhishekshankar evaluationofavoiceenabledautonomouscameracontrolsystemforthedavincisurgicalrobot AT maitreyeemajumdar evaluationofavoiceenabledautonomouscameracontrolsystemforthedavincisurgicalrobot AT troyherrickthomason evaluationofavoiceenabledautonomouscameracontrolsystemforthedavincisurgicalrobot AT abhilashpandya evaluationofavoiceenabledautonomouscameracontrolsystemforthedavincisurgicalrobot |