Design and voice‐based control of a nasal endoscopic surgical robot

Abstract In traditional nasal surgery, surgeons are prone to fatigue and jitter by holding the endoscope for a long‐time. Some complex operations require assistant surgeon to assist with holding the endoscope. To address the above problems, the authors design a remote centre of motion based nasal ro...

Full description

Bibliographic Details
Main Authors: Yucheng He, Zhen Deng, Jianwei Zhang
Format: Article
Language:English
Published: Wiley 2021-03-01
Series:CAAI Transactions on Intelligence Technology
Subjects:
Online Access:https://doi.org/10.1049/cit2.12022
_version_ 1828140674759786496
author Yucheng He
Zhen Deng
Jianwei Zhang
author_facet Yucheng He
Zhen Deng
Jianwei Zhang
author_sort Yucheng He
collection DOAJ
description Abstract In traditional nasal surgery, surgeons are prone to fatigue and jitter by holding the endoscope for a long‐time. Some complex operations require assistant surgeon to assist with holding the endoscope. To address the above problems, the authors design a remote centre of motion based nasal robot, and propose a voice‐based robot control method. First, through the operation space analysis of nasal surgery, the design scheme of the robot based on RCM mechanism is proposed. On this basis, the design parameters of the robot are analysed to complete the entire design of robot. Then, considering that the surgeon's hands are occupied by surgical instruments during complex surgical operations, a voice‐based robot control method is proposed. This method obtains direction instructions from surgeons by analysing the movement of the endoscopic image. Afterward, a commercial speech recognition interface is used to realise the offline grammar controlwords lib compatible with both Chinese and English, and the overall strategy of robot control is proposed. Finally, an experimental platform for virtual robot control is established, and the voice‐based robot control experiment is performed. The results show that the proposed voice‐based control method is feasible, and it provides guidance for the subsequent development and control of the actual robot system.
first_indexed 2024-04-11T19:13:57Z
format Article
id doaj.art-007b4e3836bc475890876e52b32ca67b
institution Directory Open Access Journal
issn 2468-2322
language English
last_indexed 2024-04-11T19:13:57Z
publishDate 2021-03-01
publisher Wiley
record_format Article
series CAAI Transactions on Intelligence Technology
spelling doaj.art-007b4e3836bc475890876e52b32ca67b2022-12-22T04:07:29ZengWileyCAAI Transactions on Intelligence Technology2468-23222021-03-016112313110.1049/cit2.12022Design and voice‐based control of a nasal endoscopic surgical robotYucheng He0Zhen Deng1Jianwei Zhang2Department of Mechanical and Automation Engineering Chinese University of Hong Kong Hong Kong ChinaDepartment of Informatics University of Hamburg Hamburg GermanyDepartment of Informatics University of Hamburg Hamburg GermanyAbstract In traditional nasal surgery, surgeons are prone to fatigue and jitter by holding the endoscope for a long‐time. Some complex operations require assistant surgeon to assist with holding the endoscope. To address the above problems, the authors design a remote centre of motion based nasal robot, and propose a voice‐based robot control method. First, through the operation space analysis of nasal surgery, the design scheme of the robot based on RCM mechanism is proposed. On this basis, the design parameters of the robot are analysed to complete the entire design of robot. Then, considering that the surgeon's hands are occupied by surgical instruments during complex surgical operations, a voice‐based robot control method is proposed. This method obtains direction instructions from surgeons by analysing the movement of the endoscopic image. Afterward, a commercial speech recognition interface is used to realise the offline grammar controlwords lib compatible with both Chinese and English, and the overall strategy of robot control is proposed. Finally, an experimental platform for virtual robot control is established, and the voice‐based robot control experiment is performed. The results show that the proposed voice‐based control method is feasible, and it provides guidance for the subsequent development and control of the actual robot system.https://doi.org/10.1049/cit2.12022endoscopesmedical roboticsspeech‐based user interfacesspeech recognitionsurgeryhuman‐robot interaction
spellingShingle Yucheng He
Zhen Deng
Jianwei Zhang
Design and voice‐based control of a nasal endoscopic surgical robot
CAAI Transactions on Intelligence Technology
endoscopes
medical robotics
speech‐based user interfaces
speech recognition
surgery
human‐robot interaction
title Design and voice‐based control of a nasal endoscopic surgical robot
title_full Design and voice‐based control of a nasal endoscopic surgical robot
title_fullStr Design and voice‐based control of a nasal endoscopic surgical robot
title_full_unstemmed Design and voice‐based control of a nasal endoscopic surgical robot
title_short Design and voice‐based control of a nasal endoscopic surgical robot
title_sort design and voice based control of a nasal endoscopic surgical robot
topic endoscopes
medical robotics
speech‐based user interfaces
speech recognition
surgery
human‐robot interaction
url https://doi.org/10.1049/cit2.12022
work_keys_str_mv AT yuchenghe designandvoicebasedcontrolofanasalendoscopicsurgicalrobot
AT zhendeng designandvoicebasedcontrolofanasalendoscopicsurgicalrobot
AT jianweizhang designandvoicebasedcontrolofanasalendoscopicsurgicalrobot