Mobile Robotic Platform for Contactless Vital Sign Monitoring

The COVID-19 pandemic has accelerated methods to facilitate contactless evaluation of patients in hospital settings. By minimizing in-person contact with individuals who may have COVID-19, healthcare workers can prevent disease transmission and conserve personal protective equipment. Obtaining vital...

Full description

Bibliographic Details
Main Authors: Huang, Hen-Wei, Chen, Jack, Chai, Peter R., Ehmke, Claas, Rupp, Philipp, Dadabhoy, Farah Z., Feng, Annie, Li, Canchen, Thomas, Akhil J., da Silva, Marco, Boyer, Edward W., Traverso, Giovanni
Format: Article
Language:English
Published: American Association for the Advancement of Science 2024
Online Access:https://hdl.handle.net/1721.1/155047
_version_ 1811000141842219008
author Huang, Hen-Wei
Chen, Jack
Chai, Peter R.
Ehmke, Claas
Rupp, Philipp
Dadabhoy, Farah Z.
Feng, Annie
Li, Canchen
Thomas, Akhil J.
da Silva, Marco
Boyer, Edward W.
Traverso, Giovanni
author_facet Huang, Hen-Wei
Chen, Jack
Chai, Peter R.
Ehmke, Claas
Rupp, Philipp
Dadabhoy, Farah Z.
Feng, Annie
Li, Canchen
Thomas, Akhil J.
da Silva, Marco
Boyer, Edward W.
Traverso, Giovanni
author_sort Huang, Hen-Wei
collection MIT
description The COVID-19 pandemic has accelerated methods to facilitate contactless evaluation of patients in hospital settings. By minimizing in-person contact with individuals who may have COVID-19, healthcare workers can prevent disease transmission and conserve personal protective equipment. Obtaining vital signs is a ubiquitous task that is commonly done in person by healthcare workers. To eliminate the need for in-person contact for vital sign measurement in the hospital setting, we developed Dr. Spot, a mobile quadruped robotic system. The system includes IR and RGB cameras for vital sign monitoring and a tablet computer for face-to-face medical interviewing. Dr. Spot is teleoperated by trained clinical staff to simultaneously measure the skin temperature, respiratory rate, and heart rate while maintaining social distancing from patients and without removing their mask. To enable accurate, contactless measurements on a mobile system without a static black body as reference, we propose novel methods for skin temperature compensation and respiratory rate measurement at various distances between the subject and the cameras, up to 5 m. Without compensation, the skin temperature MAE is 1.3°C. Using the proposed compensation method, the skin temperature MAE is reduced to 0.3°C. The respiratory rate method can provide continuous monitoring with a MAE of 1.6 BPM in 30 s or rapid screening with a MAE of 2.1 BPM in 10 s. For the heart rate estimation, our system is able to achieve a MAE less than 8 BPM in 10 s measured in arbitrary indoor light conditions at any distance below 2 m.
first_indexed 2024-09-23T15:12:02Z
format Article
id mit-1721.1/155047
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T15:12:02Z
publishDate 2024
publisher American Association for the Advancement of Science
record_format dspace
spelling mit-1721.1/1550472024-09-21T04:17:44Z Mobile Robotic Platform for Contactless Vital Sign Monitoring Huang, Hen-Wei Chen, Jack Chai, Peter R. Ehmke, Claas Rupp, Philipp Dadabhoy, Farah Z. Feng, Annie Li, Canchen Thomas, Akhil J. da Silva, Marco Boyer, Edward W. Traverso, Giovanni The COVID-19 pandemic has accelerated methods to facilitate contactless evaluation of patients in hospital settings. By minimizing in-person contact with individuals who may have COVID-19, healthcare workers can prevent disease transmission and conserve personal protective equipment. Obtaining vital signs is a ubiquitous task that is commonly done in person by healthcare workers. To eliminate the need for in-person contact for vital sign measurement in the hospital setting, we developed Dr. Spot, a mobile quadruped robotic system. The system includes IR and RGB cameras for vital sign monitoring and a tablet computer for face-to-face medical interviewing. Dr. Spot is teleoperated by trained clinical staff to simultaneously measure the skin temperature, respiratory rate, and heart rate while maintaining social distancing from patients and without removing their mask. To enable accurate, contactless measurements on a mobile system without a static black body as reference, we propose novel methods for skin temperature compensation and respiratory rate measurement at various distances between the subject and the cameras, up to 5 m. Without compensation, the skin temperature MAE is 1.3°C. Using the proposed compensation method, the skin temperature MAE is reduced to 0.3°C. The respiratory rate method can provide continuous monitoring with a MAE of 1.6 BPM in 30 s or rapid screening with a MAE of 2.1 BPM in 10 s. For the heart rate estimation, our system is able to achieve a MAE less than 8 BPM in 10 s measured in arbitrary indoor light conditions at any distance below 2 m. 2024-05-23T19:40:40Z 2024-05-23T19:40:40Z 2022-01 2024-05-23T19:36:04Z Article http://purl.org/eprint/type/JournalArticle 2692-7632 https://hdl.handle.net/1721.1/155047 Hen-Wei Huang, Jack Chen, Peter R. Chai, Claas Ehmke, Philipp Rupp, Farah Z. Dadabhoy, Annie Feng, Canchen Li, Akhil J. Thomas, Marco da Silva, et al. Mobile Robotic Platform for Contactless Vital Sign Monitoring. Cyborg Bionic Syst. 2022. en 10.34133/2022/9780497 Cyborg and Bionic Systems Creative Commons Attribution https://creativecommons.org/licenses/by/4.0/ application/pdf American Association for the Advancement of Science American Association for the Advancement of Science
spellingShingle Huang, Hen-Wei
Chen, Jack
Chai, Peter R.
Ehmke, Claas
Rupp, Philipp
Dadabhoy, Farah Z.
Feng, Annie
Li, Canchen
Thomas, Akhil J.
da Silva, Marco
Boyer, Edward W.
Traverso, Giovanni
Mobile Robotic Platform for Contactless Vital Sign Monitoring
title Mobile Robotic Platform for Contactless Vital Sign Monitoring
title_full Mobile Robotic Platform for Contactless Vital Sign Monitoring
title_fullStr Mobile Robotic Platform for Contactless Vital Sign Monitoring
title_full_unstemmed Mobile Robotic Platform for Contactless Vital Sign Monitoring
title_short Mobile Robotic Platform for Contactless Vital Sign Monitoring
title_sort mobile robotic platform for contactless vital sign monitoring
url https://hdl.handle.net/1721.1/155047
work_keys_str_mv AT huanghenwei mobileroboticplatformforcontactlessvitalsignmonitoring
AT chenjack mobileroboticplatformforcontactlessvitalsignmonitoring
AT chaipeterr mobileroboticplatformforcontactlessvitalsignmonitoring
AT ehmkeclaas mobileroboticplatformforcontactlessvitalsignmonitoring
AT ruppphilipp mobileroboticplatformforcontactlessvitalsignmonitoring
AT dadabhoyfarahz mobileroboticplatformforcontactlessvitalsignmonitoring
AT fengannie mobileroboticplatformforcontactlessvitalsignmonitoring
AT licanchen mobileroboticplatformforcontactlessvitalsignmonitoring
AT thomasakhilj mobileroboticplatformforcontactlessvitalsignmonitoring
AT dasilvamarco mobileroboticplatformforcontactlessvitalsignmonitoring
AT boyeredwardw mobileroboticplatformforcontactlessvitalsignmonitoring
AT traversogiovanni mobileroboticplatformforcontactlessvitalsignmonitoring