Reduction of Motion Artifacts From Remote Photoplethysmography Using Adaptive Noise Cancellation and Modified HSI Model

Remote photoplethysmography (rPPG) is a method to measure cardiac activities without any contact sensors. Non-contact sensors include radar, laser, and digital cameras, and there have been wide developments regarding the measurement of rPPG signals using continuous face frames. However, non-contact...

Full description

Bibliographic Details
Main Authors: Dongrae Cho, Jongin Kim, Kwang Jin Lee, Sayup Kim
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9517303/
_version_ 1830177703343423488
author Dongrae Cho
Jongin Kim
Kwang Jin Lee
Sayup Kim
author_facet Dongrae Cho
Jongin Kim
Kwang Jin Lee
Sayup Kim
author_sort Dongrae Cho
collection DOAJ
description Remote photoplethysmography (rPPG) is a method to measure cardiac activities without any contact sensors. Non-contact sensors include radar, laser, and digital cameras, and there have been wide developments regarding the measurement of rPPG signals using continuous face frames. However, non-contact sensors are quite sensitive to the subject’s motion, which causes motion artifacts. In this paper, two hypotheses are proposed: a) the motion artifacts are caused by unevenly reflected light due to the curvature of the subject’s face; and b) melanin and residuals in the continuous face frames are time-varying values whenever the subject’s movement is triggered. Adaptive noise cancellation based on recursive least square (ANS based on RLS) using the Lambert-Beer law and the hue–saturation–intensity (HSI) model were applied. The former is used for skin modeling, and the latter is used to reduce noises derived by the curvature of the face. Furthermore, the proposed algorithm is directly applied to two-dimensional continuous face frames and results in the rPPG signal and rPPG image, respectively. To evaluate proposed algorithm, two different experiments (e.g., static and dynamic situation) were conducted. Furthermore, in a study with 15 participants, the performances of heart rate estimation and heart rate variability (HRV) were evaluated by comparing the proposed method with previously developed methods. The results showed that a) the artifacts derived by head movement are efficiently removed, compared to previous methods; and b) rPPG images describing the spread of facial blood flow are acquired in real-time.
first_indexed 2024-12-17T19:29:54Z
format Article
id doaj.art-09e798a696c845c1ac24b6672b39d258
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-17T19:29:54Z
publishDate 2021-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-09e798a696c845c1ac24b6672b39d2582022-12-21T21:35:17ZengIEEEIEEE Access2169-35362021-01-01912265512266710.1109/ACCESS.2021.31060469517303Reduction of Motion Artifacts From Remote Photoplethysmography Using Adaptive Noise Cancellation and Modified HSI ModelDongrae Cho0https://orcid.org/0000-0002-3741-3410Jongin Kim1Kwang Jin Lee2Sayup Kim3https://orcid.org/0000-0001-6761-5155Deepmedi Research Institute of Integrated Technology, Deepmedi Inc., Seoul, South KoreaDeepmedi Research Institute of Integrated Technology, Deepmedi Inc., Seoul, South KoreaDeepmedi Research Institute of Integrated Technology, Deepmedi Inc., Seoul, South KoreaDigital Transformation Research and Development Department, Korea Institute of Industrial Technology, Ansan, South KoreaRemote photoplethysmography (rPPG) is a method to measure cardiac activities without any contact sensors. Non-contact sensors include radar, laser, and digital cameras, and there have been wide developments regarding the measurement of rPPG signals using continuous face frames. However, non-contact sensors are quite sensitive to the subject’s motion, which causes motion artifacts. In this paper, two hypotheses are proposed: a) the motion artifacts are caused by unevenly reflected light due to the curvature of the subject’s face; and b) melanin and residuals in the continuous face frames are time-varying values whenever the subject’s movement is triggered. Adaptive noise cancellation based on recursive least square (ANS based on RLS) using the Lambert-Beer law and the hue–saturation–intensity (HSI) model were applied. The former is used for skin modeling, and the latter is used to reduce noises derived by the curvature of the face. Furthermore, the proposed algorithm is directly applied to two-dimensional continuous face frames and results in the rPPG signal and rPPG image, respectively. To evaluate proposed algorithm, two different experiments (e.g., static and dynamic situation) were conducted. Furthermore, in a study with 15 participants, the performances of heart rate estimation and heart rate variability (HRV) were evaluated by comparing the proposed method with previously developed methods. The results showed that a) the artifacts derived by head movement are efficiently removed, compared to previous methods; and b) rPPG images describing the spread of facial blood flow are acquired in real-time.https://ieeexplore.ieee.org/document/9517303/Adaptive noise cancellation (ANC)heart rate variability (HRV)HSI color modelphotoplethysmography (PPG)recursive least square (RLS)remote sensing
spellingShingle Dongrae Cho
Jongin Kim
Kwang Jin Lee
Sayup Kim
Reduction of Motion Artifacts From Remote Photoplethysmography Using Adaptive Noise Cancellation and Modified HSI Model
IEEE Access
Adaptive noise cancellation (ANC)
heart rate variability (HRV)
HSI color model
photoplethysmography (PPG)
recursive least square (RLS)
remote sensing
title Reduction of Motion Artifacts From Remote Photoplethysmography Using Adaptive Noise Cancellation and Modified HSI Model
title_full Reduction of Motion Artifacts From Remote Photoplethysmography Using Adaptive Noise Cancellation and Modified HSI Model
title_fullStr Reduction of Motion Artifacts From Remote Photoplethysmography Using Adaptive Noise Cancellation and Modified HSI Model
title_full_unstemmed Reduction of Motion Artifacts From Remote Photoplethysmography Using Adaptive Noise Cancellation and Modified HSI Model
title_short Reduction of Motion Artifacts From Remote Photoplethysmography Using Adaptive Noise Cancellation and Modified HSI Model
title_sort reduction of motion artifacts from remote photoplethysmography using adaptive noise cancellation and modified hsi model
topic Adaptive noise cancellation (ANC)
heart rate variability (HRV)
HSI color model
photoplethysmography (PPG)
recursive least square (RLS)
remote sensing
url https://ieeexplore.ieee.org/document/9517303/
work_keys_str_mv AT dongraecho reductionofmotionartifactsfromremotephotoplethysmographyusingadaptivenoisecancellationandmodifiedhsimodel
AT jonginkim reductionofmotionartifactsfromremotephotoplethysmographyusingadaptivenoisecancellationandmodifiedhsimodel
AT kwangjinlee reductionofmotionartifactsfromremotephotoplethysmographyusingadaptivenoisecancellationandmodifiedhsimodel
AT sayupkim reductionofmotionartifactsfromremotephotoplethysmographyusingadaptivenoisecancellationandmodifiedhsimodel