Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging
Monitoring of respiration and body movements during sleep is a part of screening sleep disorders related to health status. Nowadays, thermal-based methods are presented to monitor the sleeping person without any sensors attached to the body to protect privacy. A non-contact respiration monitoring ba...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-11-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/20/21/6307 |
| _version_ | 1797548697088688128 |
|---|---|
| author | Prasara Jakkaew Takao Onoye |
| author_facet | Prasara Jakkaew Takao Onoye |
| author_sort | Prasara Jakkaew |
| collection | DOAJ |
| description | Monitoring of respiration and body movements during sleep is a part of screening sleep disorders related to health status. Nowadays, thermal-based methods are presented to monitor the sleeping person without any sensors attached to the body to protect privacy. A non-contact respiration monitoring based on thermal videos requires visible facial landmarks like nostril and mouth. The limitation of these techniques is the failure of face detection while sleeping with a fixed camera position. This study presents the non-contact respiration monitoring approach that does not require facial landmark visibility under the natural sleep environment, which implies an uncontrolled sleep posture, darkness, and subjects covered with a blanket. The automatic region of interest (ROI) extraction by temperature detection and breathing motion detection is based on image processing integrated to obtain the respiration signals. A signal processing technique was used to estimate respiration and body movements information from a sequence of thermal video. The proposed approach has been tested on 16 volunteers, for which video recordings were carried out by themselves. The participants were also asked to wear the Go Direct respiratory belt for capturing reference data. The result revealed that our proposed measuring respiratory rate obtains root mean square error (RMSE) of <inline-formula><math display="inline"><semantics><mrow><mn>1.82</mn><mo>±</mo><mrow><mn>0.75</mn></mrow></mrow></semantics></math></inline-formula> bpm. The advantage of this approach lies in its simplicity and accessibility to serve users who require monitoring the respiration during sleep without direct contact by themselves. |
| first_indexed | 2024-03-10T15:04:21Z |
| format | Article |
| id | doaj.art-afe9130be00741fe8b5102cee0696c66 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T15:04:21Z |
| publishDate | 2020-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-afe9130be00741fe8b5102cee0696c662023-11-20T19:56:21ZengMDPI AGSensors1424-82202020-11-012021630710.3390/s20216307Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal ImagingPrasara Jakkaew0Takao Onoye1Information Systems Synthesis Laboratory, Department of Information Systems Engineering, Graduate School of Information Science and Technology, Osaka University, 1-5 Yamadaoka, Suita, Osaka 565-0871, JapanInformation Systems Synthesis Laboratory, Department of Information Systems Engineering, Graduate School of Information Science and Technology, Osaka University, 1-5 Yamadaoka, Suita, Osaka 565-0871, JapanMonitoring of respiration and body movements during sleep is a part of screening sleep disorders related to health status. Nowadays, thermal-based methods are presented to monitor the sleeping person without any sensors attached to the body to protect privacy. A non-contact respiration monitoring based on thermal videos requires visible facial landmarks like nostril and mouth. The limitation of these techniques is the failure of face detection while sleeping with a fixed camera position. This study presents the non-contact respiration monitoring approach that does not require facial landmark visibility under the natural sleep environment, which implies an uncontrolled sleep posture, darkness, and subjects covered with a blanket. The automatic region of interest (ROI) extraction by temperature detection and breathing motion detection is based on image processing integrated to obtain the respiration signals. A signal processing technique was used to estimate respiration and body movements information from a sequence of thermal video. The proposed approach has been tested on 16 volunteers, for which video recordings were carried out by themselves. The participants were also asked to wear the Go Direct respiratory belt for capturing reference data. The result revealed that our proposed measuring respiratory rate obtains root mean square error (RMSE) of <inline-formula><math display="inline"><semantics><mrow><mn>1.82</mn><mo>±</mo><mrow><mn>0.75</mn></mrow></mrow></semantics></math></inline-formula> bpm. The advantage of this approach lies in its simplicity and accessibility to serve users who require monitoring the respiration during sleep without direct contact by themselves.https://www.mdpi.com/1424-8220/20/21/6307respiration monitoringnon-contact monitoringbody movements detectionthermal imagingnatural sleep environments |
| spellingShingle | Prasara Jakkaew Takao Onoye Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging Sensors respiration monitoring non-contact monitoring body movements detection thermal imaging natural sleep environments |
| title | Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging |
| title_full | Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging |
| title_fullStr | Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging |
| title_full_unstemmed | Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging |
| title_short | Non-Contact Respiration Monitoring and Body Movements Detection for Sleep Using Thermal Imaging |
| title_sort | non contact respiration monitoring and body movements detection for sleep using thermal imaging |
| topic | respiration monitoring non-contact monitoring body movements detection thermal imaging natural sleep environments |
| url | https://www.mdpi.com/1424-8220/20/21/6307 |
| work_keys_str_mv | AT prasarajakkaew noncontactrespirationmonitoringandbodymovementsdetectionforsleepusingthermalimaging AT takaoonoye noncontactrespirationmonitoringandbodymovementsdetectionforsleepusingthermalimaging |