A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy Adults
The primary aim of this study was to examine the validity of six commonly used wearable devices, i.e., Apple Watch S6, Garmin Forerunner 245 Music, Polar Vantage V, Oura Ring Generation 2, WHOOP 3.0 and Somfit, for assessing sleep. The secondary aim was to examine the validity of the six devices for...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/22/16/6317 |
| _version_ | 1797407978539712512 |
|---|---|
| author | Dean J. Miller Charli Sargent Gregory D. Roach |
| author_facet | Dean J. Miller Charli Sargent Gregory D. Roach |
| author_sort | Dean J. Miller |
| collection | DOAJ |
| description | The primary aim of this study was to examine the validity of six commonly used wearable devices, i.e., Apple Watch S6, Garmin Forerunner 245 Music, Polar Vantage V, Oura Ring Generation 2, WHOOP 3.0 and Somfit, for assessing sleep. The secondary aim was to examine the validity of the six devices for assessing heart rate and heart rate variability during, or just prior to, night-time sleep. Fifty-three adults (26 F, 27 M, aged 25.4 ± 5.9 years) spent a single night in a sleep laboratory with 9 h in bed (23:00–08:00 h). Participants were fitted with all six wearable devices—and with polysomnography and electrocardiography for gold-standard assessment of sleep and heart rate, respectively. Compared with polysomnography, agreement (and Cohen’s kappa) for two-state categorisation of sleep periods (as sleep or wake) was 88% (κ = 0.30) for Apple Watch; 89% (κ = 0.35) for Garmin; 87% (κ = 0.44) for Polar; 89% (κ = 0.51) for Oura; 86% (κ = 0.44) for WHOOP and 87% (κ = 0.48) for Somfit. Compared with polysomnography, agreement (and Cohen’s kappa) for multi-state categorisation of sleep periods (as a specific sleep stage or wake) was 53% (κ = 0.20) for Apple Watch; 50% (κ = 0.25) for Garmin; 51% (κ = 0.28) for Polar; 61% (κ = 0.43) for Oura; 60% (κ = 0.44) for WHOOP and 65% (κ = 0.52) for Somfit. Analyses regarding the two-state categorisation of sleep indicate that all six devices are valid for the field-based assessment of the timing and duration of sleep. However, analyses regarding the multi-state categorisation of sleep indicate that all six devices require improvement for the assessment of specific sleep stages. As the use of wearable devices that are valid for the assessment of sleep increases in the general community, so too does the potential to answer research questions that were previously impractical or impossible to address—in some way, we could consider that the whole world is becoming a sleep laboratory. |
| first_indexed | 2024-03-09T03:50:38Z |
| format | Article |
| id | doaj.art-8bdca05438bd47b6b2f929245cc89b75 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-09T03:50:38Z |
| publishDate | 2022-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-8bdca05438bd47b6b2f929245cc89b752023-12-03T14:27:53ZengMDPI AGSensors1424-82202022-08-012216631710.3390/s22166317A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy AdultsDean J. Miller0Charli Sargent1Gregory D. Roach2The Appleton Institute for Behavioural Science, Central Queensland University, Wayville, SA 5034, AustraliaThe Appleton Institute for Behavioural Science, Central Queensland University, Wayville, SA 5034, AustraliaThe Appleton Institute for Behavioural Science, Central Queensland University, Wayville, SA 5034, AustraliaThe primary aim of this study was to examine the validity of six commonly used wearable devices, i.e., Apple Watch S6, Garmin Forerunner 245 Music, Polar Vantage V, Oura Ring Generation 2, WHOOP 3.0 and Somfit, for assessing sleep. The secondary aim was to examine the validity of the six devices for assessing heart rate and heart rate variability during, or just prior to, night-time sleep. Fifty-three adults (26 F, 27 M, aged 25.4 ± 5.9 years) spent a single night in a sleep laboratory with 9 h in bed (23:00–08:00 h). Participants were fitted with all six wearable devices—and with polysomnography and electrocardiography for gold-standard assessment of sleep and heart rate, respectively. Compared with polysomnography, agreement (and Cohen’s kappa) for two-state categorisation of sleep periods (as sleep or wake) was 88% (κ = 0.30) for Apple Watch; 89% (κ = 0.35) for Garmin; 87% (κ = 0.44) for Polar; 89% (κ = 0.51) for Oura; 86% (κ = 0.44) for WHOOP and 87% (κ = 0.48) for Somfit. Compared with polysomnography, agreement (and Cohen’s kappa) for multi-state categorisation of sleep periods (as a specific sleep stage or wake) was 53% (κ = 0.20) for Apple Watch; 50% (κ = 0.25) for Garmin; 51% (κ = 0.28) for Polar; 61% (κ = 0.43) for Oura; 60% (κ = 0.44) for WHOOP and 65% (κ = 0.52) for Somfit. Analyses regarding the two-state categorisation of sleep indicate that all six devices are valid for the field-based assessment of the timing and duration of sleep. However, analyses regarding the multi-state categorisation of sleep indicate that all six devices require improvement for the assessment of specific sleep stages. As the use of wearable devices that are valid for the assessment of sleep increases in the general community, so too does the potential to answer research questions that were previously impractical or impossible to address—in some way, we could consider that the whole world is becoming a sleep laboratory.https://www.mdpi.com/1424-8220/22/16/6317wearable sleep monitorconsumer sleep technologysleep qualitysleep quantitysleep stagingautonomic nervous system |
| spellingShingle | Dean J. Miller Charli Sargent Gregory D. Roach A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy Adults Sensors wearable sleep monitor consumer sleep technology sleep quality sleep quantity sleep staging autonomic nervous system |
| title | A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy Adults |
| title_full | A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy Adults |
| title_fullStr | A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy Adults |
| title_full_unstemmed | A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy Adults |
| title_short | A Validation of Six Wearable Devices for Estimating Sleep, Heart Rate and Heart Rate Variability in Healthy Adults |
| title_sort | validation of six wearable devices for estimating sleep heart rate and heart rate variability in healthy adults |
| topic | wearable sleep monitor consumer sleep technology sleep quality sleep quantity sleep staging autonomic nervous system |
| url | https://www.mdpi.com/1424-8220/22/16/6317 |
| work_keys_str_mv | AT deanjmiller avalidationofsixwearabledevicesforestimatingsleepheartrateandheartratevariabilityinhealthyadults AT charlisargent avalidationofsixwearabledevicesforestimatingsleepheartrateandheartratevariabilityinhealthyadults AT gregorydroach avalidationofsixwearabledevicesforestimatingsleepheartrateandheartratevariabilityinhealthyadults AT deanjmiller validationofsixwearabledevicesforestimatingsleepheartrateandheartratevariabilityinhealthyadults AT charlisargent validationofsixwearabledevicesforestimatingsleepheartrateandheartratevariabilityinhealthyadults AT gregorydroach validationofsixwearabledevicesforestimatingsleepheartrateandheartratevariabilityinhealthyadults |