ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANs
The types of Activities of Daily Living (ADL) a person performs or avoids, and underlying patterns can provide insights into physical and mental health, making passive ADL recognition from smartphone sensor data important. However, as people perform ADLs unequally in real life, ADL datasets collecte...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10113320/ |
| _version_ | 1797813952741113856 |
|---|---|
| author | Apiwat Ditthapron Adam C. Lammert Emmanuel O. Agu |
| author_facet | Apiwat Ditthapron Adam C. Lammert Emmanuel O. Agu |
| author_sort | Apiwat Ditthapron |
| collection | DOAJ |
| description | The types of Activities of Daily Living (ADL) a person performs or avoids, and underlying patterns can provide insights into physical and mental health, making passive ADL recognition from smartphone sensor data important. However, as people perform ADLs unequally in real life, ADL datasets collected in the wild can be extremely imbalanced, which presents a challenge to Machine Learning (ML) ADL classification. Prior solutions to mitigating imbalance, such as oversampling and instance weighting, reduce but do not completely eliminate the problem. We instead propose ADL-GAN, which utilizes translation Generative Adversarial Networks (GANs), to synthesize smartphone motion and audio sensor data to improve ADL classification performance. ADL-GANs augment the minority ADL of subject <inline-formula> <tex-math notation="LaTeX">$A$ </tex-math></inline-formula> by translating real samples from either 1) other ADLs where subject <inline-formula> <tex-math notation="LaTeX">$A$ </tex-math></inline-formula> has adequate data in Context-transfer ADL-GAN or 2) other subjects with adequate ADL data in Subject-transfer ADL-GAN. ADL-GANs utilize multi-domain and contrastive loss functions to perform many-to-many translations between ADL classes and subjects, respectively. Subject-transfer ADL-GAN outperformed baselines and improved balanced accuracy (BA) on an in-the-wild ADL dataset by 27.9 %, while context-transfer ADL-GAN performed best on a scripted dataset, improving the BA of baselines by 9.58 %. The augmented samples from ADL-GANs were shown to be more realistic and diverse than conditional GAN. |
| first_indexed | 2024-03-13T07:59:24Z |
| format | Article |
| id | doaj.art-a25ffaff7781422180b7ff320e865dd0 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-13T07:59:24Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-a25ffaff7781422180b7ff320e865dd02023-06-01T23:00:33ZengIEEEIEEE Access2169-35362023-01-0111506715068810.1109/ACCESS.2023.327140910113320ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANsApiwat Ditthapron0https://orcid.org/0000-0002-1525-8421Adam C. Lammert1https://orcid.org/0000-0001-8162-2693Emmanuel O. Agu2https://orcid.org/0000-0002-3361-4952Computer Science Department, Worcester Polytechnic Institute, Worcester, MA, USABiomedical Engineering Department, Worcester Polytechnic Institute, Worcester, MA, USAComputer Science Department, Worcester Polytechnic Institute, Worcester, MA, USAThe types of Activities of Daily Living (ADL) a person performs or avoids, and underlying patterns can provide insights into physical and mental health, making passive ADL recognition from smartphone sensor data important. However, as people perform ADLs unequally in real life, ADL datasets collected in the wild can be extremely imbalanced, which presents a challenge to Machine Learning (ML) ADL classification. Prior solutions to mitigating imbalance, such as oversampling and instance weighting, reduce but do not completely eliminate the problem. We instead propose ADL-GAN, which utilizes translation Generative Adversarial Networks (GANs), to synthesize smartphone motion and audio sensor data to improve ADL classification performance. ADL-GANs augment the minority ADL of subject <inline-formula> <tex-math notation="LaTeX">$A$ </tex-math></inline-formula> by translating real samples from either 1) other ADLs where subject <inline-formula> <tex-math notation="LaTeX">$A$ </tex-math></inline-formula> has adequate data in Context-transfer ADL-GAN or 2) other subjects with adequate ADL data in Subject-transfer ADL-GAN. ADL-GANs utilize multi-domain and contrastive loss functions to perform many-to-many translations between ADL classes and subjects, respectively. Subject-transfer ADL-GAN outperformed baselines and improved balanced accuracy (BA) on an in-the-wild ADL dataset by 27.9 %, while context-transfer ADL-GAN performed best on a scripted dataset, improving the BA of baselines by 9.58 %. The augmented samples from ADL-GANs were shown to be more realistic and diverse than conditional GAN.https://ieeexplore.ieee.org/document/10113320/Activity of daily livingimbalanced classGANdata augmentationsmartphones |
| spellingShingle | Apiwat Ditthapron Adam C. Lammert Emmanuel O. Agu ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANs IEEE Access Activity of daily living imbalanced class GAN data augmentation smartphones |
| title | ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANs |
| title_full | ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANs |
| title_fullStr | ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANs |
| title_full_unstemmed | ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANs |
| title_short | ADL-GAN: Data Augmentation to Improve In-the-Wild ADL Recognition Using GANs |
| title_sort | adl gan data augmentation to improve in the wild adl recognition using gans |
| topic | Activity of daily living imbalanced class GAN data augmentation smartphones |
| url | https://ieeexplore.ieee.org/document/10113320/ |
| work_keys_str_mv | AT apiwatditthapron adlgandataaugmentationtoimproveinthewildadlrecognitionusinggans AT adamclammert adlgandataaugmentationtoimproveinthewildadlrecognitionusinggans AT emmanueloagu adlgandataaugmentationtoimproveinthewildadlrecognitionusinggans |