Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as Antennas
We present a novel intelligent garment design approach for body posture/gesture detection in the form of a loose-fitting blazer prototype, “the MoCaBlazer.” The design is realized by leveraging conductive textile antennas with the capacitive sensing modality, supported by an open-source electronic t...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-06-01
|
| Series: | Frontiers in Computer Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fcomp.2022.915280/full |
| _version_ | 1818251389462118400 |
|---|---|
| author | Hymalai Bello Bo Zhou Bo Zhou Sungho Suh Sungho Suh Luis Alfredo Sanchez Marin Paul Lukowicz Paul Lukowicz |
| author_facet | Hymalai Bello Bo Zhou Bo Zhou Sungho Suh Sungho Suh Luis Alfredo Sanchez Marin Paul Lukowicz Paul Lukowicz |
| author_sort | Hymalai Bello |
| collection | DOAJ |
| description | We present a novel intelligent garment design approach for body posture/gesture detection in the form of a loose-fitting blazer prototype, “the MoCaBlazer.” The design is realized by leveraging conductive textile antennas with the capacitive sensing modality, supported by an open-source electronic theremin system (OpenTheremin). The use of soft textile antennas as the sensing element allows flexible garment design and seamless tech-garment integration for the specific structure of different clothes. Our novel approach is evaluated through two experiments involving defined movements (20 arm/torso gestures and eight dance movements). In cross-validation, the classification model yields up to 97.18% average accuracy and 92% f1-score, respectively. We have also explored real-time inference enabled by a radio frequency identification (RFID) synchronization method, yielding an f1-score of 82%. Our approach opens a new paradigm for designing motion-aware smart garments with soft conductive textiles beyond traditional approaches that rely on tight-fitting flexible sensors or rigid motion sensor accessories. |
| first_indexed | 2024-12-12T16:07:30Z |
| format | Article |
| id | doaj.art-6dd1fbb8aad84e14be69001a0b4df488 |
| institution | Directory Open Access Journal |
| issn | 2624-9898 |
| language | English |
| last_indexed | 2024-12-12T16:07:30Z |
| publishDate | 2022-06-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Computer Science |
| spelling | doaj.art-6dd1fbb8aad84e14be69001a0b4df4882022-12-22T00:19:15ZengFrontiers Media S.A.Frontiers in Computer Science2624-98982022-06-01410.3389/fcomp.2022.915280915280Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as AntennasHymalai Bello0Bo Zhou1Bo Zhou2Sungho Suh3Sungho Suh4Luis Alfredo Sanchez Marin5Paul Lukowicz6Paul Lukowicz7German Research Centre for Artificial Intelligence, Embedded Intelligence, Kaiserslautern, GermanyGerman Research Centre for Artificial Intelligence, Embedded Intelligence, Kaiserslautern, GermanyDepartment of Computer Science, University of Kaiserslautern, Kaiserslautern, GermanyGerman Research Centre for Artificial Intelligence, Embedded Intelligence, Kaiserslautern, GermanyDepartment of Computer Science, University of Kaiserslautern, Kaiserslautern, GermanyDepartment of Computer Science, University of Kaiserslautern, Kaiserslautern, GermanyGerman Research Centre for Artificial Intelligence, Embedded Intelligence, Kaiserslautern, GermanyDepartment of Computer Science, University of Kaiserslautern, Kaiserslautern, GermanyWe present a novel intelligent garment design approach for body posture/gesture detection in the form of a loose-fitting blazer prototype, “the MoCaBlazer.” The design is realized by leveraging conductive textile antennas with the capacitive sensing modality, supported by an open-source electronic theremin system (OpenTheremin). The use of soft textile antennas as the sensing element allows flexible garment design and seamless tech-garment integration for the specific structure of different clothes. Our novel approach is evaluated through two experiments involving defined movements (20 arm/torso gestures and eight dance movements). In cross-validation, the classification model yields up to 97.18% average accuracy and 92% f1-score, respectively. We have also explored real-time inference enabled by a radio frequency identification (RFID) synchronization method, yielding an f1-score of 82%. Our approach opens a new paradigm for designing motion-aware smart garments with soft conductive textiles beyond traditional approaches that rely on tight-fitting flexible sensors or rigid motion sensor accessories.https://www.frontiersin.org/articles/10.3389/fcomp.2022.915280/fullloose garment sensingtheremincapacitive sensingactivity recognitionposture detectiongesture detection |
| spellingShingle | Hymalai Bello Bo Zhou Bo Zhou Sungho Suh Sungho Suh Luis Alfredo Sanchez Marin Paul Lukowicz Paul Lukowicz Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as Antennas Frontiers in Computer Science loose garment sensing theremin capacitive sensing activity recognition posture detection gesture detection |
| title | Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as Antennas |
| title_full | Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as Antennas |
| title_fullStr | Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as Antennas |
| title_full_unstemmed | Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as Antennas |
| title_short | Move With the Theremin: Body Posture and Gesture Recognition Using the Theremin in Loose-Garment With Embedded Textile Cables as Antennas |
| title_sort | move with the theremin body posture and gesture recognition using the theremin in loose garment with embedded textile cables as antennas |
| topic | loose garment sensing theremin capacitive sensing activity recognition posture detection gesture detection |
| url | https://www.frontiersin.org/articles/10.3389/fcomp.2022.915280/full |
| work_keys_str_mv | AT hymalaibello movewiththethereminbodypostureandgesturerecognitionusingthetheremininloosegarmentwithembeddedtextilecablesasantennas AT bozhou movewiththethereminbodypostureandgesturerecognitionusingthetheremininloosegarmentwithembeddedtextilecablesasantennas AT bozhou movewiththethereminbodypostureandgesturerecognitionusingthetheremininloosegarmentwithembeddedtextilecablesasantennas AT sunghosuh movewiththethereminbodypostureandgesturerecognitionusingthetheremininloosegarmentwithembeddedtextilecablesasantennas AT sunghosuh movewiththethereminbodypostureandgesturerecognitionusingthetheremininloosegarmentwithembeddedtextilecablesasantennas AT luisalfredosanchezmarin movewiththethereminbodypostureandgesturerecognitionusingthetheremininloosegarmentwithembeddedtextilecablesasantennas AT paullukowicz movewiththethereminbodypostureandgesturerecognitionusingthetheremininloosegarmentwithembeddedtextilecablesasantennas AT paullukowicz movewiththethereminbodypostureandgesturerecognitionusingthetheremininloosegarmentwithembeddedtextilecablesasantennas |