A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification
Wearable devices have many applications ranging from health analytics to virtual and mixed reality interaction, to industrial training. For wearable devices to be practical, they must be responsive, deformable to fit the wearer, and robust to the user's range of motion. Signals produced by the...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2020-06-01
|
Series: | Advanced Intelligent Systems |
Subjects: | |
Online Access: | https://doi.org/10.1002/aisy.202000002 |
_version_ | 1818032554942398464 |
---|---|
author | Josie Hughes Andrew Spielberg Mark Chounlakone Gloria Chang Wojciech Matusik Daniela Rus |
author_facet | Josie Hughes Andrew Spielberg Mark Chounlakone Gloria Chang Wojciech Matusik Daniela Rus |
author_sort | Josie Hughes |
collection | DOAJ |
description | Wearable devices have many applications ranging from health analytics to virtual and mixed reality interaction, to industrial training. For wearable devices to be practical, they must be responsive, deformable to fit the wearer, and robust to the user's range of motion. Signals produced by the wearable must also be informative enough to infer the precise physical state or activity of the user. Herein, a fully soft, wearable glove is developed, which is capable of real‐time hand pose reconstruction, environment sensing, and task classification. The design is easy to fabricate using low cost, commercial off‐the‐shelf items in a manner that is amenable to automated manufacturing. To realize such capabilities, resisitive and fluidic sensing technologies with machine learning neural architectures are merged. The glove is formed from a conductive knit which is strain sensitive, providing information through a network of resistance measurements. Fluidic sensing captured via pressure changes in fibrous sewn‐in flexible tubes, measuring interactions with the environment. The system can reconstruct user hand pose and identify sensory inputs such as holding force, object temperature, conductability, material stiffness, and user heart rate, all with high accuracy. The ability to identify complex environmentally dependent tasks, including held object identification and handwriting recognition is demonstrated. |
first_indexed | 2024-12-10T06:09:14Z |
format | Article |
id | doaj.art-b65fef4f0cf84c02b8d34c8a89c6bf9d |
institution | Directory Open Access Journal |
issn | 2640-4567 |
language | English |
last_indexed | 2024-12-10T06:09:14Z |
publishDate | 2020-06-01 |
publisher | Wiley |
record_format | Article |
series | Advanced Intelligent Systems |
spelling | doaj.art-b65fef4f0cf84c02b8d34c8a89c6bf9d2022-12-22T01:59:36ZengWileyAdvanced Intelligent Systems2640-45672020-06-0126n/an/a10.1002/aisy.202000002A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task IdentificationJosie Hughes0Andrew Spielberg1Mark Chounlakone2Gloria Chang3Wojciech Matusik4Daniela Rus5Computer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAWearable devices have many applications ranging from health analytics to virtual and mixed reality interaction, to industrial training. For wearable devices to be practical, they must be responsive, deformable to fit the wearer, and robust to the user's range of motion. Signals produced by the wearable must also be informative enough to infer the precise physical state or activity of the user. Herein, a fully soft, wearable glove is developed, which is capable of real‐time hand pose reconstruction, environment sensing, and task classification. The design is easy to fabricate using low cost, commercial off‐the‐shelf items in a manner that is amenable to automated manufacturing. To realize such capabilities, resisitive and fluidic sensing technologies with machine learning neural architectures are merged. The glove is formed from a conductive knit which is strain sensitive, providing information through a network of resistance measurements. Fluidic sensing captured via pressure changes in fibrous sewn‐in flexible tubes, measuring interactions with the environment. The system can reconstruct user hand pose and identify sensory inputs such as holding force, object temperature, conductability, material stiffness, and user heart rate, all with high accuracy. The ability to identify complex environmentally dependent tasks, including held object identification and handwriting recognition is demonstrated.https://doi.org/10.1002/aisy.202000002machine learningmultimodal sensingsoft sensingtask recognitionwearable computingwearable gloves |
spellingShingle | Josie Hughes Andrew Spielberg Mark Chounlakone Gloria Chang Wojciech Matusik Daniela Rus A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification Advanced Intelligent Systems machine learning multimodal sensing soft sensing task recognition wearable computing wearable gloves |
title | A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification |
title_full | A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification |
title_fullStr | A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification |
title_full_unstemmed | A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification |
title_short | A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification |
title_sort | simple inexpensive wearable glove with hybrid resistive pressure sensors for computational sensing proprioception and task identification |
topic | machine learning multimodal sensing soft sensing task recognition wearable computing wearable gloves |
url | https://doi.org/10.1002/aisy.202000002 |
work_keys_str_mv | AT josiehughes asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT andrewspielberg asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT markchounlakone asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT gloriachang asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT wojciechmatusik asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT danielarus asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT josiehughes simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT andrewspielberg simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT markchounlakone simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT gloriachang simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT wojciechmatusik simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification AT danielarus simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification |