A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification

Wearable devices have many applications ranging from health analytics to virtual and mixed reality interaction, to industrial training. For wearable devices to be practical, they must be responsive, deformable to fit the wearer, and robust to the user's range of motion. Signals produced by the...

Full description

Bibliographic Details
Main Authors: Josie Hughes, Andrew Spielberg, Mark Chounlakone, Gloria Chang, Wojciech Matusik, Daniela Rus
Format: Article
Language:English
Published: Wiley 2020-06-01
Series:Advanced Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1002/aisy.202000002
_version_ 1818032554942398464
author Josie Hughes
Andrew Spielberg
Mark Chounlakone
Gloria Chang
Wojciech Matusik
Daniela Rus
author_facet Josie Hughes
Andrew Spielberg
Mark Chounlakone
Gloria Chang
Wojciech Matusik
Daniela Rus
author_sort Josie Hughes
collection DOAJ
description Wearable devices have many applications ranging from health analytics to virtual and mixed reality interaction, to industrial training. For wearable devices to be practical, they must be responsive, deformable to fit the wearer, and robust to the user's range of motion. Signals produced by the wearable must also be informative enough to infer the precise physical state or activity of the user. Herein, a fully soft, wearable glove is developed, which is capable of real‐time hand pose reconstruction, environment sensing, and task classification. The design is easy to fabricate using low cost, commercial off‐the‐shelf items in a manner that is amenable to automated manufacturing. To realize such capabilities, resisitive and fluidic sensing technologies with machine learning neural architectures are merged. The glove is formed from a conductive knit which is strain sensitive, providing information through a network of resistance measurements. Fluidic sensing captured via pressure changes in fibrous sewn‐in flexible tubes, measuring interactions with the environment. The system can reconstruct user hand pose and identify sensory inputs such as holding force, object temperature, conductability, material stiffness, and user heart rate, all with high accuracy. The ability to identify complex environmentally dependent tasks, including held object identification and handwriting recognition is demonstrated.
first_indexed 2024-12-10T06:09:14Z
format Article
id doaj.art-b65fef4f0cf84c02b8d34c8a89c6bf9d
institution Directory Open Access Journal
issn 2640-4567
language English
last_indexed 2024-12-10T06:09:14Z
publishDate 2020-06-01
publisher Wiley
record_format Article
series Advanced Intelligent Systems
spelling doaj.art-b65fef4f0cf84c02b8d34c8a89c6bf9d2022-12-22T01:59:36ZengWileyAdvanced Intelligent Systems2640-45672020-06-0126n/an/a10.1002/aisy.202000002A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task IdentificationJosie Hughes0Andrew Spielberg1Mark Chounlakone2Gloria Chang3Wojciech Matusik4Daniela Rus5Computer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAComputer Science and Artificial Intelligence Laboratory (CSAIL) Massachusetts Institute of Technology Cambridge MA 02139 USAWearable devices have many applications ranging from health analytics to virtual and mixed reality interaction, to industrial training. For wearable devices to be practical, they must be responsive, deformable to fit the wearer, and robust to the user's range of motion. Signals produced by the wearable must also be informative enough to infer the precise physical state or activity of the user. Herein, a fully soft, wearable glove is developed, which is capable of real‐time hand pose reconstruction, environment sensing, and task classification. The design is easy to fabricate using low cost, commercial off‐the‐shelf items in a manner that is amenable to automated manufacturing. To realize such capabilities, resisitive and fluidic sensing technologies with machine learning neural architectures are merged. The glove is formed from a conductive knit which is strain sensitive, providing information through a network of resistance measurements. Fluidic sensing captured via pressure changes in fibrous sewn‐in flexible tubes, measuring interactions with the environment. The system can reconstruct user hand pose and identify sensory inputs such as holding force, object temperature, conductability, material stiffness, and user heart rate, all with high accuracy. The ability to identify complex environmentally dependent tasks, including held object identification and handwriting recognition is demonstrated.https://doi.org/10.1002/aisy.202000002machine learningmultimodal sensingsoft sensingtask recognitionwearable computingwearable gloves
spellingShingle Josie Hughes
Andrew Spielberg
Mark Chounlakone
Gloria Chang
Wojciech Matusik
Daniela Rus
A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification
Advanced Intelligent Systems
machine learning
multimodal sensing
soft sensing
task recognition
wearable computing
wearable gloves
title A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification
title_full A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification
title_fullStr A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification
title_full_unstemmed A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification
title_short A Simple, Inexpensive, Wearable Glove with Hybrid Resistive‐Pressure Sensors for Computational Sensing, Proprioception, and Task Identification
title_sort simple inexpensive wearable glove with hybrid resistive pressure sensors for computational sensing proprioception and task identification
topic machine learning
multimodal sensing
soft sensing
task recognition
wearable computing
wearable gloves
url https://doi.org/10.1002/aisy.202000002
work_keys_str_mv AT josiehughes asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT andrewspielberg asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT markchounlakone asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT gloriachang asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT wojciechmatusik asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT danielarus asimpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT josiehughes simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT andrewspielberg simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT markchounlakone simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT gloriachang simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT wojciechmatusik simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification
AT danielarus simpleinexpensivewearableglovewithhybridresistivepressuresensorsforcomputationalsensingproprioceptionandtaskidentification