Multi-modal deformation and temperature sensing for context-sensitive machines

Abstract Owing to the remarkable properties of the somatosensory system, human skin compactly perceives myriad forms of physical stimuli with high precision. Machines, conversely, are often equipped with sensory suites constituted of dozens of unique sensors, each made for detecting limited stimuli....

Full description

Bibliographic Details
Main Authors: Robert Baines, Fabio Zuliani, Neil Chennoufi, Sagar Joshi, Rebecca Kramer-Bottiglio, Jamie Paik
Format: Article
Language:English
Published: Nature Portfolio 2023-11-01
Series:Nature Communications
Online Access:https://doi.org/10.1038/s41467-023-42655-y
_version_ 1827581517940916224
author Robert Baines
Fabio Zuliani
Neil Chennoufi
Sagar Joshi
Rebecca Kramer-Bottiglio
Jamie Paik
author_facet Robert Baines
Fabio Zuliani
Neil Chennoufi
Sagar Joshi
Rebecca Kramer-Bottiglio
Jamie Paik
author_sort Robert Baines
collection DOAJ
description Abstract Owing to the remarkable properties of the somatosensory system, human skin compactly perceives myriad forms of physical stimuli with high precision. Machines, conversely, are often equipped with sensory suites constituted of dozens of unique sensors, each made for detecting limited stimuli. Emerging high degree-of-freedom human-robot interfaces and soft robot applications are delimited by the lack of simple, cohesive, and information-dense sensing technologies. Stepping toward biological levels of proprioception, we present a sensing technology capable of decoding omnidirectional bending, compression, stretch, binary changes in temperature, and combinations thereof. This multi-modal deformation and temperature sensor harnesses chromaticity and intensity of light as it travels through patterned elastomer doped with functional dyes. Deformations and temperature shifts augment the light chromaticity and intensity, resulting in a one-to-one mapping between stimulus modes that are sequentially combined and the sensor output. We study the working principle of the sensor via a comprehensive opto-thermo-mechanical assay, and find that the information density provided by a single sensing element permits deciphering rich and diverse human-robot and robot-environmental interactions.
first_indexed 2024-03-08T22:37:42Z
format Article
id doaj.art-b39ea9c96dc54dc28497dceb7454caca
institution Directory Open Access Journal
issn 2041-1723
language English
last_indexed 2024-03-08T22:37:42Z
publishDate 2023-11-01
publisher Nature Portfolio
record_format Article
series Nature Communications
spelling doaj.art-b39ea9c96dc54dc28497dceb7454caca2023-12-17T12:24:07ZengNature PortfolioNature Communications2041-17232023-11-0114111410.1038/s41467-023-42655-yMulti-modal deformation and temperature sensing for context-sensitive machinesRobert Baines0Fabio Zuliani1Neil Chennoufi2Sagar Joshi3Rebecca Kramer-Bottiglio4Jamie Paik5School of Engineering & Applied Science, Yale UniversitySchool of Engineering, Ecole Polytechnique Fédérale de LausanneSchool of Engineering, Ecole Polytechnique Fédérale de LausanneSchool of Engineering, Ecole Polytechnique Fédérale de LausanneSchool of Engineering & Applied Science, Yale UniversitySchool of Engineering, Ecole Polytechnique Fédérale de LausanneAbstract Owing to the remarkable properties of the somatosensory system, human skin compactly perceives myriad forms of physical stimuli with high precision. Machines, conversely, are often equipped with sensory suites constituted of dozens of unique sensors, each made for detecting limited stimuli. Emerging high degree-of-freedom human-robot interfaces and soft robot applications are delimited by the lack of simple, cohesive, and information-dense sensing technologies. Stepping toward biological levels of proprioception, we present a sensing technology capable of decoding omnidirectional bending, compression, stretch, binary changes in temperature, and combinations thereof. This multi-modal deformation and temperature sensor harnesses chromaticity and intensity of light as it travels through patterned elastomer doped with functional dyes. Deformations and temperature shifts augment the light chromaticity and intensity, resulting in a one-to-one mapping between stimulus modes that are sequentially combined and the sensor output. We study the working principle of the sensor via a comprehensive opto-thermo-mechanical assay, and find that the information density provided by a single sensing element permits deciphering rich and diverse human-robot and robot-environmental interactions.https://doi.org/10.1038/s41467-023-42655-y
spellingShingle Robert Baines
Fabio Zuliani
Neil Chennoufi
Sagar Joshi
Rebecca Kramer-Bottiglio
Jamie Paik
Multi-modal deformation and temperature sensing for context-sensitive machines
Nature Communications
title Multi-modal deformation and temperature sensing for context-sensitive machines
title_full Multi-modal deformation and temperature sensing for context-sensitive machines
title_fullStr Multi-modal deformation and temperature sensing for context-sensitive machines
title_full_unstemmed Multi-modal deformation and temperature sensing for context-sensitive machines
title_short Multi-modal deformation and temperature sensing for context-sensitive machines
title_sort multi modal deformation and temperature sensing for context sensitive machines
url https://doi.org/10.1038/s41467-023-42655-y
work_keys_str_mv AT robertbaines multimodaldeformationandtemperaturesensingforcontextsensitivemachines
AT fabiozuliani multimodaldeformationandtemperaturesensingforcontextsensitivemachines
AT neilchennoufi multimodaldeformationandtemperaturesensingforcontextsensitivemachines
AT sagarjoshi multimodaldeformationandtemperaturesensingforcontextsensitivemachines
AT rebeccakramerbottiglio multimodaldeformationandtemperaturesensingforcontextsensitivemachines
AT jamiepaik multimodaldeformationandtemperaturesensingforcontextsensitivemachines