Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere Microstructures

Rapid advances in wearable sensing technology have demonstrated unprecedented opportunities for artificial intelligence. In comparison with the traditional hand‐held electrolarynx, a wearable and intelligent artificial throat with sound‐sensing ability is a more comfortable and versatile method to a...

Full description

Bibliographic Details
Main Authors: Yuchi Liu, Huaiyu Li, Xiangpeng Liang, Haitao Deng, Xinran Zhang, Hadi Heidari, Rami Ghannam, Xiaosheng Zhang
Format: Article
Language:English
Published: Wiley 2023-07-01
Series:Advanced Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1002/aisy.202200427
_version_ 1827894110035378176
author Yuchi Liu
Huaiyu Li
Xiangpeng Liang
Haitao Deng
Xinran Zhang
Hadi Heidari
Rami Ghannam
Xiaosheng Zhang
author_facet Yuchi Liu
Huaiyu Li
Xiangpeng Liang
Haitao Deng
Xinran Zhang
Hadi Heidari
Rami Ghannam
Xiaosheng Zhang
author_sort Yuchi Liu
collection DOAJ
description Rapid advances in wearable sensing technology have demonstrated unprecedented opportunities for artificial intelligence. In comparison with the traditional hand‐held electrolarynx, a wearable and intelligent artificial throat with sound‐sensing ability is a more comfortable and versatile method to assist disabled people with communication. Herein, a piezoresistive sensor with a novel configuration is demonstrated, which consists of polystyrene (PS) spheres as microstructures sandwiched between silver nanowires and reduced graphene oxide layers. In fact, changes in the device's conducting patterns are obtained by spay‐coating the various weight ratios and sizes of the PS microspheres, which is a fast and convenient way to establish microstructures for improving sensitivity. The wearable artificial throat device also exhibits high sensitivity, fast response time, and ultralow intensity level detection. Moreover, the device's excellent mechanical–electrical performance allows it to detect subtle throat vibrations that can be converted into controllable sounds. In this case, an intelligent artificial throat is achieved by combining a deep learning algorithm with a highly flexible piezoresistive sensor to successfully recognize five different words (help, sick, patient, doctor, and COVID) with an accuracy exceeding 96%. Herein, new opportunities in voice control as well as other human‐machine interface applications are opened.
first_indexed 2024-03-12T22:01:57Z
format Article
id doaj.art-4118d4147c8e459e8f45c8d143a8f1cc
institution Directory Open Access Journal
issn 2640-4567
language English
last_indexed 2024-03-12T22:01:57Z
publishDate 2023-07-01
publisher Wiley
record_format Article
series Advanced Intelligent Systems
spelling doaj.art-4118d4147c8e459e8f45c8d143a8f1cc2023-07-25T05:32:26ZengWileyAdvanced Intelligent Systems2640-45672023-07-0157n/an/a10.1002/aisy.202200427Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere MicrostructuresYuchi Liu0Huaiyu Li1Xiangpeng Liang2Haitao Deng3Xinran Zhang4Hadi Heidari5Rami Ghannam6Xiaosheng Zhang7School of Electronic Science and Engineering University of Electronic Science and Technology of China Chengdu 611731 ChinaSchool of Electronic Science and Engineering University of Electronic Science and Technology of China Chengdu 611731 ChinaJames Watts School of Engineering University of Glasgow Glasgow G12 8QQ UKSchool of Electronic Science and Engineering University of Electronic Science and Technology of China Chengdu 611731 ChinaSchool of Electronic Science and Engineering University of Electronic Science and Technology of China Chengdu 611731 ChinaJames Watts School of Engineering University of Glasgow Glasgow G12 8QQ UKJames Watts School of Engineering University of Glasgow Glasgow G12 8QQ UKSchool of Electronic Science and Engineering University of Electronic Science and Technology of China Chengdu 611731 ChinaRapid advances in wearable sensing technology have demonstrated unprecedented opportunities for artificial intelligence. In comparison with the traditional hand‐held electrolarynx, a wearable and intelligent artificial throat with sound‐sensing ability is a more comfortable and versatile method to assist disabled people with communication. Herein, a piezoresistive sensor with a novel configuration is demonstrated, which consists of polystyrene (PS) spheres as microstructures sandwiched between silver nanowires and reduced graphene oxide layers. In fact, changes in the device's conducting patterns are obtained by spay‐coating the various weight ratios and sizes of the PS microspheres, which is a fast and convenient way to establish microstructures for improving sensitivity. The wearable artificial throat device also exhibits high sensitivity, fast response time, and ultralow intensity level detection. Moreover, the device's excellent mechanical–electrical performance allows it to detect subtle throat vibrations that can be converted into controllable sounds. In this case, an intelligent artificial throat is achieved by combining a deep learning algorithm with a highly flexible piezoresistive sensor to successfully recognize five different words (help, sick, patient, doctor, and COVID) with an accuracy exceeding 96%. Herein, new opportunities in voice control as well as other human‐machine interface applications are opened.https://doi.org/10.1002/aisy.202200427deep learninghuman–machine interfaceintelligent artificial throatpiezoresistive sensorspeech recognition
spellingShingle Yuchi Liu
Huaiyu Li
Xiangpeng Liang
Haitao Deng
Xinran Zhang
Hadi Heidari
Rami Ghannam
Xiaosheng Zhang
Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere Microstructures
Advanced Intelligent Systems
deep learning
human–machine interface
intelligent artificial throat
piezoresistive sensor
speech recognition
title Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere Microstructures
title_full Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere Microstructures
title_fullStr Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere Microstructures
title_full_unstemmed Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere Microstructures
title_short Speech Recognition Using Intelligent Piezoresistive Sensor Based on Polystyrene Sphere Microstructures
title_sort speech recognition using intelligent piezoresistive sensor based on polystyrene sphere microstructures
topic deep learning
human–machine interface
intelligent artificial throat
piezoresistive sensor
speech recognition
url https://doi.org/10.1002/aisy.202200427
work_keys_str_mv AT yuchiliu speechrecognitionusingintelligentpiezoresistivesensorbasedonpolystyrenespheremicrostructures
AT huaiyuli speechrecognitionusingintelligentpiezoresistivesensorbasedonpolystyrenespheremicrostructures
AT xiangpengliang speechrecognitionusingintelligentpiezoresistivesensorbasedonpolystyrenespheremicrostructures
AT haitaodeng speechrecognitionusingintelligentpiezoresistivesensorbasedonpolystyrenespheremicrostructures
AT xinranzhang speechrecognitionusingintelligentpiezoresistivesensorbasedonpolystyrenespheremicrostructures
AT hadiheidari speechrecognitionusingintelligentpiezoresistivesensorbasedonpolystyrenespheremicrostructures
AT ramighannam speechrecognitionusingintelligentpiezoresistivesensorbasedonpolystyrenespheremicrostructures
AT xiaoshengzhang speechrecognitionusingintelligentpiezoresistivesensorbasedonpolystyrenespheremicrostructures