A Speech Recognition Model Building Method Combined Dynamic Convolution and Multi-Head Self-Attention Mechanism

A Speech Recognition Model Building Method Combined Dynamic Convolution and Multi-Head Self-Attention Mechanism

The Conformer enhanced Transformer by using convolution serial connected to the multi-head self-attention (MHSA). The method strengthened the local attention calculation and obtained a better effect in auto speech recognition. This paper proposes a hybrid attention mechanism which combines the dynam...

Full description

Bibliographic Details
Main Authors: Wei Liu, Jiaming Sun, Yiming Sun, Chunyi Chen
Format: Article
Language:English
Published: MDPI AG 2022-05-01
Series:Electronics
Subjects:
speech recognition
attention
dynamic convolution
transformer
Online Access:https://www.mdpi.com/2079-9292/11/10/1656

Internet

https://www.mdpi.com/2079-9292/11/10/1656

Similar Items