MSRN and Multi-Headed Attention Mechanism for Language Identification

MSRN and Multi-Headed Attention Mechanism for Language Identification

With the popularity of the mobile internet, people all over the world can easily create and publish diverse media content such as multilingual and multi-dialectal audio and video. Therefore, language or dialect identification (LID) is increasingly important for practical applications such as multili...

Full description

Bibliographic Details
Main Authors:	Ailing Zeng, Mijit Ablimit, Askar Hamdulla
Format:	Article
Language:	English
Published:	MDPI AG 2022-12-01
Series:	Information
Subjects:	LID multiscale residual network multi-headed self-attention
Online Access:	https://www.mdpi.com/2078-2489/14/1/17

Similar Items

A Character String-Based Stemming for Morphologically Derivative Languages
by: Gvzelnur Imin, et al.
Published: (2022-03-01)

Multi-Scale Feature Learning for Language Identification of Overlapped Speech
by: Zuhragvl Aysa, et al.
Published: (2023-03-01)

DeepMHADTA: Prediction of Drug-Target Binding Affinity Using Multi-Head Self-Attention and Convolutional Neural Network
by: Lei Deng, et al.
Published: (2022-05-01)

Click-through rate prediction model integrating user interest and multi-head attention mechanism
by: Wei Zhang, et al.
Published: (2023-01-01)

Recurrent Residual Deformable Conv Unit and Multi-Head with Channel Self-Attention Based on U-Net for Building Extraction from Remote Sensing Images
by: Wenling Yu, et al.
Published: (2023-10-01)

Speaker Verification Based on Single Channel Speech Separation
by: Rong Jin, et al.
Published: (2023-01-01)

MSRN-Informer: Time Series Prediction Model Based on Multi-Scale Residual Network
by: Xiaohui Wang, et al.
Published: (2023-01-01)

A Dual Multi-Head Contextual Attention Network for Hyperspectral Image Classification
by: Miaomiao Liang, et al.
Published: (2022-06-01)

Scene Text Detection Based on Multi-Headed Self-Attention Using Shifted Windows
by: Baohua Huang, et al.
Published: (2023-03-01)

A Novel Approach Based on Multi-Level Bottleneck Attention Modules Using Self-Guided Dropblock for Person Re-Identification
by: Muhammad Usman Yaseen, et al.
Published: (2022-01-01)

Hepatic vessel segmentation based on 3D swin-transformer with inductive biased multi-head self-attention
by: Mian Wu, et al.
Published: (2023-07-01)

Language Identification-Based Evaluation of Single Channel Speech Separation of Overlapped Speeches
by: Zuhragvl Aysa, et al.
Published: (2022-10-01)

Attention-Based Multi-Learning Approach for Speech Emotion Recognition With Dilated Convolution
by: Samuel Kakuba, et al.
Published: (2022-01-01)

Improved MSRN-Based Attention Block for Mask Alignment Mark Detection in Photolithography
by: Juyong Park, et al.
Published: (2022-03-01)

Hyperspectral Image Classification Based on Multiscale Hybrid Networks and Attention Mechanisms
by: Haizhu Pan, et al.
Published: (2023-05-01)

Multi-head Self-attention Neural Network for Detecting EEG Epilepsy
by: TONG Hang, YANG Yan, JIANG Yongquan
Published: (2023-02-01)

Analyzing and Controlling Inter-Head Diversity in Multi-Head Attention
by: Hyeongu Yun, et al.
Published: (2021-02-01)

Bimodal Fusion Network with Multi-Head Attention for Multimodal Sentiment Analysis
by: Rui Zhang, et al.
Published: (2023-02-01)

Attention-Enhanced Graph Convolutional Networks for Aspect-Based Sentiment Classification with Multi-Head Attention
by: Guangtao Xu, et al.
Published: (2021-04-01)

Automatic Segmentation of Kidney Volume Using Multi-Module Hybrid Based U-Shape in Polycystic Kidney Disease
by: Haoyang Cui, et al.
Published: (2023-01-01)

Distract Your Attention: Multi-Head Cross Attention Network for Facial Expression Recognition
by: Zhengyao Wen, et al.
Published: (2023-05-01)

A semi-supervised approach for the integration of multi-omics data based on transformer multi-head self-attention mechanism and graph convolutional networks
by: Jiahui Wang, et al.
Published: (2024-01-01)

A Multi-Attention UNet for Semantic Segmentation in Remote Sensing Images
by: Yu Sun, et al.
Published: (2022-04-01)

Geological information prediction for shield machine using an enhanced multi-head self-attention convolution neural network with two-stage feature extraction
by: Chengjin Qin, et al.
Published: (2023-03-01)

MHSA-EC: An Indoor Localization Algorithm Fusing the Multi-Head Self-Attention Mechanism and Effective CSI
by: Wen Liu, et al.
Published: (2022-04-01)

EEG-Based Emotion Recognition Using Convolutional Recurrent Neural Network with Multi-Head Self-Attention
by: Zhangfang Hu, et al.
Published: (2022-11-01)

Capsule Network Improved Multi-Head Attention for Word Sense Disambiguation
by: Jinfeng Cheng, et al.
Published: (2021-03-01)

A structured multi-head attention prediction method based on heterogeneous financial data
by: Cheng Zhao, et al.
Published: (2023-11-01)

Predicting disease genes based on multi-head attention fusion
by: Linlin Zhang, et al.
Published: (2023-04-01)

Multi-Head Self-Attention-Enhanced Prototype Network with Contrastive–Center Loss for Few-Shot Relation Extraction
by: Jiangtao Ma, et al.
Published: (2023-12-01)

Efficient Road Traffic Video Congestion Classification Based on the Multi-Head Self-Attention Vision Transformer Model
by: Khalladi Sofiane Abdelkrim, et al.
Published: (2024-02-01)

An Intelligent Athlete Signal Processing Methodology for Balance Control Ability Assessment with Multi-Headed Self-Attention Mechanism
by: Nannan Xu, et al.
Published: (2022-08-01)

Multi-Head Self-Attention Gated-Dilated Convolutional Neural Network for Word Sense Disambiguation
by: Chun-Xiang Zhang, et al.
Published: (2023-01-01)

An Efficient Method for Biomedical Entity Linking Based on Inter- and Intra-Entity Attention
by: Mamatjan Abdurxit, et al.
Published: (2022-03-01)

A Network Intrusion Detection Model Based on BiLSTM with Multi-Head Attention Mechanism
by: Jingqi Zhang, et al.
Published: (2023-10-01)

Financial Volatility Forecasting: A Sparse Multi-Head Attention Neural Network
by: Hualing Lin, et al.
Published: (2021-10-01)

Design of news recommendation model based on sub-attention news encoder
by: Wenting Zhang
Published: (2023-03-01)

Drone-based apple detection: Finding the depth of apples using YOLOv7 architecture with multi-head attention mechanism
by: Praveen Kumar S, et al.
Published: (2023-10-01)

Multi-Head Self-Attention-Based Deep Clustering for Single-Channel Speech Separation
by: Yanliang Jin, et al.
Published: (2020-01-01)

Replay Attack Detection Based on High Frequency Missing Spectrum
by: Junming Yuan, et al.
Published: (2022-12-01)