Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation

Accent similarity evaluation and accent identification are complex and challenging tasks for various applications due to the existence of variant types of native and non-native languages in the world. The lack of prior research on evaluating similarities between non-native and native English accents...

Full description

Bibliographic Details
Main Authors: Yeshanew Ale Wubet, Deepak Balram, Kuang-Yow Lian
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10077397/
_version_ 1797852335512223744
author Yeshanew Ale Wubet
Deepak Balram
Kuang-Yow Lian
author_facet Yeshanew Ale Wubet
Deepak Balram
Kuang-Yow Lian
author_sort Yeshanew Ale Wubet
collection DOAJ
description Accent similarity evaluation and accent identification are complex and challenging tasks for various applications due to the existence of variant types of native and non-native languages in the world. The lack of prior research on evaluating similarities between non-native and native English accents and the limitations of individual feature extraction methods for accent classification prompted us to introduce and propose a new model termed the intra-native accent feature shared-based native accent identification (NAI) framework using an English accent archive speech dataset. The NAI network was employed for non-native English accent classification, native English accent classification, and identification of native and non-native English accents. Finally, the accent similarity of native and non-native English accents was evaluated based on a delicate NAI pre-trained model. Moreover, the proposed approach has an innovative idea in training data augmentation to overcome the challenge of a huge amount of training datasets required for deep learning. The ordinary individual voice feature extraction with data augmentation and regularization techniques was the baseline for our work. The proposed approach boosted the accuracy of the baseline method with an average accuracy value of 3.7% -7.5% on different vigorous deep learning algorithms. The Quade test method for the performance comparison gave a 0.01 significant level (p-value) that proved that the proposed approach performed better than the baseline significantly. The model makes the rank for non-native English accents based on their similarity to native English accents and the proximity rank is Mandarin, Italian, German, French, Amharic, and Hindi.
first_indexed 2024-04-09T19:31:19Z
format Article
id doaj.art-ba0a57aee20346d481be7ffe6b4239ca
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-09T19:31:19Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-ba0a57aee20346d481be7ffe6b4239ca2023-04-04T23:00:31ZengIEEEIEEE Access2169-35362023-01-0111321763218610.1109/ACCESS.2023.325990110077397Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity EvaluationYeshanew Ale Wubet0https://orcid.org/0000-0002-1411-715XDeepak Balram1https://orcid.org/0000-0002-0634-4707Kuang-Yow Lian2https://orcid.org/0000-0002-5692-9279Department of Electrical Engineering, National Taipei University of Technology, Taipei, TaiwanDepartment of Electrical Engineering, National Taipei University of Technology, Taipei, TaiwanDepartment of Electrical Engineering, National Taipei University of Technology, Taipei, TaiwanAccent similarity evaluation and accent identification are complex and challenging tasks for various applications due to the existence of variant types of native and non-native languages in the world. The lack of prior research on evaluating similarities between non-native and native English accents and the limitations of individual feature extraction methods for accent classification prompted us to introduce and propose a new model termed the intra-native accent feature shared-based native accent identification (NAI) framework using an English accent archive speech dataset. The NAI network was employed for non-native English accent classification, native English accent classification, and identification of native and non-native English accents. Finally, the accent similarity of native and non-native English accents was evaluated based on a delicate NAI pre-trained model. Moreover, the proposed approach has an innovative idea in training data augmentation to overcome the challenge of a huge amount of training datasets required for deep learning. The ordinary individual voice feature extraction with data augmentation and regularization techniques was the baseline for our work. The proposed approach boosted the accuracy of the baseline method with an average accuracy value of 3.7% -7.5% on different vigorous deep learning algorithms. The Quade test method for the performance comparison gave a 0.01 significant level (p-value) that proved that the proposed approach performed better than the baseline significantly. The model makes the rank for non-native English accents based on their similarity to native English accents and the proximity rank is Mandarin, Italian, German, French, Amharic, and Hindi.https://ieeexplore.ieee.org/document/10077397/Accent recognitionaccent shared featuresaccent similarityCNN-LSTMdeep learningnative accent identification
spellingShingle Yeshanew Ale Wubet
Deepak Balram
Kuang-Yow Lian
Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation
IEEE Access
Accent recognition
accent shared features
accent similarity
CNN-LSTM
deep learning
native accent identification
title Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation
title_full Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation
title_fullStr Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation
title_full_unstemmed Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation
title_short Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation
title_sort intra native accent shared features for improving neural network based accent classification and accent similarity evaluation
topic Accent recognition
accent shared features
accent similarity
CNN-LSTM
deep learning
native accent identification
url https://ieeexplore.ieee.org/document/10077397/
work_keys_str_mv AT yeshanewalewubet intranativeaccentsharedfeaturesforimprovingneuralnetworkbasedaccentclassificationandaccentsimilarityevaluation
AT deepakbalram intranativeaccentsharedfeaturesforimprovingneuralnetworkbasedaccentclassificationandaccentsimilarityevaluation
AT kuangyowlian intranativeaccentsharedfeaturesforimprovingneuralnetworkbasedaccentclassificationandaccentsimilarityevaluation