Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation
Accent similarity evaluation and accent identification are complex and challenging tasks for various applications due to the existence of variant types of native and non-native languages in the world. The lack of prior research on evaluating similarities between non-native and native English accents...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2023-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/10077397/ |
_version_ | 1797852335512223744 |
---|---|
author | Yeshanew Ale Wubet Deepak Balram Kuang-Yow Lian |
author_facet | Yeshanew Ale Wubet Deepak Balram Kuang-Yow Lian |
author_sort | Yeshanew Ale Wubet |
collection | DOAJ |
description | Accent similarity evaluation and accent identification are complex and challenging tasks for various applications due to the existence of variant types of native and non-native languages in the world. The lack of prior research on evaluating similarities between non-native and native English accents and the limitations of individual feature extraction methods for accent classification prompted us to introduce and propose a new model termed the intra-native accent feature shared-based native accent identification (NAI) framework using an English accent archive speech dataset. The NAI network was employed for non-native English accent classification, native English accent classification, and identification of native and non-native English accents. Finally, the accent similarity of native and non-native English accents was evaluated based on a delicate NAI pre-trained model. Moreover, the proposed approach has an innovative idea in training data augmentation to overcome the challenge of a huge amount of training datasets required for deep learning. The ordinary individual voice feature extraction with data augmentation and regularization techniques was the baseline for our work. The proposed approach boosted the accuracy of the baseline method with an average accuracy value of 3.7% -7.5% on different vigorous deep learning algorithms. The Quade test method for the performance comparison gave a 0.01 significant level (p-value) that proved that the proposed approach performed better than the baseline significantly. The model makes the rank for non-native English accents based on their similarity to native English accents and the proximity rank is Mandarin, Italian, German, French, Amharic, and Hindi. |
first_indexed | 2024-04-09T19:31:19Z |
format | Article |
id | doaj.art-ba0a57aee20346d481be7ffe6b4239ca |
institution | Directory Open Access Journal |
issn | 2169-3536 |
language | English |
last_indexed | 2024-04-09T19:31:19Z |
publishDate | 2023-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj.art-ba0a57aee20346d481be7ffe6b4239ca2023-04-04T23:00:31ZengIEEEIEEE Access2169-35362023-01-0111321763218610.1109/ACCESS.2023.325990110077397Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity EvaluationYeshanew Ale Wubet0https://orcid.org/0000-0002-1411-715XDeepak Balram1https://orcid.org/0000-0002-0634-4707Kuang-Yow Lian2https://orcid.org/0000-0002-5692-9279Department of Electrical Engineering, National Taipei University of Technology, Taipei, TaiwanDepartment of Electrical Engineering, National Taipei University of Technology, Taipei, TaiwanDepartment of Electrical Engineering, National Taipei University of Technology, Taipei, TaiwanAccent similarity evaluation and accent identification are complex and challenging tasks for various applications due to the existence of variant types of native and non-native languages in the world. The lack of prior research on evaluating similarities between non-native and native English accents and the limitations of individual feature extraction methods for accent classification prompted us to introduce and propose a new model termed the intra-native accent feature shared-based native accent identification (NAI) framework using an English accent archive speech dataset. The NAI network was employed for non-native English accent classification, native English accent classification, and identification of native and non-native English accents. Finally, the accent similarity of native and non-native English accents was evaluated based on a delicate NAI pre-trained model. Moreover, the proposed approach has an innovative idea in training data augmentation to overcome the challenge of a huge amount of training datasets required for deep learning. The ordinary individual voice feature extraction with data augmentation and regularization techniques was the baseline for our work. The proposed approach boosted the accuracy of the baseline method with an average accuracy value of 3.7% -7.5% on different vigorous deep learning algorithms. The Quade test method for the performance comparison gave a 0.01 significant level (p-value) that proved that the proposed approach performed better than the baseline significantly. The model makes the rank for non-native English accents based on their similarity to native English accents and the proximity rank is Mandarin, Italian, German, French, Amharic, and Hindi.https://ieeexplore.ieee.org/document/10077397/Accent recognitionaccent shared featuresaccent similarityCNN-LSTMdeep learningnative accent identification |
spellingShingle | Yeshanew Ale Wubet Deepak Balram Kuang-Yow Lian Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation IEEE Access Accent recognition accent shared features accent similarity CNN-LSTM deep learning native accent identification |
title | Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation |
title_full | Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation |
title_fullStr | Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation |
title_full_unstemmed | Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation |
title_short | Intra-Native Accent Shared Features for Improving Neural Network-Based Accent Classification and Accent Similarity Evaluation |
title_sort | intra native accent shared features for improving neural network based accent classification and accent similarity evaluation |
topic | Accent recognition accent shared features accent similarity CNN-LSTM deep learning native accent identification |
url | https://ieeexplore.ieee.org/document/10077397/ |
work_keys_str_mv | AT yeshanewalewubet intranativeaccentsharedfeaturesforimprovingneuralnetworkbasedaccentclassificationandaccentsimilarityevaluation AT deepakbalram intranativeaccentsharedfeaturesforimprovingneuralnetworkbasedaccentclassificationandaccentsimilarityevaluation AT kuangyowlian intranativeaccentsharedfeaturesforimprovingneuralnetworkbasedaccentclassificationandaccentsimilarityevaluation |