Development of Al-Quran sign language classification based on convolutional neural network
Sign language is the main form of communication used by deaf people. Most of their activities, like; speaking, reading, and learning, involved sign languages. For reading Al-Quran, deaf people used Arabic sign language to read the ayah Al-Quran. For them, assistive technologies to aid them in the pr...
| Main Authors: | , , , , , |
|---|---|
| Format: | Conference or Workshop Item |
| Published: |
2021
|
| Subjects: |
| _version_ | 1796865848061722624 |
|---|---|
| author | Mohd. Nizam, Muhamad Zulhairi Mad Saad, Shaharil Suhaimi, Mohd. Azlan Mat Dzahir, Mohd. Azuwan Abd. Rahim, Shayfull Zamree Mat Dzahir, Mohd. Azwarie |
| author_facet | Mohd. Nizam, Muhamad Zulhairi Mad Saad, Shaharil Suhaimi, Mohd. Azlan Mat Dzahir, Mohd. Azuwan Abd. Rahim, Shayfull Zamree Mat Dzahir, Mohd. Azwarie |
| author_sort | Mohd. Nizam, Muhamad Zulhairi |
| collection | ePrints |
| description | Sign language is the main form of communication used by deaf people. Most of their activities, like; speaking, reading, and learning, involved sign languages. For reading Al-Quran, deaf people used Arabic sign language to read the ayah Al-Quran. For them, assistive technologies to aid them in the process of learning and teaching of Al-Quran is very important, since the traditional method is very difficult and challenging. One of the reasons is that, traditionally, teachers need to know Arabic Sign Languages (ArSL) first in order to teach them to learn Al-Quran. Currently, assistive technology, it still considered to be relatively new and not well developed. In Malaysia and Indonesia, most of the developed technologies are mobile app, and web-based device, which both of them required continuous internet connection and only suitable for personal used. Previous research on assistive technologies can be classified into two types of devices. First, a sensor-based device, and second is the image-based device. Both of them have their advantages and disadvantages. For this project, the only image-based device is focused since the scope of this project is limited to supervised machine learning (Convolution neural network, CNN) that developed with accuracy above 80% in training and testing. The accuracy of CNN model can be explained based on the resulting pattern obtained from the training and testing. Next, the resulting pattern can be described as overfitting, underfitting, or optimum. This project shows that, with the appropriate tuning of hyperparameters based on the resulting pattern, the accuracy of the model can be improved. This CNN model is developed from scratch through trial and error tuning method since there are no formal techniques. Lastly, the CNN model is converted into a Tensorflow Lite format, which can ready to be integrated with mobile applications. |
| first_indexed | 2024-03-05T21:03:20Z |
| format | Conference or Workshop Item |
| id | utm.eprints-94567 |
| institution | Universiti Teknologi Malaysia - ePrints |
| last_indexed | 2024-03-05T21:03:20Z |
| publishDate | 2021 |
| record_format | dspace |
| spelling | utm.eprints-945672022-03-31T15:47:50Z http://eprints.utm.my/94567/ Development of Al-Quran sign language classification based on convolutional neural network Mohd. Nizam, Muhamad Zulhairi Mad Saad, Shaharil Suhaimi, Mohd. Azlan Mat Dzahir, Mohd. Azuwan Abd. Rahim, Shayfull Zamree Mat Dzahir, Mohd. Azwarie TJ Mechanical engineering and machinery Sign language is the main form of communication used by deaf people. Most of their activities, like; speaking, reading, and learning, involved sign languages. For reading Al-Quran, deaf people used Arabic sign language to read the ayah Al-Quran. For them, assistive technologies to aid them in the process of learning and teaching of Al-Quran is very important, since the traditional method is very difficult and challenging. One of the reasons is that, traditionally, teachers need to know Arabic Sign Languages (ArSL) first in order to teach them to learn Al-Quran. Currently, assistive technology, it still considered to be relatively new and not well developed. In Malaysia and Indonesia, most of the developed technologies are mobile app, and web-based device, which both of them required continuous internet connection and only suitable for personal used. Previous research on assistive technologies can be classified into two types of devices. First, a sensor-based device, and second is the image-based device. Both of them have their advantages and disadvantages. For this project, the only image-based device is focused since the scope of this project is limited to supervised machine learning (Convolution neural network, CNN) that developed with accuracy above 80% in training and testing. The accuracy of CNN model can be explained based on the resulting pattern obtained from the training and testing. Next, the resulting pattern can be described as overfitting, underfitting, or optimum. This project shows that, with the appropriate tuning of hyperparameters based on the resulting pattern, the accuracy of the model can be improved. This CNN model is developed from scratch through trial and error tuning method since there are no formal techniques. Lastly, the CNN model is converted into a Tensorflow Lite format, which can ready to be integrated with mobile applications. 2021 Conference or Workshop Item PeerReviewed Mohd. Nizam, Muhamad Zulhairi and Mad Saad, Shaharil and Suhaimi, Mohd. Azlan and Mat Dzahir, Mohd. Azuwan and Abd. Rahim, Shayfull Zamree and Mat Dzahir, Mohd. Azwarie (2021) Development of Al-Quran sign language classification based on convolutional neural network. In: 8th International Conference on Advanced Material Engineering and Technology, ICAMET 2020, 26 - 27 November 2020, Langkawi, Malaysia. http://dx.doi.org/10.1063/5.0051490 |
| spellingShingle | TJ Mechanical engineering and machinery Mohd. Nizam, Muhamad Zulhairi Mad Saad, Shaharil Suhaimi, Mohd. Azlan Mat Dzahir, Mohd. Azuwan Abd. Rahim, Shayfull Zamree Mat Dzahir, Mohd. Azwarie Development of Al-Quran sign language classification based on convolutional neural network |
| title | Development of Al-Quran sign language classification based on convolutional neural network |
| title_full | Development of Al-Quran sign language classification based on convolutional neural network |
| title_fullStr | Development of Al-Quran sign language classification based on convolutional neural network |
| title_full_unstemmed | Development of Al-Quran sign language classification based on convolutional neural network |
| title_short | Development of Al-Quran sign language classification based on convolutional neural network |
| title_sort | development of al quran sign language classification based on convolutional neural network |
| topic | TJ Mechanical engineering and machinery |
| work_keys_str_mv | AT mohdnizammuhamadzulhairi developmentofalquransignlanguageclassificationbasedonconvolutionalneuralnetwork AT madsaadshaharil developmentofalquransignlanguageclassificationbasedonconvolutionalneuralnetwork AT suhaimimohdazlan developmentofalquransignlanguageclassificationbasedonconvolutionalneuralnetwork AT matdzahirmohdazuwan developmentofalquransignlanguageclassificationbasedonconvolutionalneuralnetwork AT abdrahimshayfullzamree developmentofalquransignlanguageclassificationbasedonconvolutionalneuralnetwork AT matdzahirmohdazwarie developmentofalquransignlanguageclassificationbasedonconvolutionalneuralnetwork |