Evaluating Urgency of Typhoon-Related Tweets Through Sentiment Analysis Using Artificial Neural Networks
Purpose – The main objective of this project was to evaluate typhoon-related Tweets’ urgency using sentiment analysis with supervised learning over an artificial neural network. Method – The researchers implemented artificial neural network and natural language processing techniques for sentiment a...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
STEP Academic Publisher
2022-01-01
|
| Series: | International Journal of Computing Sciences Research |
| Online Access: | https://stepacademic.net/ijcsr/article/view/289 |
| _version_ | 1811329887472975872 |
|---|---|
| author | Ronnel P. Ermino Ray Carlo A. Abacan Nadine Gweneth C. Diamante Kristine Marie N. Faca Thatiana Erica D. Juntereal |
| author_facet | Ronnel P. Ermino Ray Carlo A. Abacan Nadine Gweneth C. Diamante Kristine Marie N. Faca Thatiana Erica D. Juntereal |
| author_sort | Ronnel P. Ermino |
| collection | DOAJ |
| description | Purpose – The main objective of this project was to evaluate typhoon-related Tweets’ urgency using sentiment analysis with supervised learning over an artificial neural network.
Method – The researchers implemented artificial neural network and natural language processing techniques for sentiment analysis and evaluation of the urgency score of typhoon-related Tweets. The model’s accuracy on training and validation was evaluated simultaneously. A separate validation using 100 data was done using confusion matrix analysis.
Results – The accuracy of the model in training was at 99.87% and the loss was 0.0074. Validation was conducted simultaneously with the training. It was found that the accuracy of the model was at 99.17% and the loss was 0.0680. The confusion matrix analysis showed that the sensitivity was 97.67% and the specificity was 100%. The positive predictive value was 100% and the negative predicted value was 98.28%. Both false positive and false discovery rates are at 0% while the false-negative rate was at 2.33%. Finally, the F1 score was 98.82% and accuracy was 99%.
Conclusion – The implementation of the architecture of the model was successful; the researchers concluded that the training produced successful results by looking at the high accuracy prediction of the model and the low loss during the simultaneous training and validation, and confusion matrix analysis for the separate validation.
Recommendations – The researchers recommend expanding the vocabulary of the model by adding more diverse data to the dataset when training. The model produced by this study can be used in incident reporting systems that will be helpful during times of typhoon-related disasters.
Research Implications – Using the model produced by the study in incident reporting applications of the government and NGOs will be more efficient than manually looking at typhoon-related posts on Twitter. |
| first_indexed | 2024-04-13T15:51:54Z |
| format | Article |
| id | doaj.art-71950687cd4b42e6941d3c54afd35878 |
| institution | Directory Open Access Journal |
| issn | 2546-0552 |
| language | English |
| last_indexed | 2024-04-13T15:51:54Z |
| publishDate | 2022-01-01 |
| publisher | STEP Academic Publisher |
| record_format | Article |
| series | International Journal of Computing Sciences Research |
| spelling | doaj.art-71950687cd4b42e6941d3c54afd358782022-12-22T02:40:49ZengSTEP Academic PublisherInternational Journal of Computing Sciences Research2546-05522022-01-016940950289Evaluating Urgency of Typhoon-Related Tweets Through Sentiment Analysis Using Artificial Neural NetworksRonnel P. Ermino0Ray Carlo A. Abacan1Nadine Gweneth C. Diamante2Kristine Marie N. Faca3Thatiana Erica D. Juntereal4College of Computer Studies and Multimedia Arts, FEU Alabang, PhilippinesCollege of Computer Studies and Multimedia Arts, FEU Alabang, PhilippinesCollege of Computer Studies and Multimedia Arts, FEU Alabang, PhilippinesCollege of Computer Studies and Multimedia Arts, FEU Alabang, PhilippinesCollege of Computer Studies and Multimedia Arts, FEU Alabang, PhilippinesPurpose – The main objective of this project was to evaluate typhoon-related Tweets’ urgency using sentiment analysis with supervised learning over an artificial neural network. Method – The researchers implemented artificial neural network and natural language processing techniques for sentiment analysis and evaluation of the urgency score of typhoon-related Tweets. The model’s accuracy on training and validation was evaluated simultaneously. A separate validation using 100 data was done using confusion matrix analysis. Results – The accuracy of the model in training was at 99.87% and the loss was 0.0074. Validation was conducted simultaneously with the training. It was found that the accuracy of the model was at 99.17% and the loss was 0.0680. The confusion matrix analysis showed that the sensitivity was 97.67% and the specificity was 100%. The positive predictive value was 100% and the negative predicted value was 98.28%. Both false positive and false discovery rates are at 0% while the false-negative rate was at 2.33%. Finally, the F1 score was 98.82% and accuracy was 99%. Conclusion – The implementation of the architecture of the model was successful; the researchers concluded that the training produced successful results by looking at the high accuracy prediction of the model and the low loss during the simultaneous training and validation, and confusion matrix analysis for the separate validation. Recommendations – The researchers recommend expanding the vocabulary of the model by adding more diverse data to the dataset when training. The model produced by this study can be used in incident reporting systems that will be helpful during times of typhoon-related disasters. Research Implications – Using the model produced by the study in incident reporting applications of the government and NGOs will be more efficient than manually looking at typhoon-related posts on Twitter.https://stepacademic.net/ijcsr/article/view/289 |
| spellingShingle | Ronnel P. Ermino Ray Carlo A. Abacan Nadine Gweneth C. Diamante Kristine Marie N. Faca Thatiana Erica D. Juntereal Evaluating Urgency of Typhoon-Related Tweets Through Sentiment Analysis Using Artificial Neural Networks International Journal of Computing Sciences Research |
| title | Evaluating Urgency of Typhoon-Related Tweets Through Sentiment Analysis Using Artificial Neural Networks |
| title_full | Evaluating Urgency of Typhoon-Related Tweets Through Sentiment Analysis Using Artificial Neural Networks |
| title_fullStr | Evaluating Urgency of Typhoon-Related Tweets Through Sentiment Analysis Using Artificial Neural Networks |
| title_full_unstemmed | Evaluating Urgency of Typhoon-Related Tweets Through Sentiment Analysis Using Artificial Neural Networks |
| title_short | Evaluating Urgency of Typhoon-Related Tweets Through Sentiment Analysis Using Artificial Neural Networks |
| title_sort | evaluating urgency of typhoon related tweets through sentiment analysis using artificial neural networks |
| url | https://stepacademic.net/ijcsr/article/view/289 |
| work_keys_str_mv | AT ronnelpermino evaluatingurgencyoftyphoonrelatedtweetsthroughsentimentanalysisusingartificialneuralnetworks AT raycarloaabacan evaluatingurgencyoftyphoonrelatedtweetsthroughsentimentanalysisusingartificialneuralnetworks AT nadinegwenethcdiamante evaluatingurgencyoftyphoonrelatedtweetsthroughsentimentanalysisusingartificialneuralnetworks AT kristinemarienfaca evaluatingurgencyoftyphoonrelatedtweetsthroughsentimentanalysisusingartificialneuralnetworks AT thatianaericadjuntereal evaluatingurgencyoftyphoonrelatedtweetsthroughsentimentanalysisusingartificialneuralnetworks |