Aspect-based classification of vaccine misinformation: a spatiotemporal analysis using Twitter chatter
Abstract Background The spread of misinformation of all types threatens people’s safety and interrupts resolutions. COVID-19 vaccination has been a widely discussed topic on social media platforms with numerous misleading and fallacious information. This false information has a critical impact on th...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-06-01
|
| Series: | BMC Public Health |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12889-023-16067-y |
| _version_ | 1797795439760637952 |
|---|---|
| author | Heba Ismail Nada Hussein Rawan Elabyad Salma Abdelhalim Mourad Elhadef |
| author_facet | Heba Ismail Nada Hussein Rawan Elabyad Salma Abdelhalim Mourad Elhadef |
| author_sort | Heba Ismail |
| collection | DOAJ |
| description | Abstract Background The spread of misinformation of all types threatens people’s safety and interrupts resolutions. COVID-19 vaccination has been a widely discussed topic on social media platforms with numerous misleading and fallacious information. This false information has a critical impact on the safety of society as it prevents many people from taking the vaccine, decelerating the world’s ability to go back to normal. Therefore, it is vital to analyze the content shared on social media platforms, detect misinformation, identify aspects of misinformation, and efficiently represent related statistics to combat the spread of misleading information about the vaccine. This paper aims to support stakeholders in decision-making by providing solid and current insights into the spatiotemporal progression of the common misinformation aspects of the various available vaccines. Methods Approximately 3800 tweets were annotated into four expert-verified aspects of vaccine misinformation obtained from reliable medical resources. Next, an Aspect-based Misinformation Analysis Framework was designed using the Light Gradient Boosting Machine (LightGBM) model, which is one of the most advanced, fast, and efficient machine learning models to date. Based on this dataset, spatiotemporal statistical analysis was performed to infer insights into the progression of aspects of vaccine misinformation among the public. Finally, the Pearson correlation coefficient and p-values are calculated for the global misinformation count against the vaccination counts of 43 countries from December 2020 until July 2021. Results The optimized classification per class (i.e., per an aspect of misinformation) accuracy was 87.4%, 92.7%, 80.1%, and 82.5% for the “Vaccine Constituent,” “Adverse Effects,” “Agenda,” “Efficacy and Clinical Trials” aspects, respectively. The model achieved an Area Under the ROC Curve (AUC) of 90.3% and 89.6% for validation and testing, respectively, which indicates the reliability of the proposed framework in detecting aspects of vaccine misinformation on Twitter. The correlation analysis shows that 37% of the countries addressed in this study were negatively affected by the spread of misinformation on Twitter resulting in reduced number of administered vaccines during the same timeframe. Conclusions Twitter is a rich source of insight on the progression of vaccine misinformation among the public. Machine Learning models, such as LightGBM, are efficient for multi-class classification and proved reliable in classifying vaccine misinformation aspects even with limited samples in social media datasets. |
| first_indexed | 2024-03-13T03:17:57Z |
| format | Article |
| id | doaj.art-37ac18c01b064466b760f83b1cee44fd |
| institution | Directory Open Access Journal |
| issn | 1471-2458 |
| language | English |
| last_indexed | 2024-03-13T03:17:57Z |
| publishDate | 2023-06-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Public Health |
| spelling | doaj.art-37ac18c01b064466b760f83b1cee44fd2023-06-25T11:31:18ZengBMCBMC Public Health1471-24582023-06-0123111410.1186/s12889-023-16067-yAspect-based classification of vaccine misinformation: a spatiotemporal analysis using Twitter chatterHeba Ismail0Nada Hussein1Rawan Elabyad2Salma Abdelhalim3Mourad Elhadef4College of Engineering, Computer Science and Information Technology Department, Abu Dhabi UniversityCollege of Engineering, Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi UniversityCollege of Engineering, Computer Science and Information Technology Department, Abu Dhabi UniversityCollege of Engineering, Computer Science and Information Technology Department, Abu Dhabi UniversityCollege of Engineering, Computer Science and Information Technology Department, Abu Dhabi UniversityAbstract Background The spread of misinformation of all types threatens people’s safety and interrupts resolutions. COVID-19 vaccination has been a widely discussed topic on social media platforms with numerous misleading and fallacious information. This false information has a critical impact on the safety of society as it prevents many people from taking the vaccine, decelerating the world’s ability to go back to normal. Therefore, it is vital to analyze the content shared on social media platforms, detect misinformation, identify aspects of misinformation, and efficiently represent related statistics to combat the spread of misleading information about the vaccine. This paper aims to support stakeholders in decision-making by providing solid and current insights into the spatiotemporal progression of the common misinformation aspects of the various available vaccines. Methods Approximately 3800 tweets were annotated into four expert-verified aspects of vaccine misinformation obtained from reliable medical resources. Next, an Aspect-based Misinformation Analysis Framework was designed using the Light Gradient Boosting Machine (LightGBM) model, which is one of the most advanced, fast, and efficient machine learning models to date. Based on this dataset, spatiotemporal statistical analysis was performed to infer insights into the progression of aspects of vaccine misinformation among the public. Finally, the Pearson correlation coefficient and p-values are calculated for the global misinformation count against the vaccination counts of 43 countries from December 2020 until July 2021. Results The optimized classification per class (i.e., per an aspect of misinformation) accuracy was 87.4%, 92.7%, 80.1%, and 82.5% for the “Vaccine Constituent,” “Adverse Effects,” “Agenda,” “Efficacy and Clinical Trials” aspects, respectively. The model achieved an Area Under the ROC Curve (AUC) of 90.3% and 89.6% for validation and testing, respectively, which indicates the reliability of the proposed framework in detecting aspects of vaccine misinformation on Twitter. The correlation analysis shows that 37% of the countries addressed in this study were negatively affected by the spread of misinformation on Twitter resulting in reduced number of administered vaccines during the same timeframe. Conclusions Twitter is a rich source of insight on the progression of vaccine misinformation among the public. Machine Learning models, such as LightGBM, are efficient for multi-class classification and proved reliable in classifying vaccine misinformation aspects even with limited samples in social media datasets.https://doi.org/10.1186/s12889-023-16067-yCOVID-19 vaccineMisinformationTwitterAspect-based analysisLightGBMMachine learning |
| spellingShingle | Heba Ismail Nada Hussein Rawan Elabyad Salma Abdelhalim Mourad Elhadef Aspect-based classification of vaccine misinformation: a spatiotemporal analysis using Twitter chatter BMC Public Health COVID-19 vaccine Misinformation Aspect-based analysis LightGBM Machine learning |
| title | Aspect-based classification of vaccine misinformation: a spatiotemporal analysis using Twitter chatter |
| title_full | Aspect-based classification of vaccine misinformation: a spatiotemporal analysis using Twitter chatter |
| title_fullStr | Aspect-based classification of vaccine misinformation: a spatiotemporal analysis using Twitter chatter |
| title_full_unstemmed | Aspect-based classification of vaccine misinformation: a spatiotemporal analysis using Twitter chatter |
| title_short | Aspect-based classification of vaccine misinformation: a spatiotemporal analysis using Twitter chatter |
| title_sort | aspect based classification of vaccine misinformation a spatiotemporal analysis using twitter chatter |
| topic | COVID-19 vaccine Misinformation Aspect-based analysis LightGBM Machine learning |
| url | https://doi.org/10.1186/s12889-023-16067-y |
| work_keys_str_mv | AT hebaismail aspectbasedclassificationofvaccinemisinformationaspatiotemporalanalysisusingtwitterchatter AT nadahussein aspectbasedclassificationofvaccinemisinformationaspatiotemporalanalysisusingtwitterchatter AT rawanelabyad aspectbasedclassificationofvaccinemisinformationaspatiotemporalanalysisusingtwitterchatter AT salmaabdelhalim aspectbasedclassificationofvaccinemisinformationaspatiotemporalanalysisusingtwitterchatter AT mouradelhadef aspectbasedclassificationofvaccinemisinformationaspatiotemporalanalysisusingtwitterchatter |