Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis
Machine learning models are used today to solve problems within a broad span of disciplines. If the proper hyperparameter tuning of a machine learning classifier is performed, significantly higher accuracy can be obtained. In this paper, a comprehensive comparative analysis of various hyperparameter...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-11-01
|
| Series: | Informatics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-9709/8/4/79 |
| _version_ | 1797503626228269056 |
|---|---|
| author | Enas Elgeldawi Awny Sayed Ahmed R. Galal Alaa M. Zaki |
| author_facet | Enas Elgeldawi Awny Sayed Ahmed R. Galal Alaa M. Zaki |
| author_sort | Enas Elgeldawi |
| collection | DOAJ |
| description | Machine learning models are used today to solve problems within a broad span of disciplines. If the proper hyperparameter tuning of a machine learning classifier is performed, significantly higher accuracy can be obtained. In this paper, a comprehensive comparative analysis of various hyperparameter tuning techniques is performed; these are Grid Search, Random Search, Bayesian Optimization, Particle Swarm Optimization (PSO), and Genetic Algorithm (GA). They are used to optimize the accuracy of six machine learning algorithms, namely, Logistic Regression (LR), Ridge Classifier (RC), Support Vector Machine Classifier (SVC), Decision Tree (DT), Random Forest (RF), and Naive Bayes (NB) classifiers. To test the performance of each hyperparameter tuning technique, the machine learning models are used to solve an Arabic sentiment classification problem. Sentiment analysis is the process of detecting whether a text carries a positive, negative, or neutral sentiment. However, extracting such sentiment from a complex derivational morphology language such as Arabic has been always very challenging. The performance of all classifiers is tested using our constructed dataset both before and after the hyperparameter tuning process. A detailed analysis is described, along with the strengths and limitations of each hyperparameter tuning technique. The results show that the highest accuracy was given by SVC both before and after the hyperparameter tuning process, with a score of 95.6208 obtained when using Bayesian Optimization. |
| first_indexed | 2024-03-10T03:53:23Z |
| format | Article |
| id | doaj.art-20d79158db2a410c92a6a45735942ee4 |
| institution | Directory Open Access Journal |
| issn | 2227-9709 |
| language | English |
| last_indexed | 2024-03-10T03:53:23Z |
| publishDate | 2021-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Informatics |
| spelling | doaj.art-20d79158db2a410c92a6a45735942ee42023-11-23T08:51:05ZengMDPI AGInformatics2227-97092021-11-01847910.3390/informatics8040079Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment AnalysisEnas Elgeldawi0Awny Sayed1Ahmed R. Galal2Alaa M. Zaki3Computer Science Department, Faculty of Science, Minia University, Minia 61519, EgyptComputer Science Department, Faculty of Science, Minia University, Minia 61519, EgyptComputer Science Department, Faculty of Science, Minia University, Minia 61519, EgyptComputer Science Department, Faculty of Science, Minia University, Minia 61519, EgyptMachine learning models are used today to solve problems within a broad span of disciplines. If the proper hyperparameter tuning of a machine learning classifier is performed, significantly higher accuracy can be obtained. In this paper, a comprehensive comparative analysis of various hyperparameter tuning techniques is performed; these are Grid Search, Random Search, Bayesian Optimization, Particle Swarm Optimization (PSO), and Genetic Algorithm (GA). They are used to optimize the accuracy of six machine learning algorithms, namely, Logistic Regression (LR), Ridge Classifier (RC), Support Vector Machine Classifier (SVC), Decision Tree (DT), Random Forest (RF), and Naive Bayes (NB) classifiers. To test the performance of each hyperparameter tuning technique, the machine learning models are used to solve an Arabic sentiment classification problem. Sentiment analysis is the process of detecting whether a text carries a positive, negative, or neutral sentiment. However, extracting such sentiment from a complex derivational morphology language such as Arabic has been always very challenging. The performance of all classifiers is tested using our constructed dataset both before and after the hyperparameter tuning process. A detailed analysis is described, along with the strengths and limitations of each hyperparameter tuning technique. The results show that the highest accuracy was given by SVC both before and after the hyperparameter tuning process, with a score of 95.6208 obtained when using Bayesian Optimization.https://www.mdpi.com/2227-9709/8/4/79hyperparameter tuningArabic sentiment analysismachine learning |
| spellingShingle | Enas Elgeldawi Awny Sayed Ahmed R. Galal Alaa M. Zaki Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis Informatics hyperparameter tuning Arabic sentiment analysis machine learning |
| title | Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis |
| title_full | Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis |
| title_fullStr | Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis |
| title_full_unstemmed | Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis |
| title_short | Hyperparameter Tuning for Machine Learning Algorithms Used for Arabic Sentiment Analysis |
| title_sort | hyperparameter tuning for machine learning algorithms used for arabic sentiment analysis |
| topic | hyperparameter tuning Arabic sentiment analysis machine learning |
| url | https://www.mdpi.com/2227-9709/8/4/79 |
| work_keys_str_mv | AT enaselgeldawi hyperparametertuningformachinelearningalgorithmsusedforarabicsentimentanalysis AT awnysayed hyperparametertuningformachinelearningalgorithmsusedforarabicsentimentanalysis AT ahmedrgalal hyperparametertuningformachinelearningalgorithmsusedforarabicsentimentanalysis AT alaamzaki hyperparametertuningformachinelearningalgorithmsusedforarabicsentimentanalysis |