Improving Prediction Accuracy of Lasso and Ridge Regression as an Alternative to LS Regression to Identify Variable Selection Problems
This paper introduces the Lasso and Ridge Regression methods, which are two popular regularization approaches. The method they give a penalty to the coefficients differs in both of them. L1 Regularization refers to Lasso linear regression, while L2 Regularization refers to Ridge regression. As we al...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Salahaddin University-Erbil
2022-12-01
|
| Series: | Zanco Journal of Pure and Applied Sciences |
| Subjects: | |
| Online Access: | https://zancojournal.su.edu.krd/index.php/JPAS/article/view/1244 |
| _version_ | 1797370728786427904 |
|---|---|
| author | Pareekhan Abdulla Omer |
| author_facet | Pareekhan Abdulla Omer |
| author_sort | Pareekhan Abdulla Omer |
| collection | DOAJ |
| description | This paper introduces the Lasso and Ridge Regression methods, which are two popular regularization approaches. The method they give a penalty to the coefficients differs in both of them. L1 Regularization refers to Lasso linear regression, while L2 Regularization refers to Ridge regression. As we all know, regression models serve two main purposes: explanation and prediction of scientific phenomena. Where prediction accuracy will be optimized by balancing each of the bias and variance of predictions, while explanation will be gained by constructing interpretable regression models by variable selection. The penalized regression method, also known as Lasso regression, adds bias to the model's estimates and reduces variance to enhance prediction. Ridge regression, on the other hand, introduces a minor amount of bias in the data to get long-term predictions. In the presence of multicollinearity, both regression methods have been offered as an alternative to the least square approach (LS). Because they deal with multicollinearity, they have the appropriate properties to reduce numerical instability caused by overfitting. As a result, prediction accuracy can be improved. For this study, the Corona virus disease (Covid-19) dataset was used, which has had a significant impact on global life. Particularly in our region (Kurdistan), where life has altered dramatically and many people have succumbed to this deadly sickness. Our data is utilized to analyze the benefits of each of the two regression methods. The results show that the Lasso approach produces more accurate and dependable or reliable results in the presence of multicollinearity than Ridge and LS methods when compared in terms of accuracy of predictions by using NCSS10, EViews 12 and SPSS 25. |
| first_indexed | 2024-03-08T18:08:40Z |
| format | Article |
| id | doaj.art-833828bd214a4357a7799a292a31d4b4 |
| institution | Directory Open Access Journal |
| issn | 2218-0230 2412-3986 |
| language | English |
| last_indexed | 2024-03-08T18:08:40Z |
| publishDate | 2022-12-01 |
| publisher | Salahaddin University-Erbil |
| record_format | Article |
| series | Zanco Journal of Pure and Applied Sciences |
| spelling | doaj.art-833828bd214a4357a7799a292a31d4b42024-01-01T11:09:39ZengSalahaddin University-ErbilZanco Journal of Pure and Applied Sciences2218-02302412-39862022-12-0134s610.21271/ZJPAS.34.s6.5Improving Prediction Accuracy of Lasso and Ridge Regression as an Alternative to LS Regression to Identify Variable Selection ProblemsPareekhan Abdulla OmerThis paper introduces the Lasso and Ridge Regression methods, which are two popular regularization approaches. The method they give a penalty to the coefficients differs in both of them. L1 Regularization refers to Lasso linear regression, while L2 Regularization refers to Ridge regression. As we all know, regression models serve two main purposes: explanation and prediction of scientific phenomena. Where prediction accuracy will be optimized by balancing each of the bias and variance of predictions, while explanation will be gained by constructing interpretable regression models by variable selection. The penalized regression method, also known as Lasso regression, adds bias to the model's estimates and reduces variance to enhance prediction. Ridge regression, on the other hand, introduces a minor amount of bias in the data to get long-term predictions. In the presence of multicollinearity, both regression methods have been offered as an alternative to the least square approach (LS). Because they deal with multicollinearity, they have the appropriate properties to reduce numerical instability caused by overfitting. As a result, prediction accuracy can be improved. For this study, the Corona virus disease (Covid-19) dataset was used, which has had a significant impact on global life. Particularly in our region (Kurdistan), where life has altered dramatically and many people have succumbed to this deadly sickness. Our data is utilized to analyze the benefits of each of the two regression methods. The results show that the Lasso approach produces more accurate and dependable or reliable results in the presence of multicollinearity than Ridge and LS methods when compared in terms of accuracy of predictions by using NCSS10, EViews 12 and SPSS 25.https://zancojournal.su.edu.krd/index.php/JPAS/article/view/1244methodologyregularizationlasso regressionridge regressionmulticollinearity. |
| spellingShingle | Pareekhan Abdulla Omer Improving Prediction Accuracy of Lasso and Ridge Regression as an Alternative to LS Regression to Identify Variable Selection Problems Zanco Journal of Pure and Applied Sciences methodology regularization lasso regression ridge regression multicollinearity. |
| title | Improving Prediction Accuracy of Lasso and Ridge Regression as an Alternative to LS Regression to Identify Variable Selection Problems |
| title_full | Improving Prediction Accuracy of Lasso and Ridge Regression as an Alternative to LS Regression to Identify Variable Selection Problems |
| title_fullStr | Improving Prediction Accuracy of Lasso and Ridge Regression as an Alternative to LS Regression to Identify Variable Selection Problems |
| title_full_unstemmed | Improving Prediction Accuracy of Lasso and Ridge Regression as an Alternative to LS Regression to Identify Variable Selection Problems |
| title_short | Improving Prediction Accuracy of Lasso and Ridge Regression as an Alternative to LS Regression to Identify Variable Selection Problems |
| title_sort | improving prediction accuracy of lasso and ridge regression as an alternative to ls regression to identify variable selection problems |
| topic | methodology regularization lasso regression ridge regression multicollinearity. |
| url | https://zancojournal.su.edu.krd/index.php/JPAS/article/view/1244 |
| work_keys_str_mv | AT pareekhanabdullaomer improvingpredictionaccuracyoflassoandridgeregressionasanalternativetolsregressiontoidentifyvariableselectionproblems |