Robust estimations as a remedy for multicollinearity caused by multiple high leverage points
Problem statement: The Least Squares (LS) method has been the most popular technique for estimating the parameters of a model due to its optimal properties and ease of computation. LS estimated regression may be seriously disturbed by multicollinearity which is a near linear dependency between two o...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English English |
| Published: |
Science Publications
2009
|
| Subjects: | |
| Online Access: | http://psasir.upm.edu.my/id/eprint/16588/1/Robust%20estimations%20as%20a%20remedy%20for%20multicollinearity%20caused%20by%20multiple%20high%20leverage%20points.pdf |
| _version_ | 1796969084419571712 |
|---|---|
| author | Bagheri, Arezoo Midi, Habshah |
| author_facet | Bagheri, Arezoo Midi, Habshah |
| author_sort | Bagheri, Arezoo |
| collection | UPM |
| description | Problem statement: The Least Squares (LS) method has been the most popular technique for estimating the parameters of a model due to its optimal properties and ease of computation. LS estimated regression may be seriously disturbed by multicollinearity which is a near linear dependency between two or more explanatory variables in the regression models. Even though LS estimates are unbiased in the presence of multicollinearity, they will be imprecise with inflated standard errors of the estimated regression coefficients. It is now evident that the multiple high leverage points which are the outliers in the X-direction may be the prime source of collinearity-influential observations.
Approach: In this study, we had proposed robust procedures for the estimation of regression parameters in the presence of multiple high leverage points which cause multicollinearity problems. This procedure utilized mainly a one step reweighted least square where the initial weight functions were determined by the Diagnostic-Robust Generalized Potentials (DRGP). Here, we had incorporated
the DRGP with different types of robust methods to downweight the multiple high leverage points
which lead to reducing the effects of multicollinearity. The new proposed methods were called GMDRGP-
L1, GM-DRGP-LTS, M-DRGP, MM-DRGP, DRGP-MM. Some indicators had been defined to obtain the best performance robust method among the existing and new introduced methods. Results:The empirical study indicated that the DRGP-MM emerge to be more efficient and more reliable than
other methods, followed by the GM-DRGP-LTS as they were able to reduce the most effect of multicollinearity. The results seemed to suggest that the DRGP-MM and the GM-DRGP-LTS offers a substantial improvement over other methods for correcting the problems of high leverage points
enhancing multicollinearity.
Conclusion/Recommendations: In order to solve the multicollinearity problems which are mainly due to the multiple high leverage points, two proposed robust methods,
DRGP- MM and the GM-DRGP-LTS, were recommended. |
| first_indexed | 2024-03-06T07:37:51Z |
| format | Article |
| id | upm.eprints-16588 |
| institution | Universiti Putra Malaysia |
| language | English English |
| last_indexed | 2024-03-06T07:37:51Z |
| publishDate | 2009 |
| publisher | Science Publications |
| record_format | dspace |
| spelling | upm.eprints-165882015-09-03T02:03:31Z http://psasir.upm.edu.my/id/eprint/16588/ Robust estimations as a remedy for multicollinearity caused by multiple high leverage points Bagheri, Arezoo Midi, Habshah Problem statement: The Least Squares (LS) method has been the most popular technique for estimating the parameters of a model due to its optimal properties and ease of computation. LS estimated regression may be seriously disturbed by multicollinearity which is a near linear dependency between two or more explanatory variables in the regression models. Even though LS estimates are unbiased in the presence of multicollinearity, they will be imprecise with inflated standard errors of the estimated regression coefficients. It is now evident that the multiple high leverage points which are the outliers in the X-direction may be the prime source of collinearity-influential observations. Approach: In this study, we had proposed robust procedures for the estimation of regression parameters in the presence of multiple high leverage points which cause multicollinearity problems. This procedure utilized mainly a one step reweighted least square where the initial weight functions were determined by the Diagnostic-Robust Generalized Potentials (DRGP). Here, we had incorporated the DRGP with different types of robust methods to downweight the multiple high leverage points which lead to reducing the effects of multicollinearity. The new proposed methods were called GMDRGP- L1, GM-DRGP-LTS, M-DRGP, MM-DRGP, DRGP-MM. Some indicators had been defined to obtain the best performance robust method among the existing and new introduced methods. Results:The empirical study indicated that the DRGP-MM emerge to be more efficient and more reliable than other methods, followed by the GM-DRGP-LTS as they were able to reduce the most effect of multicollinearity. The results seemed to suggest that the DRGP-MM and the GM-DRGP-LTS offers a substantial improvement over other methods for correcting the problems of high leverage points enhancing multicollinearity. Conclusion/Recommendations: In order to solve the multicollinearity problems which are mainly due to the multiple high leverage points, two proposed robust methods, DRGP- MM and the GM-DRGP-LTS, were recommended. Science Publications 2009 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/16588/1/Robust%20estimations%20as%20a%20remedy%20for%20multicollinearity%20caused%20by%20multiple%20high%20leverage%20points.pdf Bagheri, Arezoo and Midi, Habshah (2009) Robust estimations as a remedy for multicollinearity caused by multiple high leverage points. Journal of Mathematics and Statistics, 5 (4). pp. 311-321. ISSN 1549-3644 Multicollinearity Estimation theory Least squares English |
| spellingShingle | Multicollinearity Estimation theory Least squares Bagheri, Arezoo Midi, Habshah Robust estimations as a remedy for multicollinearity caused by multiple high leverage points |
| title | Robust estimations as a remedy for multicollinearity caused by multiple high leverage points |
| title_full | Robust estimations as a remedy for multicollinearity caused by multiple high leverage points |
| title_fullStr | Robust estimations as a remedy for multicollinearity caused by multiple high leverage points |
| title_full_unstemmed | Robust estimations as a remedy for multicollinearity caused by multiple high leverage points |
| title_short | Robust estimations as a remedy for multicollinearity caused by multiple high leverage points |
| title_sort | robust estimations as a remedy for multicollinearity caused by multiple high leverage points |
| topic | Multicollinearity Estimation theory Least squares |
| url | http://psasir.upm.edu.my/id/eprint/16588/1/Robust%20estimations%20as%20a%20remedy%20for%20multicollinearity%20caused%20by%20multiple%20high%20leverage%20points.pdf |
| work_keys_str_mv | AT bagheriarezoo robustestimationsasaremedyformulticollinearitycausedbymultiplehighleveragepoints AT midihabshah robustestimationsasaremedyformulticollinearitycausedbymultiplehighleveragepoints |