Collinearity diagnostics of binary logistic regression model
Multicollinearity is a statistical phenomenon in which predictor variables in a logistic regression model are highly correlated. It is not uncommon when there are a large number of covariates in the model. Multicollinearity has been the thousand pounds monster in statistical modeling. Taming this mo...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Taylor & Francis
2010
|
Online Access: | http://psasir.upm.edu.my/id/eprint/13626/1/Collinearity%20diagnostics%20of%20binary%20logistic%20regression%20model.pdf |
_version_ | 1825945272362991616 |
---|---|
author | Midi, Habshah Sarkar, Saroje Kumar Rana, Sohel |
author_facet | Midi, Habshah Sarkar, Saroje Kumar Rana, Sohel |
author_sort | Midi, Habshah |
collection | UPM |
description | Multicollinearity is a statistical phenomenon in which predictor variables in a logistic regression model are highly correlated. It is not uncommon when there are a large number of covariates in the model. Multicollinearity has been the thousand pounds monster in statistical modeling. Taming this monster has proven to be one of the great challenges of statistical modeling research. Multicollinearity can cause unstable estimates and inaccurate variances which affects confidence intervals and hypothesis tests. The existence of collinearity inflates the variances of the parameter estimates, and consequently incorrect inferences about relationships between explanatory and response variables. Examining the correlation matrix may be helpful to detect multicollinearity but not sufficient. Much better diagnostics are produced by linear regressionwith the option tolerance, Vif, condition indices and variance proportions. For moderate to large sample sizes, the approach to drop one of the correlated variables was established entirely satisfactory to reduce multicollinearity. On the light of different collinearity diagnostics, we may safely conclude that without increasing sample size, the second choice to omit one of the correlated variables can reduce multicollinearity to a great extent. |
first_indexed | 2024-03-06T07:28:55Z |
format | Article |
id | upm.eprints-13626 |
institution | Universiti Putra Malaysia |
language | English |
last_indexed | 2024-03-06T07:28:55Z |
publishDate | 2010 |
publisher | Taylor & Francis |
record_format | dspace |
spelling | upm.eprints-136262015-10-21T00:04:21Z http://psasir.upm.edu.my/id/eprint/13626/ Collinearity diagnostics of binary logistic regression model Midi, Habshah Sarkar, Saroje Kumar Rana, Sohel Multicollinearity is a statistical phenomenon in which predictor variables in a logistic regression model are highly correlated. It is not uncommon when there are a large number of covariates in the model. Multicollinearity has been the thousand pounds monster in statistical modeling. Taming this monster has proven to be one of the great challenges of statistical modeling research. Multicollinearity can cause unstable estimates and inaccurate variances which affects confidence intervals and hypothesis tests. The existence of collinearity inflates the variances of the parameter estimates, and consequently incorrect inferences about relationships between explanatory and response variables. Examining the correlation matrix may be helpful to detect multicollinearity but not sufficient. Much better diagnostics are produced by linear regressionwith the option tolerance, Vif, condition indices and variance proportions. For moderate to large sample sizes, the approach to drop one of the correlated variables was established entirely satisfactory to reduce multicollinearity. On the light of different collinearity diagnostics, we may safely conclude that without increasing sample size, the second choice to omit one of the correlated variables can reduce multicollinearity to a great extent. Taylor & Francis 2010 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/13626/1/Collinearity%20diagnostics%20of%20binary%20logistic%20regression%20model.pdf Midi, Habshah and Sarkar, Saroje Kumar and Rana, Sohel (2010) Collinearity diagnostics of binary logistic regression model. Journal of Interdisciplinary Mathematics, 13 (3). pp. 253-267. ISSN 0972-0502; ESSN: 2169-012X 10.1080/09720502.2010.10700699 |
spellingShingle | Midi, Habshah Sarkar, Saroje Kumar Rana, Sohel Collinearity diagnostics of binary logistic regression model |
title | Collinearity diagnostics of binary logistic regression model |
title_full | Collinearity diagnostics of binary logistic regression model |
title_fullStr | Collinearity diagnostics of binary logistic regression model |
title_full_unstemmed | Collinearity diagnostics of binary logistic regression model |
title_short | Collinearity diagnostics of binary logistic regression model |
title_sort | collinearity diagnostics of binary logistic regression model |
url | http://psasir.upm.edu.my/id/eprint/13626/1/Collinearity%20diagnostics%20of%20binary%20logistic%20regression%20model.pdf |
work_keys_str_mv | AT midihabshah collinearitydiagnosticsofbinarylogisticregressionmodel AT sarkarsarojekumar collinearitydiagnosticsofbinarylogisticregressionmodel AT ranasohel collinearitydiagnosticsofbinarylogisticregressionmodel |