Collinearity diagnostics of binary logistic regression model

Multicollinearity is a statistical phenomenon in which predictor variables in a logistic regression model are highly correlated. It is not uncommon when there are a large number of covariates in the model. Multicollinearity has been the thousand pounds monster in statistical modeling. Taming this mo...

Full description

Bibliographic Details
Main Authors: Midi, Habshah, Sarkar, Saroje Kumar, Rana, Sohel
Format: Article
Language:English
Published: Taylor & Francis 2010
Online Access:http://psasir.upm.edu.my/id/eprint/13626/1/Collinearity%20diagnostics%20of%20binary%20logistic%20regression%20model.pdf
_version_ 1825945272362991616
author Midi, Habshah
Sarkar, Saroje Kumar
Rana, Sohel
author_facet Midi, Habshah
Sarkar, Saroje Kumar
Rana, Sohel
author_sort Midi, Habshah
collection UPM
description Multicollinearity is a statistical phenomenon in which predictor variables in a logistic regression model are highly correlated. It is not uncommon when there are a large number of covariates in the model. Multicollinearity has been the thousand pounds monster in statistical modeling. Taming this monster has proven to be one of the great challenges of statistical modeling research. Multicollinearity can cause unstable estimates and inaccurate variances which affects confidence intervals and hypothesis tests. The existence of collinearity inflates the variances of the parameter estimates, and consequently incorrect inferences about relationships between explanatory and response variables. Examining the correlation matrix may be helpful to detect multicollinearity but not sufficient. Much better diagnostics are produced by linear regressionwith the option tolerance, Vif, condition indices and variance proportions. For moderate to large sample sizes, the approach to drop one of the correlated variables was established entirely satisfactory to reduce multicollinearity. On the light of different collinearity diagnostics, we may safely conclude that without increasing sample size, the second choice to omit one of the correlated variables can reduce multicollinearity to a great extent.
first_indexed 2024-03-06T07:28:55Z
format Article
id upm.eprints-13626
institution Universiti Putra Malaysia
language English
last_indexed 2024-03-06T07:28:55Z
publishDate 2010
publisher Taylor & Francis
record_format dspace
spelling upm.eprints-136262015-10-21T00:04:21Z http://psasir.upm.edu.my/id/eprint/13626/ Collinearity diagnostics of binary logistic regression model Midi, Habshah Sarkar, Saroje Kumar Rana, Sohel Multicollinearity is a statistical phenomenon in which predictor variables in a logistic regression model are highly correlated. It is not uncommon when there are a large number of covariates in the model. Multicollinearity has been the thousand pounds monster in statistical modeling. Taming this monster has proven to be one of the great challenges of statistical modeling research. Multicollinearity can cause unstable estimates and inaccurate variances which affects confidence intervals and hypothesis tests. The existence of collinearity inflates the variances of the parameter estimates, and consequently incorrect inferences about relationships between explanatory and response variables. Examining the correlation matrix may be helpful to detect multicollinearity but not sufficient. Much better diagnostics are produced by linear regressionwith the option tolerance, Vif, condition indices and variance proportions. For moderate to large sample sizes, the approach to drop one of the correlated variables was established entirely satisfactory to reduce multicollinearity. On the light of different collinearity diagnostics, we may safely conclude that without increasing sample size, the second choice to omit one of the correlated variables can reduce multicollinearity to a great extent. Taylor & Francis 2010 Article PeerReviewed application/pdf en http://psasir.upm.edu.my/id/eprint/13626/1/Collinearity%20diagnostics%20of%20binary%20logistic%20regression%20model.pdf Midi, Habshah and Sarkar, Saroje Kumar and Rana, Sohel (2010) Collinearity diagnostics of binary logistic regression model. Journal of Interdisciplinary Mathematics, 13 (3). pp. 253-267. ISSN 0972-0502; ESSN: 2169-012X 10.1080/09720502.2010.10700699
spellingShingle Midi, Habshah
Sarkar, Saroje Kumar
Rana, Sohel
Collinearity diagnostics of binary logistic regression model
title Collinearity diagnostics of binary logistic regression model
title_full Collinearity diagnostics of binary logistic regression model
title_fullStr Collinearity diagnostics of binary logistic regression model
title_full_unstemmed Collinearity diagnostics of binary logistic regression model
title_short Collinearity diagnostics of binary logistic regression model
title_sort collinearity diagnostics of binary logistic regression model
url http://psasir.upm.edu.my/id/eprint/13626/1/Collinearity%20diagnostics%20of%20binary%20logistic%20regression%20model.pdf
work_keys_str_mv AT midihabshah collinearitydiagnosticsofbinarylogisticregressionmodel
AT sarkarsarojekumar collinearitydiagnosticsofbinarylogisticregressionmodel
AT ranasohel collinearitydiagnosticsofbinarylogisticregressionmodel