Combating outliers and multicollinearity in linear regression model using robust Kibria-Lukman mixed with principal component estimator, simulation and computation

Scholars usually adopt the method of least squared to model the relationship between a response variable and two or more explanatory variables. Ordinary least squares estimator's performance is good when there is no outliers and multicollinearity in the regression model dataset. Outliers and mu...

Full description

Bibliographic Details
Main Authors: K.C. Arum, F.I. Ugwuowo, H.E. Oranye, T.O. Alakija, T.E. Ugah, O.C. Asogwa
Format: Article
Language:English
Published: Elsevier 2023-03-01
Series:Scientific African
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S246822762300025X
_version_ 1811159658300178432
author K.C. Arum
F.I. Ugwuowo
H.E. Oranye
T.O. Alakija
T.E. Ugah
O.C. Asogwa
author_facet K.C. Arum
F.I. Ugwuowo
H.E. Oranye
T.O. Alakija
T.E. Ugah
O.C. Asogwa
author_sort K.C. Arum
collection DOAJ
description Scholars usually adopt the method of least squared to model the relationship between a response variable and two or more explanatory variables. Ordinary least squares estimator's performance is good when there is no outliers and multicollinearity in the regression model dataset. Outliers and multicollinearity can occur together in a regression model dataset and least squares estimator suffers setback when both problems subsist. This study considers developing a new estimator to address both problems. We combined the principal component estimator (PCE), M-estimator and Kibria-Lukman estimator (KLE) to derive new estimator called robust PC-KL. Robust PC-KL estimator inherits the characteristics of M-estimator, KLE, and PCE which makes it efficient in handling both problems individually and jointly. We examined the performance of the robust PC-KL estimator with other existing estimators using mean squared error (MSE) as performance evaluation criteria through simulation design and real life application. Robust PC-KL estimator outperformed other estimators compared with in this study based on theoretical comparison, simulation design and real life application by having the smallest MSE.
first_indexed 2024-04-10T05:44:53Z
format Article
id doaj.art-fde1cdbb3d914f15a3d877d8de43ff73
institution Directory Open Access Journal
issn 2468-2276
language English
last_indexed 2024-04-10T05:44:53Z
publishDate 2023-03-01
publisher Elsevier
record_format Article
series Scientific African
spelling doaj.art-fde1cdbb3d914f15a3d877d8de43ff732023-03-06T04:18:21ZengElsevierScientific African2468-22762023-03-0119e01566Combating outliers and multicollinearity in linear regression model using robust Kibria-Lukman mixed with principal component estimator, simulation and computationK.C. Arum0F.I. Ugwuowo1H.E. Oranye2T.O. Alakija3T.E. Ugah4O.C. Asogwa5Department of Statistics, University of Nigeria, Nsukka, Nigeria; Corresponding author.Department of Statistics, University of Nigeria, Nsukka, NigeriaDepartment of Statistics, University of Nigeria, Nsukka, NigeriaDepartment of Statistics, Yaba College of Technology, Yaba Lagos, NigeriaDepartment of Statistics, University of Nigeria, Nsukka, NigeriaDepartment of Statistics, Federal University, Ndufu Alike, Ikwo, Ebonyi State, NigeriaScholars usually adopt the method of least squared to model the relationship between a response variable and two or more explanatory variables. Ordinary least squares estimator's performance is good when there is no outliers and multicollinearity in the regression model dataset. Outliers and multicollinearity can occur together in a regression model dataset and least squares estimator suffers setback when both problems subsist. This study considers developing a new estimator to address both problems. We combined the principal component estimator (PCE), M-estimator and Kibria-Lukman estimator (KLE) to derive new estimator called robust PC-KL. Robust PC-KL estimator inherits the characteristics of M-estimator, KLE, and PCE which makes it efficient in handling both problems individually and jointly. We examined the performance of the robust PC-KL estimator with other existing estimators using mean squared error (MSE) as performance evaluation criteria through simulation design and real life application. Robust PC-KL estimator outperformed other estimators compared with in this study based on theoretical comparison, simulation design and real life application by having the smallest MSE.http://www.sciencedirect.com/science/article/pii/S246822762300025XRidge estimatorKibria-Lukman estimatorM-estimatorPrincipal componentMulticollinearityOutliers
spellingShingle K.C. Arum
F.I. Ugwuowo
H.E. Oranye
T.O. Alakija
T.E. Ugah
O.C. Asogwa
Combating outliers and multicollinearity in linear regression model using robust Kibria-Lukman mixed with principal component estimator, simulation and computation
Scientific African
Ridge estimator
Kibria-Lukman estimator
M-estimator
Principal component
Multicollinearity
Outliers
title Combating outliers and multicollinearity in linear regression model using robust Kibria-Lukman mixed with principal component estimator, simulation and computation
title_full Combating outliers and multicollinearity in linear regression model using robust Kibria-Lukman mixed with principal component estimator, simulation and computation
title_fullStr Combating outliers and multicollinearity in linear regression model using robust Kibria-Lukman mixed with principal component estimator, simulation and computation
title_full_unstemmed Combating outliers and multicollinearity in linear regression model using robust Kibria-Lukman mixed with principal component estimator, simulation and computation
title_short Combating outliers and multicollinearity in linear regression model using robust Kibria-Lukman mixed with principal component estimator, simulation and computation
title_sort combating outliers and multicollinearity in linear regression model using robust kibria lukman mixed with principal component estimator simulation and computation
topic Ridge estimator
Kibria-Lukman estimator
M-estimator
Principal component
Multicollinearity
Outliers
url http://www.sciencedirect.com/science/article/pii/S246822762300025X
work_keys_str_mv AT kcarum combatingoutliersandmulticollinearityinlinearregressionmodelusingrobustkibrialukmanmixedwithprincipalcomponentestimatorsimulationandcomputation
AT fiugwuowo combatingoutliersandmulticollinearityinlinearregressionmodelusingrobustkibrialukmanmixedwithprincipalcomponentestimatorsimulationandcomputation
AT heoranye combatingoutliersandmulticollinearityinlinearregressionmodelusingrobustkibrialukmanmixedwithprincipalcomponentestimatorsimulationandcomputation
AT toalakija combatingoutliersandmulticollinearityinlinearregressionmodelusingrobustkibrialukmanmixedwithprincipalcomponentestimatorsimulationandcomputation
AT teugah combatingoutliersandmulticollinearityinlinearregressionmodelusingrobustkibrialukmanmixedwithprincipalcomponentestimatorsimulationandcomputation
AT ocasogwa combatingoutliersandmulticollinearityinlinearregressionmodelusingrobustkibrialukmanmixedwithprincipalcomponentestimatorsimulationandcomputation