A Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning Parameters

Redundant and irrelevant features in high dimensional data increase the complexity in underlying mathematical models. It is necessary to conduct pre-processing steps that search for the most relevant features in order to reduce the dimensionality of the data. This study made use of a meta-heuristic...

Full description

Bibliographic Details
Main Authors: A. Omondi, I.A. Lukandu, G.W. Wanyembi
Format: Article
Language:English
Published: Shahrood University of Technology 2020-11-01
Series:Journal of Artificial Intelligence and Data Mining
Subjects:
Online Access:http://jad.shahroodut.ac.ir/article_1832_9bee8989299c0484c9ba5bba0735cb17.pdf
_version_ 1819160474859601920
author A. Omondi
I.A. Lukandu
G.W. Wanyembi
author_facet A. Omondi
I.A. Lukandu
G.W. Wanyembi
author_sort A. Omondi
collection DOAJ
description Redundant and irrelevant features in high dimensional data increase the complexity in underlying mathematical models. It is necessary to conduct pre-processing steps that search for the most relevant features in order to reduce the dimensionality of the data. This study made use of a meta-heuristic search approach which uses lightweight random simulations to balance between the exploitation of relevant features and the exploration of features that have the potential to be relevant. In doing so, the study evaluated how effective the manipulation of the search component in feature selection is on achieving high accuracy with reduced dimensions. A control group experimental design was used to observe factual evidence. The context of the experiment was the high dimensional data experienced in performance tuning of complex database systems. The Wilcoxon signed-rank test at .05 level of significance was used to compare repeated classification accuracy measurements on the independent experiment and control group samples. Encouraging results with a p-value < 0.05 were recorded and provided evidence to reject the null hypothesis in favour of the alternative hypothesis which states that meta-heuristic search approaches are effective in achieving high accuracy with reduced dimensions depending on the outcome variable under investigation.
first_indexed 2024-12-22T16:57:02Z
format Article
id doaj.art-dca6e7a6bbdf444d8ed0c00cfec719f6
institution Directory Open Access Journal
issn 2322-5211
2322-4444
language English
last_indexed 2024-12-22T16:57:02Z
publishDate 2020-11-01
publisher Shahrood University of Technology
record_format Article
series Journal of Artificial Intelligence and Data Mining
spelling doaj.art-dca6e7a6bbdf444d8ed0c00cfec719f62022-12-21T18:19:25ZengShahrood University of TechnologyJournal of Artificial Intelligence and Data Mining2322-52112322-44442020-11-018447148010.22044/jadm.2020.9403.20761832A Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning ParametersA. Omondi0I.A. Lukandu1G.W. Wanyembi2Faculty of Information Technology, Strathmore University, Nairobi, Kenya.Faculty of Information Technology, Strathmore University, Nairobi, Kenya.Department of Information Technology, Mount Kenya University, Thika, Kenya.Redundant and irrelevant features in high dimensional data increase the complexity in underlying mathematical models. It is necessary to conduct pre-processing steps that search for the most relevant features in order to reduce the dimensionality of the data. This study made use of a meta-heuristic search approach which uses lightweight random simulations to balance between the exploitation of relevant features and the exploration of features that have the potential to be relevant. In doing so, the study evaluated how effective the manipulation of the search component in feature selection is on achieving high accuracy with reduced dimensions. A control group experimental design was used to observe factual evidence. The context of the experiment was the high dimensional data experienced in performance tuning of complex database systems. The Wilcoxon signed-rank test at .05 level of significance was used to compare repeated classification accuracy measurements on the independent experiment and control group samples. Encouraging results with a p-value < 0.05 were recorded and provided evidence to reject the null hypothesis in favour of the alternative hypothesis which states that meta-heuristic search approaches are effective in achieving high accuracy with reduced dimensions depending on the outcome variable under investigation.http://jad.shahroodut.ac.ir/article_1832_9bee8989299c0484c9ba5bba0735cb17.pdfdimensionality reductionmeta-heuristic searchmonte carloperformance tuningreinforcement learning
spellingShingle A. Omondi
I.A. Lukandu
G.W. Wanyembi
A Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning Parameters
Journal of Artificial Intelligence and Data Mining
dimensionality reduction
meta-heuristic search
monte carlo
performance tuning
reinforcement learning
title A Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning Parameters
title_full A Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning Parameters
title_fullStr A Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning Parameters
title_full_unstemmed A Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning Parameters
title_short A Monte Carlo-Based Search Strategy for Dimensionality Reduction in Performance Tuning Parameters
title_sort monte carlo based search strategy for dimensionality reduction in performance tuning parameters
topic dimensionality reduction
meta-heuristic search
monte carlo
performance tuning
reinforcement learning
url http://jad.shahroodut.ac.ir/article_1832_9bee8989299c0484c9ba5bba0735cb17.pdf
work_keys_str_mv AT aomondi amontecarlobasedsearchstrategyfordimensionalityreductioninperformancetuningparameters
AT ialukandu amontecarlobasedsearchstrategyfordimensionalityreductioninperformancetuningparameters
AT gwwanyembi amontecarlobasedsearchstrategyfordimensionalityreductioninperformancetuningparameters
AT aomondi montecarlobasedsearchstrategyfordimensionalityreductioninperformancetuningparameters
AT ialukandu montecarlobasedsearchstrategyfordimensionalityreductioninperformancetuningparameters
AT gwwanyembi montecarlobasedsearchstrategyfordimensionalityreductioninperformancetuningparameters