Large Dataset Classification Using Parallel Processing Concept

Much attention has been paid to large data technologies in the past few years mainly due to its capability to impact business analytics and data mining practices, as well as the possibility of influencing an ambit of a highly effective decision-making tools. With the current increase in the number o...

ver descrição completa

Detalhes bibliográficos
Principais autores: Aljanabi, Mohammad, Ebraheem, Hind Ra'ad, Hussain, Zahraa Faiz, Mohd Farhan, Md Fudzee, Shahreen, Kasim, Mohd Arfian, Ismail, Meidelfie, Dwiny, Eriandae, Aldo
Formato: Artigo
Idioma:English
Publicado em: Department of Information Technology - Politeknik Negeri Padang 2020
Assuntos:
Acesso em linha:http://umpir.ump.edu.my/id/eprint/30480/1/Large%20Dataset%20Classification.pdf
Descrição
Resumo:Much attention has been paid to large data technologies in the past few years mainly due to its capability to impact business analytics and data mining practices, as well as the possibility of influencing an ambit of a highly effective decision-making tools. With the current increase in the number of modern applications (including social media and other web-based and healthcare applications) which generates high data in different forms and volume, the processing of such huge data volume is becoming a challenge with the conventional data processing tools. This has resulted in the emergence of big data analytics which also comes with many challenges. This paper introduced the use of principal components analysis (PCA) for data size reduction, followed by SVM parallelization. The proposed scheme in this study was executed on the Spark platform and the experimental findings revealed the capability of the proposed scheme to reduce the classifiers’ classification time without much influence on the classification accuracy of the classifier.