Performance Evaluation of ARM-based versus x86- based Processors in High Performance Computing Clusters

With an increasing need for enormous amount of computing power, different approaches for building inexpensive supercomputers have emerged. Decreasing costs and continuous technology scaling has led to the emergence of computers with ARM processors which are considered as a possible alternative to tr...

Full description

Bibliographic Details
Main Authors: Dileep Kumar, Pardeep Kumar, Muhammad Awais Rajput, Saleem Ahmed, Muhammad Saqib Bhatti, Anthony Tsetse
Format: Article
Language:English
Published: Shaheed Zulfikar Ali Bhutto Institute of Science and Technology 2023-12-01
Series:JISR on Computing
Subjects:
Online Access:https://jisrc.szabist.edu.pk/ojs/index.php/jisrc/article/view/58
_version_ 1797271663722627072
author Dileep Kumar
Pardeep Kumar
Muhammad Awais Rajput
Saleem Ahmed
Muhammad Saqib Bhatti
Anthony Tsetse
author_facet Dileep Kumar
Pardeep Kumar
Muhammad Awais Rajput
Saleem Ahmed
Muhammad Saqib Bhatti
Anthony Tsetse
author_sort Dileep Kumar
collection DOAJ
description With an increasing need for enormous amount of computing power, different approaches for building inexpensive supercomputers have emerged. Decreasing costs and continuous technology scaling has led to the emergence of computers with ARM processors which are considered as a possible alternative to traditional x86 processors for creating High Performance Computing (HPC) systems. The aim of this research is to carry out a detailed performance evaluation of a cluster of ARM-based computers against a comparable low-cost cluster of x86-based computers and investigates whether these ARM processors are capable to substitute x86 processors for creating HPC clusters. Our methodology is based on experimental evaluation by setting up two cluster architectures. To compare the performances of both clusters, two complex applications were implemented: approximation of mathematical constant PI (3.14), a matrix multiplication program. Our analysis focused on execution time and speedup as performance metrics. From the results we observed that maximum performance achieved by both clusters is when the number of MPI processes are equal to the number of processing nodes on the cluster thereby allowing a one-to-one mapping of the tasks with minimal overhead. If we compare the maximum performances of both clusters in terms of execution time, the x86-Cluster performed 1.16× and 2.42× faster than the ARM-Cluster for pi_calculation and matrix_mul benchmarks. However, we noted that the ARM-based cluster exhibited superior speedup compared to the x86-based cluster, potentially attributed to the greater number of cores per node used in the ARM cluster. From the comparative performance evaluation, we conclude that ARM processors substantially lag behind x86 processors not only because of their limited resources but due to major difference between their instruction sets and architecture especially when it comes to memory-bound operations. This research underscores the challenges and opportunities associated with ARM processors in the context of HPC clusters, offering valuable insights to the scientific community looking for cost-effective computing solutions.
first_indexed 2024-03-07T14:09:41Z
format Article
id doaj.art-56ff15dce9994486920dee459b90515c
institution Directory Open Access Journal
issn 2412-0448
1998-4154
language English
last_indexed 2024-03-07T14:09:41Z
publishDate 2023-12-01
publisher Shaheed Zulfikar Ali Bhutto Institute of Science and Technology
record_format Article
series JISR on Computing
spelling doaj.art-56ff15dce9994486920dee459b90515c2024-03-06T16:57:30ZengShaheed Zulfikar Ali Bhutto Institute of Science and TechnologyJISR on Computing2412-04481998-41542023-12-0121210.31645/JISRC.23.21.2.6Performance Evaluation of ARM-based versus x86- based Processors in High Performance Computing ClustersDileep Kumar0Pardeep Kumar1Muhammad Awais Rajput2Saleem Ahmed3Muhammad Saqib Bhatti4Anthony Tsetse5Computer Systems Eng. Department QUEST Nawabshah, PakistanSoftware Engineering Department QUEST Nawabshah, PakistanDepartment of Computer Science Universität Paderborn Paderborn, GermanyInformation Technology (IT) Convergence Research Center, Jeonbuk National University, Jeonju, South KoreaDepartment of Telecommunication Eng. Dawood University of Eng.& Technology, Karachi, PakistanSchool of Computing & Analytics, Northern Kentucky University, Kentucky, USAWith an increasing need for enormous amount of computing power, different approaches for building inexpensive supercomputers have emerged. Decreasing costs and continuous technology scaling has led to the emergence of computers with ARM processors which are considered as a possible alternative to traditional x86 processors for creating High Performance Computing (HPC) systems. The aim of this research is to carry out a detailed performance evaluation of a cluster of ARM-based computers against a comparable low-cost cluster of x86-based computers and investigates whether these ARM processors are capable to substitute x86 processors for creating HPC clusters. Our methodology is based on experimental evaluation by setting up two cluster architectures. To compare the performances of both clusters, two complex applications were implemented: approximation of mathematical constant PI (3.14), a matrix multiplication program. Our analysis focused on execution time and speedup as performance metrics. From the results we observed that maximum performance achieved by both clusters is when the number of MPI processes are equal to the number of processing nodes on the cluster thereby allowing a one-to-one mapping of the tasks with minimal overhead. If we compare the maximum performances of both clusters in terms of execution time, the x86-Cluster performed 1.16× and 2.42× faster than the ARM-Cluster for pi_calculation and matrix_mul benchmarks. However, we noted that the ARM-based cluster exhibited superior speedup compared to the x86-based cluster, potentially attributed to the greater number of cores per node used in the ARM cluster. From the comparative performance evaluation, we conclude that ARM processors substantially lag behind x86 processors not only because of their limited resources but due to major difference between their instruction sets and architecture especially when it comes to memory-bound operations. This research underscores the challenges and opportunities associated with ARM processors in the context of HPC clusters, offering valuable insights to the scientific community looking for cost-effective computing solutions. https://jisrc.szabist.edu.pk/ojs/index.php/jisrc/article/view/58ARMCISCClusterCOTSHPCRISC
spellingShingle Dileep Kumar
Pardeep Kumar
Muhammad Awais Rajput
Saleem Ahmed
Muhammad Saqib Bhatti
Anthony Tsetse
Performance Evaluation of ARM-based versus x86- based Processors in High Performance Computing Clusters
JISR on Computing
ARM
CISC
Cluster
COTS
HPC
RISC
title Performance Evaluation of ARM-based versus x86- based Processors in High Performance Computing Clusters
title_full Performance Evaluation of ARM-based versus x86- based Processors in High Performance Computing Clusters
title_fullStr Performance Evaluation of ARM-based versus x86- based Processors in High Performance Computing Clusters
title_full_unstemmed Performance Evaluation of ARM-based versus x86- based Processors in High Performance Computing Clusters
title_short Performance Evaluation of ARM-based versus x86- based Processors in High Performance Computing Clusters
title_sort performance evaluation of arm based versus x86 based processors in high performance computing clusters
topic ARM
CISC
Cluster
COTS
HPC
RISC
url https://jisrc.szabist.edu.pk/ojs/index.php/jisrc/article/view/58
work_keys_str_mv AT dileepkumar performanceevaluationofarmbasedversusx86basedprocessorsinhighperformancecomputingclusters
AT pardeepkumar performanceevaluationofarmbasedversusx86basedprocessorsinhighperformancecomputingclusters
AT muhammadawaisrajput performanceevaluationofarmbasedversusx86basedprocessorsinhighperformancecomputingclusters
AT saleemahmed performanceevaluationofarmbasedversusx86basedprocessorsinhighperformancecomputingclusters
AT muhammadsaqibbhatti performanceevaluationofarmbasedversusx86basedprocessorsinhighperformancecomputingclusters
AT anthonytsetse performanceevaluationofarmbasedversusx86basedprocessorsinhighperformancecomputingclusters