Performance Assessment of Using Docker for Selected MPI Applications in a Parallel Environment Based on Commodity Hardware

In the paper, we perform detailed performance analysis of three parallel MPI applications run in a parallel environment based on commodity hardware, using Docker and bare-metal configurations. The testbed applications are representative of the most typical parallel processing paradigms: master–slave...

Full description

Bibliographic Details
Main Authors: Tomasz Kononowicz, Paweł Czarnul
Format: Article
Language:English
Published: MDPI AG 2022-08-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/12/16/8305
_version_ 1797432521286221824
author Tomasz Kononowicz
Paweł Czarnul
author_facet Tomasz Kononowicz
Paweł Czarnul
author_sort Tomasz Kononowicz
collection DOAJ
description In the paper, we perform detailed performance analysis of three parallel MPI applications run in a parallel environment based on commodity hardware, using Docker and bare-metal configurations. The testbed applications are representative of the most typical parallel processing paradigms: master–slave, geometric Single Program Multiple Data (SPMD) as well as divide-and-conquer and feature characteristic computational and communication schemes. We perform analysis selecting best configurations considering various optimization flags for the applications and best execution times and speed-ups in terms of the number of nodes and overhead of the virtualized environment. We have concluded that for the configurations giving the shortest execution times the overheads of Docker versus bare-metal for the applications are as follows: 7.59% for master–slave run using 64 processes (number of physical cores), 15.30% for geometric SPMD run using 128 processes (number of logical cores) and 13.29% for divide-and-conquer run using 256 processes. Finally, we compare results obtained using gcc V9 and V7 compiler versions.
first_indexed 2024-03-09T10:01:49Z
format Article
id doaj.art-ae8bcf5bb00a4ef0b87ed95b569c39c0
institution Directory Open Access Journal
issn 2076-3417
language English
last_indexed 2024-03-09T10:01:49Z
publishDate 2022-08-01
publisher MDPI AG
record_format Article
series Applied Sciences
spelling doaj.art-ae8bcf5bb00a4ef0b87ed95b569c39c02023-12-01T23:22:31ZengMDPI AGApplied Sciences2076-34172022-08-011216830510.3390/app12168305Performance Assessment of Using Docker for Selected MPI Applications in a Parallel Environment Based on Commodity HardwareTomasz Kononowicz0Paweł Czarnul1Faculty of Electronics, Telecommunications and Informatics, Gdańsk University of Technology, 11/12 Narutowicza, 80-233 Gdańsk, PolandFaculty of Electronics, Telecommunications and Informatics, Gdańsk University of Technology, 11/12 Narutowicza, 80-233 Gdańsk, PolandIn the paper, we perform detailed performance analysis of three parallel MPI applications run in a parallel environment based on commodity hardware, using Docker and bare-metal configurations. The testbed applications are representative of the most typical parallel processing paradigms: master–slave, geometric Single Program Multiple Data (SPMD) as well as divide-and-conquer and feature characteristic computational and communication schemes. We perform analysis selecting best configurations considering various optimization flags for the applications and best execution times and speed-ups in terms of the number of nodes and overhead of the virtualized environment. We have concluded that for the configurations giving the shortest execution times the overheads of Docker versus bare-metal for the applications are as follows: 7.59% for master–slave run using 64 processes (number of physical cores), 15.30% for geometric SPMD run using 128 processes (number of logical cores) and 13.29% for divide-and-conquer run using 256 processes. Finally, we compare results obtained using gcc V9 and V7 compiler versions.https://www.mdpi.com/2076-3417/12/16/8305high performance computingparallelizationvirtualizationDockeroverhead evaluation
spellingShingle Tomasz Kononowicz
Paweł Czarnul
Performance Assessment of Using Docker for Selected MPI Applications in a Parallel Environment Based on Commodity Hardware
Applied Sciences
high performance computing
parallelization
virtualization
Docker
overhead evaluation
title Performance Assessment of Using Docker for Selected MPI Applications in a Parallel Environment Based on Commodity Hardware
title_full Performance Assessment of Using Docker for Selected MPI Applications in a Parallel Environment Based on Commodity Hardware
title_fullStr Performance Assessment of Using Docker for Selected MPI Applications in a Parallel Environment Based on Commodity Hardware
title_full_unstemmed Performance Assessment of Using Docker for Selected MPI Applications in a Parallel Environment Based on Commodity Hardware
title_short Performance Assessment of Using Docker for Selected MPI Applications in a Parallel Environment Based on Commodity Hardware
title_sort performance assessment of using docker for selected mpi applications in a parallel environment based on commodity hardware
topic high performance computing
parallelization
virtualization
Docker
overhead evaluation
url https://www.mdpi.com/2076-3417/12/16/8305
work_keys_str_mv AT tomaszkononowicz performanceassessmentofusingdockerforselectedmpiapplicationsinaparallelenvironmentbasedoncommodityhardware
AT pawełczarnul performanceassessmentofusingdockerforselectedmpiapplicationsinaparallelenvironmentbasedoncommodityhardware