Characterization of MPI communication primitives on a heterogeneous cluster / Siti Arpah Ahmad ... [et al.]

This paper focuses on the performance of basic communication primitives, namely the overlap of message transfer with computation in the point-to-point communication within a small cluster of four nodes. The mpptest has been implemented to measure the basic performance of MPI message passing routine...

Full description

Bibliographic Details
Main Authors: Ahmad, Siti Arpah, Mohamed Said, Mohamed Faidz, Mohamed Ramli, Norazan, Taib, Mohd Nasir
Format: Article
Language:English
Published: Research Management Institute (RMI) 2009
Subjects:
Online Access:https://ir.uitm.edu.my/id/eprint/12924/1/AJ_SITI%20ARPAH%20AHMAD%20SRJ%2009%201.pdf
Description
Summary:This paper focuses on the performance of basic communication primitives, namely the overlap of message transfer with computation in the point-to-point communication within a small cluster of four nodes. The mpptest has been implemented to measure the basic performance of MPI message passing routines with a variety of message sizes. The mpptest is capable of measuring performance with many participating processes thus exposing contention and scalability problems. This enables programmers to select message sizes in order to isolate and evaluate sudden changes in performance. Investigating these matters is interesting in that non-blocking calls have the advantage of allowing the system to schedule communications even when many processes are running simultaneously. On the other hand, understanding the characteristics of computation and communication overlap is significant, because high performance kernels often strive to achieve this, since it is both advantageous with respect to data transfer and latency hiding. The results indicate that certain overlap sizes utilize greater node processing power either in blocking send and receive operations or non-blocking send and receive operations. The results have elucidated a detailed MPI characterization of the performance regarding the overlap of message transfer with computation in a small cluster system.