Progress in Parallel Algorithms

Parallel computing offers the promise of increased performance over sequential computing, and parallel algorithms are one of its key components. There has been no aggregated or generalized comparative analysis of parallel algorithms. In this thesis, we investigate this field as a whole. We aim to un...

Full description

Bibliographic Details
Main Author: Tontici, Damian
Other Authors: Lynch, Jayson
Format: Thesis
Published: Massachusetts Institute of Technology 2024
Online Access:https://hdl.handle.net/1721.1/153852
_version_ 1826200104775712768
author Tontici, Damian
author2 Lynch, Jayson
author_facet Lynch, Jayson
Tontici, Damian
author_sort Tontici, Damian
collection MIT
description Parallel computing offers the promise of increased performance over sequential computing, and parallel algorithms are one of its key components. There has been no aggregated or generalized comparative analysis of parallel algorithms. In this thesis, we investigate this field as a whole. We aim to understand the trends in algorithmic progress, improvement patterns, and the importance and interactions of various commonly used metrics. We collect parallel algorithms solving problems in our set and analyze them. We look at four major themes: how parallel algorithms have progressed, including in relationship to sequential algorithms and parallel hardware; how the work and span of algorithms influence performance; how problem size and available parallelism affect performance; and what researchers’ observable priorities look like. We find that more problems have had parallel improvements than sequential ones since the ’80s, that most parallel algorithms don’t improve algorithmic complexities, and much more. This research is important for us to understand how the field of parallel algorithms has changed throughout time, and what it looks like now.
first_indexed 2024-09-23T11:31:15Z
format Thesis
id mit-1721.1/153852
institution Massachusetts Institute of Technology
last_indexed 2024-09-23T11:31:15Z
publishDate 2024
publisher Massachusetts Institute of Technology
record_format dspace
spelling mit-1721.1/1538522024-03-22T03:44:41Z Progress in Parallel Algorithms Tontici, Damian Lynch, Jayson Thompson, Neil Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Parallel computing offers the promise of increased performance over sequential computing, and parallel algorithms are one of its key components. There has been no aggregated or generalized comparative analysis of parallel algorithms. In this thesis, we investigate this field as a whole. We aim to understand the trends in algorithmic progress, improvement patterns, and the importance and interactions of various commonly used metrics. We collect parallel algorithms solving problems in our set and analyze them. We look at four major themes: how parallel algorithms have progressed, including in relationship to sequential algorithms and parallel hardware; how the work and span of algorithms influence performance; how problem size and available parallelism affect performance; and what researchers’ observable priorities look like. We find that more problems have had parallel improvements than sequential ones since the ’80s, that most parallel algorithms don’t improve algorithmic complexities, and much more. This research is important for us to understand how the field of parallel algorithms has changed throughout time, and what it looks like now. M.Eng. 2024-03-21T19:10:43Z 2024-03-21T19:10:43Z 2024-02 2024-03-04T16:37:41.208Z Thesis https://hdl.handle.net/1721.1/153852 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology
spellingShingle Tontici, Damian
Progress in Parallel Algorithms
title Progress in Parallel Algorithms
title_full Progress in Parallel Algorithms
title_fullStr Progress in Parallel Algorithms
title_full_unstemmed Progress in Parallel Algorithms
title_short Progress in Parallel Algorithms
title_sort progress in parallel algorithms
url https://hdl.handle.net/1721.1/153852
work_keys_str_mv AT tonticidamian progressinparallelalgorithms