Optimization Techniques for a Distributed In-Memory Computing Platform by Leveraging SSD

In this paper, we present several optimization strategies that can improve the overall performance of the distributed in-memory computing system, “Apache Spark”. Despite its distributed memory management capability for iterative jobs and intermediate data, Spark has a significant performance degrada...

Full description

Bibliographic Details
Main Authors: June Choi, Jaehyun Lee, Jik-Soo Kim, Jaehwan Lee
Format: Article
Language:English
Published: MDPI AG 2021-09-01
Series:Applied Sciences
Subjects:
Online Access:https://www.mdpi.com/2076-3417/11/18/8476