SparkSim: A Counterfactual Approach for Spark Cluster Scheduling

Simulating and testing scheduling policies can be immensely time- and resourceintensive. In this work, we explore a novel approach, SparkSim, to scheduling policy training that is faster and more efficient than traditional scheduling policy testing. Our approach is based on an extension of CausalSim...

Full description

Bibliographic Details
Main Author: Rodríguez Garnica, Sol Estrella
Other Authors: Nasr-Esfahany, Arash
Format: Thesis
Published: Massachusetts Institute of Technology 2023
Online Access:https://hdl.handle.net/1721.1/151471