Scheduling Spark Tasks With Data Skew and Deadline Constraints

Scheduling Spark Tasks With Data Skew and Deadline Constraints

Data skew has an essential impact on the performance of big data processing. Spark task scheduling with data skew and deadline constraints is considered to minimize the total rental cost in this paper. A modified scheduling architecture is developed in terms of the unique characteristics of the cons...

Full description

Bibliographic Details
Main Authors: Haihua Gu, Xiaoping Li, Zhipeng Lu
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Data skew
spark
scheduling optimization
cloud computing
Online Access:https://ieeexplore.ieee.org/document/9272293/

Similar Items

Similar Items