Towards bespoke optimizations of energy efficiency in HPC environments

Abstract We present bespoke energy efficiency optimizations in high performance computing (HPC) environments using holistic approach to data collection, analysis and proactive management of resources and workloads. Our solution has three major components: (i) platform for collecting, storing and pro...

Full description

Bibliographic Details
Main Authors: Robert Tracey, Vadim Elisseev, Michalis Smyrnakis, Lan Hoang, Mark Fellows, Michael Ackers, Andrew Laughton, Stephen Hill, Phillip Folkes, John Whittle
Format: Article
Language:English
Published: Wiley 2023-12-01
Series:Applied AI Letters
Subjects:
Online Access:https://doi.org/10.1002/ail2.87
Description
Summary:Abstract We present bespoke energy efficiency optimizations in high performance computing (HPC) environments using holistic approach to data collection, analysis and proactive management of resources and workloads. Our solution has three major components: (i) platform for collecting, storing and processing data from multiple sources across hardware and software stacks, (ii) collections of regression machine learning (ML) algorithms for making workloads classifications and energy usage predictions, (iii) agent‐based decision‐making framework for delivering control decisions to middle‐ware and infrastructure thus supporting real time or near real energy efficiency optimizations. We will provide some concrete examples of using our proposed approach in HPC environment.
ISSN:2689-5595