Factory Monitoring for the 21st Century

A key aspect of pilot-based grid operations are the GlideinWMS pilot factories. A proper and efficient use of any central block in the grid infrastructure for operations is inevitable, and GlideinWMS factories are no exception. The monitoring package for the GlideinWMS factory was originally develop...

Full description

Bibliographic Details
Main Authors: Dost Jeffrey, Fajardo Edgar, Bockelman Brian, Hernández-Cano Leonardo, Hung Caitlin, Kashyap Naveen, Würthwein Frank, Zvada Marian
Format: Article
Language:English
Published: EDP Sciences 2019-01-01
Series:EPJ Web of Conferences
Online Access:https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_03038.pdf
_version_ 1818656105388048384
author Dost Jeffrey
Fajardo Edgar
Bockelman Brian
Hernández-Cano Leonardo
Hung Caitlin
Kashyap Naveen
Würthwein Frank
Zvada Marian
author_facet Dost Jeffrey
Fajardo Edgar
Bockelman Brian
Hernández-Cano Leonardo
Hung Caitlin
Kashyap Naveen
Würthwein Frank
Zvada Marian
author_sort Dost Jeffrey
collection DOAJ
description A key aspect of pilot-based grid operations are the GlideinWMS pilot factories. A proper and efficient use of any central block in the grid infrastructure for operations is inevitable, and GlideinWMS factories are no exception. The monitoring package for the GlideinWMS factory was originally developed when the factories were serving a couple of VOs and tens of sites. Today with the factories serving tens of VOs and hundreds of sites around the globe an update of the monitoring is due. Moreover with the new availability of industry open source storage and graphing packages an opportunity remains open.This work presents the changes made to the factory monitoring to leverage different technologies: Elasticsearch, RabbitMQ, Grafana, and InfluxDB to provide a centralized view of the status and work of several GlideinWMS factories located in different continents around the globe.
first_indexed 2024-12-17T03:20:18Z
format Article
id doaj.art-6260714bf8254196b20e91ac5cb732b3
institution Directory Open Access Journal
issn 2100-014X
language English
last_indexed 2024-12-17T03:20:18Z
publishDate 2019-01-01
publisher EDP Sciences
record_format Article
series EPJ Web of Conferences
spelling doaj.art-6260714bf8254196b20e91ac5cb732b32022-12-21T22:05:32ZengEDP SciencesEPJ Web of Conferences2100-014X2019-01-012140303810.1051/epjconf/201921403038epjconf_chep2018_03038Factory Monitoring for the 21st CenturyDost JeffreyFajardo EdgarBockelman BrianHernández-Cano LeonardoHung CaitlinKashyap NaveenWürthwein FrankZvada MarianA key aspect of pilot-based grid operations are the GlideinWMS pilot factories. A proper and efficient use of any central block in the grid infrastructure for operations is inevitable, and GlideinWMS factories are no exception. The monitoring package for the GlideinWMS factory was originally developed when the factories were serving a couple of VOs and tens of sites. Today with the factories serving tens of VOs and hundreds of sites around the globe an update of the monitoring is due. Moreover with the new availability of industry open source storage and graphing packages an opportunity remains open.This work presents the changes made to the factory monitoring to leverage different technologies: Elasticsearch, RabbitMQ, Grafana, and InfluxDB to provide a centralized view of the status and work of several GlideinWMS factories located in different continents around the globe.https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_03038.pdf
spellingShingle Dost Jeffrey
Fajardo Edgar
Bockelman Brian
Hernández-Cano Leonardo
Hung Caitlin
Kashyap Naveen
Würthwein Frank
Zvada Marian
Factory Monitoring for the 21st Century
EPJ Web of Conferences
title Factory Monitoring for the 21st Century
title_full Factory Monitoring for the 21st Century
title_fullStr Factory Monitoring for the 21st Century
title_full_unstemmed Factory Monitoring for the 21st Century
title_short Factory Monitoring for the 21st Century
title_sort factory monitoring for the 21st century
url https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_03038.pdf
work_keys_str_mv AT dostjeffrey factorymonitoringforthe21stcentury
AT fajardoedgar factorymonitoringforthe21stcentury
AT bockelmanbrian factorymonitoringforthe21stcentury
AT hernandezcanoleonardo factorymonitoringforthe21stcentury
AT hungcaitlin factorymonitoringforthe21stcentury
AT kashyapnaveen factorymonitoringforthe21stcentury
AT wurthweinfrank factorymonitoringforthe21stcentury
AT zvadamarian factorymonitoringforthe21stcentury