Backfilling the Grid with Containerized BOINC in the ATLAS computing
Virtualization is a commonly used solution for utilizing the opportunistic computing resources in the HEP field, as it provides a unified software and OS layer that the HEP computing tasks require over the heterogeneous opportunistic computing resources. However there is always performance penalty w...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2019-01-01
|
| Series: | EPJ Web of Conferences |
| Online Access: | https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_07015.pdf |
| _version_ | 1831546043628519424 |
|---|---|
| author | Wu Wenjing Cameron David |
| author_facet | Wu Wenjing Cameron David |
| author_sort | Wu Wenjing |
| collection | DOAJ |
| description | Virtualization is a commonly used solution for utilizing the opportunistic computing resources in the HEP field, as it provides a unified software and OS layer that the HEP computing tasks require over the heterogeneous opportunistic computing resources. However there is always performance penalty with virtualization, especially for short jobs which are always the case for volunteer computing tasks, the overhead of virtualization reduces the CPU efficiency of the jobs, hence it leads to low CPU efficiency of the jobs. With the wide usage of containers in HEP computing, we explore the possibility of adopting the container technology into the ATLAS BOINC project, hence we implemented a Native version in BOINC, which uses the Singularity container or direct usage of the Operating System of the host machines to replace VirtualBox. In this paper, we will discuss 1) the implementation and workflow of the Native version in the ATLAS BOINC; 2) the performance measurement of the Native version comparing to the previous virtualization version. 3) the limits and shortcomings of the Native version; 4) The practice and outcome of the Native version which includes using it in backfilling the ATLAS Grid Tier2 sites and other clusters, and to utilize the idle computers from the CERN computing centre. |
| first_indexed | 2024-12-17T01:37:39Z |
| format | Article |
| id | doaj.art-6c4ed3b40e4d400987e50743fa30ab50 |
| institution | Directory Open Access Journal |
| issn | 2100-014X |
| language | English |
| last_indexed | 2024-12-17T01:37:39Z |
| publishDate | 2019-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | EPJ Web of Conferences |
| spelling | doaj.art-6c4ed3b40e4d400987e50743fa30ab502022-12-21T22:08:24ZengEDP SciencesEPJ Web of Conferences2100-014X2019-01-012140701510.1051/epjconf/201921407015epjconf_chep2018_07015Backfilling the Grid with Containerized BOINC in the ATLAS computingWu WenjingCameron DavidVirtualization is a commonly used solution for utilizing the opportunistic computing resources in the HEP field, as it provides a unified software and OS layer that the HEP computing tasks require over the heterogeneous opportunistic computing resources. However there is always performance penalty with virtualization, especially for short jobs which are always the case for volunteer computing tasks, the overhead of virtualization reduces the CPU efficiency of the jobs, hence it leads to low CPU efficiency of the jobs. With the wide usage of containers in HEP computing, we explore the possibility of adopting the container technology into the ATLAS BOINC project, hence we implemented a Native version in BOINC, which uses the Singularity container or direct usage of the Operating System of the host machines to replace VirtualBox. In this paper, we will discuss 1) the implementation and workflow of the Native version in the ATLAS BOINC; 2) the performance measurement of the Native version comparing to the previous virtualization version. 3) the limits and shortcomings of the Native version; 4) The practice and outcome of the Native version which includes using it in backfilling the ATLAS Grid Tier2 sites and other clusters, and to utilize the idle computers from the CERN computing centre.https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_07015.pdf |
| spellingShingle | Wu Wenjing Cameron David Backfilling the Grid with Containerized BOINC in the ATLAS computing EPJ Web of Conferences |
| title | Backfilling the Grid with Containerized BOINC in the ATLAS computing |
| title_full | Backfilling the Grid with Containerized BOINC in the ATLAS computing |
| title_fullStr | Backfilling the Grid with Containerized BOINC in the ATLAS computing |
| title_full_unstemmed | Backfilling the Grid with Containerized BOINC in the ATLAS computing |
| title_short | Backfilling the Grid with Containerized BOINC in the ATLAS computing |
| title_sort | backfilling the grid with containerized boinc in the atlas computing |
| url | https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_07015.pdf |
| work_keys_str_mv | AT wuwenjing backfillingthegridwithcontainerizedboincintheatlascomputing AT camerondavid backfillingthegridwithcontainerizedboincintheatlascomputing |