The first disk-based custodial storage for the ALICE experiment
We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2021-01-01
|
| Series: | EPJ Web of Conferences |
| Online Access: | https://www.epj-conferences.org/articles/epjconf/pdf/2021/05/epjconf_chep2021_02051.pdf |
| _version_ | 1818572003987161088 |
|---|---|
| author | Ahn Sang Un Kim Jeongheon Han Heejune Lee Seung Hee Yoon Heejun |
| author_facet | Ahn Sang Un Kim Jeongheon Han Heejune Lee Seung Hee Yoon Heejun |
| author_sort | Ahn Sang Un |
| collection | DOAJ |
| description | We proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed by CERN – for data protection and takes full advantage of high-density Just-Bunch-Of-Disks (JBOD) enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to 33:3% with this layout, the estimated annual data loss rate drops down to 8:6 × 10−5%. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail. |
| first_indexed | 2024-12-14T18:51:39Z |
| format | Article |
| id | doaj.art-3d24a269b39548d383c9e7c02ae9390a |
| institution | Directory Open Access Journal |
| issn | 2100-014X |
| language | English |
| last_indexed | 2024-12-14T18:51:39Z |
| publishDate | 2021-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | EPJ Web of Conferences |
| spelling | doaj.art-3d24a269b39548d383c9e7c02ae9390a2022-12-21T22:51:13ZengEDP SciencesEPJ Web of Conferences2100-014X2021-01-012510205110.1051/epjconf/202125102051epjconf_chep2021_02051The first disk-based custodial storage for the ALICE experimentAhn Sang Un0Kim Jeongheon1Han Heejune2Lee Seung Hee3Yoon Heejun4KISTI, GSDCKISTI, GSDCKISTI, GSDCKISTI, GSDCKISTI, GSDCWe proposed a disk-based custodial storage as an alternative to tape for the ALICE experiment at CERN to preserve its raw data. The proposed storage system relies on Redundant Array of Independent Nodes (RAIN) layout – the implementation of erasure coding in the EOS storage suite, which is developed by CERN – for data protection and takes full advantage of high-density Just-Bunch-Of-Disks (JBOD) enclosures to maximize storage capacity as well as to achieve cost-effectiveness comparable to tape. The system we present provides 18 PB of total raw capacity from the 18 set of high-density JBOD enclosures attached to 9 EOS front-end servers. In order to balance between usable space and data protection, the system will stripe a file into 16 chunks on the 4-parity enabled RAIN layout configured on top of 18 containerized EOS FSTs. Although the reduction rate of available space increases up to 33:3% with this layout, the estimated annual data loss rate drops down to 8:6 × 10−5%. In this paper, we discuss the system architecture of the disk-based custodial storage, 4-parity RAIN layout, deployment automation, and the integration to the ALICE experiment in detail.https://www.epj-conferences.org/articles/epjconf/pdf/2021/05/epjconf_chep2021_02051.pdf |
| spellingShingle | Ahn Sang Un Kim Jeongheon Han Heejune Lee Seung Hee Yoon Heejun The first disk-based custodial storage for the ALICE experiment EPJ Web of Conferences |
| title | The first disk-based custodial storage for the ALICE experiment |
| title_full | The first disk-based custodial storage for the ALICE experiment |
| title_fullStr | The first disk-based custodial storage for the ALICE experiment |
| title_full_unstemmed | The first disk-based custodial storage for the ALICE experiment |
| title_short | The first disk-based custodial storage for the ALICE experiment |
| title_sort | first disk based custodial storage for the alice experiment |
| url | https://www.epj-conferences.org/articles/epjconf/pdf/2021/05/epjconf_chep2021_02051.pdf |
| work_keys_str_mv | AT ahnsangun thefirstdiskbasedcustodialstorageforthealiceexperiment AT kimjeongheon thefirstdiskbasedcustodialstorageforthealiceexperiment AT hanheejune thefirstdiskbasedcustodialstorageforthealiceexperiment AT leeseunghee thefirstdiskbasedcustodialstorageforthealiceexperiment AT yoonheejun thefirstdiskbasedcustodialstorageforthealiceexperiment AT ahnsangun firstdiskbasedcustodialstorageforthealiceexperiment AT kimjeongheon firstdiskbasedcustodialstorageforthealiceexperiment AT hanheejune firstdiskbasedcustodialstorageforthealiceexperiment AT leeseunghee firstdiskbasedcustodialstorageforthealiceexperiment AT yoonheejun firstdiskbasedcustodialstorageforthealiceexperiment |