The ATLAS Eventindex using the HBase/Phoenix storage solution
The ATLAS EventIndex provides a global event catalogue and event-level metadata for ATLAS analysis groups and users. The LHC Run 3, starting in 2022, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its lim...
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Conference item |
| Language: | English |
| Published: |
CEUR Workshop Proceedings
2021
|
| _version_ | 1797111722098556928 |
|---|---|
| author | Cherepanova, E Alexandrov, E Alexandrov, I Barberis, D Canali, L Casani, AF Gallas, E Montoro, CG de la Hoz, SG Hrivnac, J Kazymov, A Mineev, M Prokoshin, F Rybkin, G Sanchez, J Cairols, JS Perez, MV Yakovlev, A |
| author_facet | Cherepanova, E Alexandrov, E Alexandrov, I Barberis, D Canali, L Casani, AF Gallas, E Montoro, CG de la Hoz, SG Hrivnac, J Kazymov, A Mineev, M Prokoshin, F Rybkin, G Sanchez, J Cairols, JS Perez, MV Yakovlev, A |
| author_sort | Cherepanova, E |
| collection | OXFORD |
| description | The ATLAS EventIndex provides a global event catalogue and event-level metadata for ATLAS analysis groups and users. The LHC Run 3, starting in 2022, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, which allows the re-use of most of the existing code for metadata integration. |
| first_indexed | 2024-03-07T08:14:17Z |
| format | Conference item |
| id | oxford-uuid:92e7a63d-1984-4a44-87a7-f22ea4a3a49a |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T08:14:17Z |
| publishDate | 2021 |
| publisher | CEUR Workshop Proceedings |
| record_format | dspace |
| spelling | oxford-uuid:92e7a63d-1984-4a44-87a7-f22ea4a3a49a2023-12-14T10:40:22ZThe ATLAS Eventindex using the HBase/Phoenix storage solutionConference itemhttp://purl.org/coar/resource_type/c_5794uuid:92e7a63d-1984-4a44-87a7-f22ea4a3a49aEnglishSymplectic ElementsCEUR Workshop Proceedings2021Cherepanova, EAlexandrov, EAlexandrov, IBarberis, DCanali, LCasani, AFGallas, EMontoro, CGde la Hoz, SGHrivnac, JKazymov, AMineev, MProkoshin, FRybkin, GSanchez, JCairols, JSPerez, MVYakovlev, AThe ATLAS EventIndex provides a global event catalogue and event-level metadata for ATLAS analysis groups and users. The LHC Run 3, starting in 2022, will see increased data-taking and simulation production rates, with which the current infrastructure would still cope but may be stretched to its limits by the end of Run 3. This talk describes the implementation of a new core storage service that will provide at least the same functionality as the current one for increased data ingestion and search rates, and with increasing volumes of stored data. It is based on a set of HBase tables, coupled to Apache Phoenix for data access; in this way we will add to the advantages of a BigData based storage system the possibility of SQL as well as NoSQL data access, which allows the re-use of most of the existing code for metadata integration. |
| spellingShingle | Cherepanova, E Alexandrov, E Alexandrov, I Barberis, D Canali, L Casani, AF Gallas, E Montoro, CG de la Hoz, SG Hrivnac, J Kazymov, A Mineev, M Prokoshin, F Rybkin, G Sanchez, J Cairols, JS Perez, MV Yakovlev, A The ATLAS Eventindex using the HBase/Phoenix storage solution |
| title | The ATLAS Eventindex using the HBase/Phoenix storage solution |
| title_full | The ATLAS Eventindex using the HBase/Phoenix storage solution |
| title_fullStr | The ATLAS Eventindex using the HBase/Phoenix storage solution |
| title_full_unstemmed | The ATLAS Eventindex using the HBase/Phoenix storage solution |
| title_short | The ATLAS Eventindex using the HBase/Phoenix storage solution |
| title_sort | atlas eventindex using the hbase phoenix storage solution |
| work_keys_str_mv | AT cherepanovae theatlaseventindexusingthehbasephoenixstoragesolution AT alexandrove theatlaseventindexusingthehbasephoenixstoragesolution AT alexandrovi theatlaseventindexusingthehbasephoenixstoragesolution AT barberisd theatlaseventindexusingthehbasephoenixstoragesolution AT canalil theatlaseventindexusingthehbasephoenixstoragesolution AT casaniaf theatlaseventindexusingthehbasephoenixstoragesolution AT gallase theatlaseventindexusingthehbasephoenixstoragesolution AT montorocg theatlaseventindexusingthehbasephoenixstoragesolution AT delahozsg theatlaseventindexusingthehbasephoenixstoragesolution AT hrivnacj theatlaseventindexusingthehbasephoenixstoragesolution AT kazymova theatlaseventindexusingthehbasephoenixstoragesolution AT mineevm theatlaseventindexusingthehbasephoenixstoragesolution AT prokoshinf theatlaseventindexusingthehbasephoenixstoragesolution AT rybking theatlaseventindexusingthehbasephoenixstoragesolution AT sanchezj theatlaseventindexusingthehbasephoenixstoragesolution AT cairolsjs theatlaseventindexusingthehbasephoenixstoragesolution AT perezmv theatlaseventindexusingthehbasephoenixstoragesolution AT yakovleva theatlaseventindexusingthehbasephoenixstoragesolution AT cherepanovae atlaseventindexusingthehbasephoenixstoragesolution AT alexandrove atlaseventindexusingthehbasephoenixstoragesolution AT alexandrovi atlaseventindexusingthehbasephoenixstoragesolution AT barberisd atlaseventindexusingthehbasephoenixstoragesolution AT canalil atlaseventindexusingthehbasephoenixstoragesolution AT casaniaf atlaseventindexusingthehbasephoenixstoragesolution AT gallase atlaseventindexusingthehbasephoenixstoragesolution AT montorocg atlaseventindexusingthehbasephoenixstoragesolution AT delahozsg atlaseventindexusingthehbasephoenixstoragesolution AT hrivnacj atlaseventindexusingthehbasephoenixstoragesolution AT kazymova atlaseventindexusingthehbasephoenixstoragesolution AT mineevm atlaseventindexusingthehbasephoenixstoragesolution AT prokoshinf atlaseventindexusingthehbasephoenixstoragesolution AT rybking atlaseventindexusingthehbasephoenixstoragesolution AT sanchezj atlaseventindexusingthehbasephoenixstoragesolution AT cairolsjs atlaseventindexusingthehbasephoenixstoragesolution AT perezmv atlaseventindexusingthehbasephoenixstoragesolution AT yakovleva atlaseventindexusingthehbasephoenixstoragesolution |