IceCube File Catalog

IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate fil...

Full description

Bibliographic Details
Main Authors: Brik Vladimir, Meade Patrick, Merino Gonzalo, Oertlin Jan, Schultz David, Skarlupka Heath
Format: Article
Language:English
Published: EDP Sciences 2019-01-01
Series:EPJ Web of Conferences
Online Access:https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf
_version_ 1818740162881912832
author Brik Vladimir
Meade Patrick
Merino Gonzalo
Oertlin Jan
Schultz David
Skarlupka Heath
author_facet Brik Vladimir
Meade Patrick
Merino Gonzalo
Oertlin Jan
Schultz David
Skarlupka Heath
author_sort Brik Vladimir
collection DOAJ
description IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate files. Recently effort has been put into creating a unified view in a central metadata catalog. Going for a simple solution, we created a userfacing REST API backed by a NoSQL database. All major data producers add their metadata to this central catalog. Schema generation is identified as an important aspect of multi-application metadata services.
first_indexed 2024-12-18T01:36:21Z
format Article
id doaj.art-4673fa2aa7514411832992ff68951b4c
institution Directory Open Access Journal
issn 2100-014X
language English
last_indexed 2024-12-18T01:36:21Z
publishDate 2019-01-01
publisher EDP Sciences
record_format Article
series EPJ Web of Conferences
spelling doaj.art-4673fa2aa7514411832992ff68951b4c2022-12-21T21:25:26ZengEDP SciencesEPJ Web of Conferences2100-014X2019-01-012140405510.1051/epjconf/201921404055epjconf_chep2018_04055IceCube File CatalogBrik VladimirMeade PatrickMerino GonzaloOertlin JanSchultz DavidSkarlupka HeathIceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate files. Recently effort has been put into creating a unified view in a central metadata catalog. Going for a simple solution, we created a userfacing REST API backed by a NoSQL database. All major data producers add their metadata to this central catalog. Schema generation is identified as an important aspect of multi-application metadata services.https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf
spellingShingle Brik Vladimir
Meade Patrick
Merino Gonzalo
Oertlin Jan
Schultz David
Skarlupka Heath
IceCube File Catalog
EPJ Web of Conferences
title IceCube File Catalog
title_full IceCube File Catalog
title_fullStr IceCube File Catalog
title_full_unstemmed IceCube File Catalog
title_short IceCube File Catalog
title_sort icecube file catalog
url https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf
work_keys_str_mv AT brikvladimir icecubefilecatalog
AT meadepatrick icecubefilecatalog
AT merinogonzalo icecubefilecatalog
AT oertlinjan icecubefilecatalog
AT schultzdavid icecubefilecatalog
AT skarlupkaheath icecubefilecatalog