IceCube File Catalog
IceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate fil...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
EDP Sciences
2019-01-01
|
Series: | EPJ Web of Conferences |
Online Access: | https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf |
_version_ | 1818740162881912832 |
---|---|
author | Brik Vladimir Meade Patrick Merino Gonzalo Oertlin Jan Schultz David Skarlupka Heath |
author_facet | Brik Vladimir Meade Patrick Merino Gonzalo Oertlin Jan Schultz David Skarlupka Heath |
author_sort | Brik Vladimir |
collection | DOAJ |
description | IceCube is a cubic kilometer neutrino detector located at the
south pole. Metadata for files in IceCube have traditionally been handled
on an application by application basis, with no user-facing access. There
has been no unified view of data files, and users often query the filesystem
to locate files. Recently effort has been put into creating a unified view in a
central metadata catalog. Going for a simple solution, we created a userfacing
REST API backed by a NoSQL database. All major data producers
add their metadata to this central catalog. Schema generation is identified
as an important aspect of multi-application metadata services. |
first_indexed | 2024-12-18T01:36:21Z |
format | Article |
id | doaj.art-4673fa2aa7514411832992ff68951b4c |
institution | Directory Open Access Journal |
issn | 2100-014X |
language | English |
last_indexed | 2024-12-18T01:36:21Z |
publishDate | 2019-01-01 |
publisher | EDP Sciences |
record_format | Article |
series | EPJ Web of Conferences |
spelling | doaj.art-4673fa2aa7514411832992ff68951b4c2022-12-21T21:25:26ZengEDP SciencesEPJ Web of Conferences2100-014X2019-01-012140405510.1051/epjconf/201921404055epjconf_chep2018_04055IceCube File CatalogBrik VladimirMeade PatrickMerino GonzaloOertlin JanSchultz DavidSkarlupka HeathIceCube is a cubic kilometer neutrino detector located at the south pole. Metadata for files in IceCube have traditionally been handled on an application by application basis, with no user-facing access. There has been no unified view of data files, and users often query the filesystem to locate files. Recently effort has been put into creating a unified view in a central metadata catalog. Going for a simple solution, we created a userfacing REST API backed by a NoSQL database. All major data producers add their metadata to this central catalog. Schema generation is identified as an important aspect of multi-application metadata services.https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf |
spellingShingle | Brik Vladimir Meade Patrick Merino Gonzalo Oertlin Jan Schultz David Skarlupka Heath IceCube File Catalog EPJ Web of Conferences |
title | IceCube File Catalog |
title_full | IceCube File Catalog |
title_fullStr | IceCube File Catalog |
title_full_unstemmed | IceCube File Catalog |
title_short | IceCube File Catalog |
title_sort | icecube file catalog |
url | https://www.epj-conferences.org/articles/epjconf/pdf/2019/19/epjconf_chep2018_04055.pdf |
work_keys_str_mv | AT brikvladimir icecubefilecatalog AT meadepatrick icecubefilecatalog AT merinogonzalo icecubefilecatalog AT oertlinjan icecubefilecatalog AT schultzdavid icecubefilecatalog AT skarlupkaheath icecubefilecatalog |