A programmatic view of metadata, metadata services, and metadata flow in ATLAS
The volume and diversity of metadata in an experiment of the size and scope of ATLAS are considerable. Even the definition of metadata may seem context-dependent: data that are primary for one purpose may be metadata for another. ATLAS metadata services must integrate and federate information from i...
| Main Authors: | , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
2012
|
| _version_ | 1797068204095307776 |
|---|---|
| author | Malon, D Albrand, S Gallas, E Stewart, G |
| author_facet | Malon, D Albrand, S Gallas, E Stewart, G |
| author_sort | Malon, D |
| collection | OXFORD |
| description | The volume and diversity of metadata in an experiment of the size and scope of ATLAS are considerable. Even the definition of metadata may seem context-dependent: data that are primary for one purpose may be metadata for another. ATLAS metadata services must integrate and federate information from inhomogeneous sources and repositories, map metadata about logical or physics constructs to deployment and production constructs, provide a means to associate metadata at one level of granularity with processing or decision-making at another, offer a coherent and integrated view to physicists, and support both human use and programmatic access. In this paper we consider ATLAS metadata, metadata services, and metadata flow principally from the illustrative perspective of how disparate metadata are made available to executing jobs and, conversely, how metadata generated by such jobs are returned. We describe how metadata are read, how metadata are cached, and how metadata generated by jobs and the tasks of which they are a part are communicated, associated with data products, and preserved. We also discuss the principles that guide decision-making about metadata storage, replication, and access.. |
| first_indexed | 2024-03-06T22:07:20Z |
| format | Journal article |
| id | oxford-uuid:509a32ca-7c43-4cea-8166-144988c23eea |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T22:07:20Z |
| publishDate | 2012 |
| record_format | dspace |
| spelling | oxford-uuid:509a32ca-7c43-4cea-8166-144988c23eea2022-03-26T16:14:34ZA programmatic view of metadata, metadata services, and metadata flow in ATLASJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:509a32ca-7c43-4cea-8166-144988c23eeaEnglishSymplectic Elements at Oxford2012Malon, DAlbrand, SGallas, EStewart, GThe volume and diversity of metadata in an experiment of the size and scope of ATLAS are considerable. Even the definition of metadata may seem context-dependent: data that are primary for one purpose may be metadata for another. ATLAS metadata services must integrate and federate information from inhomogeneous sources and repositories, map metadata about logical or physics constructs to deployment and production constructs, provide a means to associate metadata at one level of granularity with processing or decision-making at another, offer a coherent and integrated view to physicists, and support both human use and programmatic access. In this paper we consider ATLAS metadata, metadata services, and metadata flow principally from the illustrative perspective of how disparate metadata are made available to executing jobs and, conversely, how metadata generated by such jobs are returned. We describe how metadata are read, how metadata are cached, and how metadata generated by jobs and the tasks of which they are a part are communicated, associated with data products, and preserved. We also discuss the principles that guide decision-making about metadata storage, replication, and access.. |
| spellingShingle | Malon, D Albrand, S Gallas, E Stewart, G A programmatic view of metadata, metadata services, and metadata flow in ATLAS |
| title | A programmatic view of metadata, metadata services, and metadata flow in ATLAS |
| title_full | A programmatic view of metadata, metadata services, and metadata flow in ATLAS |
| title_fullStr | A programmatic view of metadata, metadata services, and metadata flow in ATLAS |
| title_full_unstemmed | A programmatic view of metadata, metadata services, and metadata flow in ATLAS |
| title_short | A programmatic view of metadata, metadata services, and metadata flow in ATLAS |
| title_sort | programmatic view of metadata metadata services and metadata flow in atlas |
| work_keys_str_mv | AT malond aprogrammaticviewofmetadatametadataservicesandmetadataflowinatlas AT albrands aprogrammaticviewofmetadatametadataservicesandmetadataflowinatlas AT gallase aprogrammaticviewofmetadatametadataservicesandmetadataflowinatlas AT stewartg aprogrammaticviewofmetadatametadataservicesandmetadataflowinatlas AT malond programmaticviewofmetadatametadataservicesandmetadataflowinatlas AT albrands programmaticviewofmetadatametadataservicesandmetadataflowinatlas AT gallase programmaticviewofmetadatametadataservicesandmetadataflowinatlas AT stewartg programmaticviewofmetadatametadataservicesandmetadataflowinatlas |