The IceProd framework: distributed data processing for the IceCube neutrino observatory
IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, iden- tify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computat...
| Main Authors: | , |
|---|---|
| Format: | Journal article |
| Published: |
Elsevier
2014
|
| _version_ | 1797064593487429632 |
|---|---|
| author | Aartsen, MG Sarkar, S |
| author_facet | Aartsen, MG Sarkar, S |
| author_sort | Aartsen, MG |
| collection | OXFORD |
| description | IceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, iden- tify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. IceProd is a distributed management system based on Python, XML-RPC and GridFTP. It is driven by a central database in order to coordinate and admin- ister production of simulations and processing of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, Condor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework. |
| first_indexed | 2024-03-06T21:16:36Z |
| format | Journal article |
| id | oxford-uuid:3ffcaa9a-9c37-4665-a774-a7f5634dc155 |
| institution | University of Oxford |
| last_indexed | 2024-03-06T21:16:36Z |
| publishDate | 2014 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | oxford-uuid:3ffcaa9a-9c37-4665-a774-a7f5634dc1552022-03-26T14:35:18ZThe IceProd framework: distributed data processing for the IceCube neutrino observatoryJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:3ffcaa9a-9c37-4665-a774-a7f5634dc155Symplectic Elements at OxfordElsevier2014Aartsen, MGSarkar, SIceCube is a one-gigaton instrument located at the geographic South Pole, designed to detect cosmic neutrinos, iden- tify the particle nature of dark matter, and study high-energy neutrinos themselves. Simulation of the IceCube detector and processing of data require a significant amount of computational resources. IceProd is a distributed management system based on Python, XML-RPC and GridFTP. It is driven by a central database in order to coordinate and admin- ister production of simulations and processing of data produced by the IceCube detector. IceProd runs as a separate layer on top of other middleware and can take advantage of a variety of computing resources, including grids and batch systems such as CREAM, Condor, and PBS. This is accomplished by a set of dedicated daemons that process job submission in a coordinated fashion through the use of middleware plugins that serve to abstract the details of job submission and job management from the framework. |
| spellingShingle | Aartsen, MG Sarkar, S The IceProd framework: distributed data processing for the IceCube neutrino observatory |
| title | The IceProd framework: distributed data processing for the IceCube neutrino observatory |
| title_full | The IceProd framework: distributed data processing for the IceCube neutrino observatory |
| title_fullStr | The IceProd framework: distributed data processing for the IceCube neutrino observatory |
| title_full_unstemmed | The IceProd framework: distributed data processing for the IceCube neutrino observatory |
| title_short | The IceProd framework: distributed data processing for the IceCube neutrino observatory |
| title_sort | iceprod framework distributed data processing for the icecube neutrino observatory |
| work_keys_str_mv | AT aartsenmg theiceprodframeworkdistributeddataprocessingfortheicecubeneutrinoobservatory AT sarkars theiceprodframeworkdistributeddataprocessingfortheicecubeneutrinoobservatory AT aartsenmg iceprodframeworkdistributeddataprocessingfortheicecubeneutrinoobservatory AT sarkars iceprodframeworkdistributeddataprocessingfortheicecubeneutrinoobservatory |