Jupyter-based service for JUNO analysis
The JUNO (Jiangmen Underground Neutrino Observatory) is designed to determine the neutrino mass hierarchy and precisely measure oscillation parameters. The estimated data volume of raw data is about 2 PB/year. The event rate of reactor anti-neutrinos is about 60/day, while the event rate of backgrou...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2020-01-01
|
| Series: | EPJ Web of Conferences |
| Online Access: | https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07011.pdf |
| _version_ | 1819114141389946880 |
|---|---|
| author | Lin Tao |
| author_facet | Lin Tao |
| author_sort | Lin Tao |
| collection | DOAJ |
| description | The JUNO (Jiangmen Underground Neutrino Observatory) is designed to determine the neutrino mass hierarchy and precisely measure oscillation parameters. The estimated data volume of raw data is about 2 PB/year. The event rate of reactor anti-neutrinos is about 60/day, while the event rate of background is about O(10) Hz. The challenge is the event correlation during the analysis, where the background events could not be discarded. In order to use big data techniques to search for rare events, a Jupyter-based interactive service is developed for JUNO analysis.
In this paper, an overview of this service is presented. The infrastructure is based on Jupyter and Kubernetes, which provides the user interface and resource management. In order to integrate the data processing framework and big data techniques, an index file is used as an intermediate file, which points to the interested events. Data processing framework SNiPER is used to select the candidate of neutrino signals and produce the index file. Apache Spark is then used to process such index file repeatedly with data cached in memory. With the index file produced from Spark and the complete event data files, SNiPER is used to process them and produce the final physics result. At the end of paper, the test-bed is presented and the testing result is shown. |
| first_indexed | 2024-12-22T04:40:35Z |
| format | Article |
| id | doaj.art-921c539355d347e49db16b5fbfa2fba5 |
| institution | Directory Open Access Journal |
| issn | 2100-014X |
| language | English |
| last_indexed | 2024-12-22T04:40:35Z |
| publishDate | 2020-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | EPJ Web of Conferences |
| spelling | doaj.art-921c539355d347e49db16b5fbfa2fba52022-12-21T18:38:45ZengEDP SciencesEPJ Web of Conferences2100-014X2020-01-012450701110.1051/epjconf/202024507011epjconf_chep2020_07011Jupyter-based service for JUNO analysisLin Tao0Institute of High Energy Physics, Chinese Academy of SciencesThe JUNO (Jiangmen Underground Neutrino Observatory) is designed to determine the neutrino mass hierarchy and precisely measure oscillation parameters. The estimated data volume of raw data is about 2 PB/year. The event rate of reactor anti-neutrinos is about 60/day, while the event rate of background is about O(10) Hz. The challenge is the event correlation during the analysis, where the background events could not be discarded. In order to use big data techniques to search for rare events, a Jupyter-based interactive service is developed for JUNO analysis. In this paper, an overview of this service is presented. The infrastructure is based on Jupyter and Kubernetes, which provides the user interface and resource management. In order to integrate the data processing framework and big data techniques, an index file is used as an intermediate file, which points to the interested events. Data processing framework SNiPER is used to select the candidate of neutrino signals and produce the index file. Apache Spark is then used to process such index file repeatedly with data cached in memory. With the index file produced from Spark and the complete event data files, SNiPER is used to process them and produce the final physics result. At the end of paper, the test-bed is presented and the testing result is shown.https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07011.pdf |
| spellingShingle | Lin Tao Jupyter-based service for JUNO analysis EPJ Web of Conferences |
| title | Jupyter-based service for JUNO analysis |
| title_full | Jupyter-based service for JUNO analysis |
| title_fullStr | Jupyter-based service for JUNO analysis |
| title_full_unstemmed | Jupyter-based service for JUNO analysis |
| title_short | Jupyter-based service for JUNO analysis |
| title_sort | jupyter based service for juno analysis |
| url | https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07011.pdf |
| work_keys_str_mv | AT lintao jupyterbasedserviceforjunoanalysis |