Science pipelines for the Square Kilometre Array
The Square Kilometre Array (SKA) will be both the largest radio telescope ever constructed and the largest Big Data project in the known Universe. The first phase of the project will generate on the order of five zettabytes of data per year. A critical task for the SKA will be its ability to process...
| Main Authors: | , , , , |
|---|---|
| Format: | Journal article |
| Published: |
MDPI
2018
|
| _version_ | 1797074834346213376 |
|---|---|
| author | Farnes, J Mort, B Dulwich, F Salvini, S Armour, W |
| author_facet | Farnes, J Mort, B Dulwich, F Salvini, S Armour, W |
| author_sort | Farnes, J |
| collection | OXFORD |
| description | The Square Kilometre Array (SKA) will be both the largest radio telescope ever constructed and the largest Big Data project in the known Universe. The first phase of the project will generate on the order of five zettabytes of data per year. A critical task for the SKA will be its ability to process data for science, which will need to be conducted by science pipelines. Together with polarization data from the LOFAR Multifrequency Snapshot Sky Survey (MSSS), we have been developing a realistic SKA-like science pipeline that can handle the large data volumes generated by LOFAR at 150 MHz. The pipeline uses task-based parallelism to image, detect sources and perform Faraday tomography across the entire LOFAR sky. The project thereby provides a unique opportunity to contribute to the technological development of the SKA telescope, while simultaneously enabling cutting-edge scientific results. In this paper, we provide an update on current efforts to develop a science pipeline that can enable tight constraints on the magnetised large-scale structure of the Universe. |
| first_indexed | 2024-03-06T23:41:57Z |
| format | Journal article |
| id | oxford-uuid:6f9ec4cf-d30a-4a4a-9e9c-0f8867f5887b |
| institution | University of Oxford |
| last_indexed | 2024-03-06T23:41:57Z |
| publishDate | 2018 |
| publisher | MDPI |
| record_format | dspace |
| spelling | oxford-uuid:6f9ec4cf-d30a-4a4a-9e9c-0f8867f5887b2022-03-26T19:31:46ZScience pipelines for the Square Kilometre ArrayJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:6f9ec4cf-d30a-4a4a-9e9c-0f8867f5887bSymplectic Elements at OxfordMDPI2018Farnes, JMort, BDulwich, FSalvini, SArmour, WThe Square Kilometre Array (SKA) will be both the largest radio telescope ever constructed and the largest Big Data project in the known Universe. The first phase of the project will generate on the order of five zettabytes of data per year. A critical task for the SKA will be its ability to process data for science, which will need to be conducted by science pipelines. Together with polarization data from the LOFAR Multifrequency Snapshot Sky Survey (MSSS), we have been developing a realistic SKA-like science pipeline that can handle the large data volumes generated by LOFAR at 150 MHz. The pipeline uses task-based parallelism to image, detect sources and perform Faraday tomography across the entire LOFAR sky. The project thereby provides a unique opportunity to contribute to the technological development of the SKA telescope, while simultaneously enabling cutting-edge scientific results. In this paper, we provide an update on current efforts to develop a science pipeline that can enable tight constraints on the magnetised large-scale structure of the Universe. |
| spellingShingle | Farnes, J Mort, B Dulwich, F Salvini, S Armour, W Science pipelines for the Square Kilometre Array |
| title | Science pipelines for the Square Kilometre Array |
| title_full | Science pipelines for the Square Kilometre Array |
| title_fullStr | Science pipelines for the Square Kilometre Array |
| title_full_unstemmed | Science pipelines for the Square Kilometre Array |
| title_short | Science pipelines for the Square Kilometre Array |
| title_sort | science pipelines for the square kilometre array |
| work_keys_str_mv | AT farnesj sciencepipelinesforthesquarekilometrearray AT mortb sciencepipelinesforthesquarekilometrearray AT dulwichf sciencepipelinesforthesquarekilometrearray AT salvinis sciencepipelinesforthesquarekilometrearray AT armourw sciencepipelinesforthesquarekilometrearray |