Building the world's largest radio telescope: the Square Kilometre Array science data processor
The Square Kilometre Array (SKA) will be the largest radio telescope constructed to date and the largest Big Data project in the known Universe. The first phase of the project will generate 160 terabytes every second. This amounts to 5 zettabytes (5 million petabytes) of data that will be generated...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Conference item |
| Language: | English |
| Published: |
Institute of Electrical and Electronics Engineers
2018
|
| _version_ | 1826298330104201216 |
|---|---|
| author | Farnes, JS Mort, B Dulwich, F Adamek, K Brown, A Novotny, J Salvini, S Armour, W SKASDP Consortium |
| author_facet | Farnes, JS Mort, B Dulwich, F Adamek, K Brown, A Novotny, J Salvini, S Armour, W SKASDP Consortium |
| author_sort | Farnes, JS |
| collection | OXFORD |
| description | The Square Kilometre Array (SKA) will be the largest radio telescope constructed to date and the largest Big Data project in the known Universe. The first phase of the project will generate 160 terabytes every second. This amounts to 5 zettabytes (5 million petabytes) of data that will be generated by the facility each year - a data rate equivalent to 5 times the estimated global internet traffic in 2015. These data need to be reduced and then continuously ingested by the SKA Science Data Processor (SDP). Within the SDP Consortium, we are contributing to various roles in the development of the telescope including building a lightweight end-to-end prototype of the major components of the SDP system - a project we call the SDP Integration Prototype (SIP). The aim is to build a mini, fully-operational SDP, for which we have been developing realistic SKA-like science pipelines that can handle these unprecedented data volumes. |
| first_indexed | 2024-03-07T04:45:11Z |
| format | Conference item |
| id | oxford-uuid:d3029f54-80b1-426e-8f78-08933261c67f |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T04:45:11Z |
| publishDate | 2018 |
| publisher | Institute of Electrical and Electronics Engineers |
| record_format | dspace |
| spelling | oxford-uuid:d3029f54-80b1-426e-8f78-08933261c67f2022-03-27T08:08:18ZBuilding the world's largest radio telescope: the Square Kilometre Array science data processorConference itemhttp://purl.org/coar/resource_type/c_5794uuid:d3029f54-80b1-426e-8f78-08933261c67fEnglishSymplectic ElementsInstitute of Electrical and Electronics Engineers 2018Farnes, JSMort, BDulwich, FAdamek, KBrown, ANovotny, JSalvini, SArmour, WSKASDP ConsortiumThe Square Kilometre Array (SKA) will be the largest radio telescope constructed to date and the largest Big Data project in the known Universe. The first phase of the project will generate 160 terabytes every second. This amounts to 5 zettabytes (5 million petabytes) of data that will be generated by the facility each year - a data rate equivalent to 5 times the estimated global internet traffic in 2015. These data need to be reduced and then continuously ingested by the SKA Science Data Processor (SDP). Within the SDP Consortium, we are contributing to various roles in the development of the telescope including building a lightweight end-to-end prototype of the major components of the SDP system - a project we call the SDP Integration Prototype (SIP). The aim is to build a mini, fully-operational SDP, for which we have been developing realistic SKA-like science pipelines that can handle these unprecedented data volumes. |
| spellingShingle | Farnes, JS Mort, B Dulwich, F Adamek, K Brown, A Novotny, J Salvini, S Armour, W SKASDP Consortium Building the world's largest radio telescope: the Square Kilometre Array science data processor |
| title | Building the world's largest radio telescope: the Square Kilometre Array science data processor |
| title_full | Building the world's largest radio telescope: the Square Kilometre Array science data processor |
| title_fullStr | Building the world's largest radio telescope: the Square Kilometre Array science data processor |
| title_full_unstemmed | Building the world's largest radio telescope: the Square Kilometre Array science data processor |
| title_short | Building the world's largest radio telescope: the Square Kilometre Array science data processor |
| title_sort | building the world s largest radio telescope the square kilometre array science data processor |
| work_keys_str_mv | AT farnesjs buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor AT mortb buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor AT dulwichf buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor AT adamekk buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor AT browna buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor AT novotnyj buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor AT salvinis buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor AT armourw buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor AT skasdpconsortium buildingtheworldslargestradiotelescopethesquarekilometrearraysciencedataprocessor |