Automatic Data Standardization for the Global Cryosphere Watch Data Portal
The Global Cryosphere Watch (GCW) was initiated by the World Meteorological Organization (WMO) as a mechanism to support the delivery of Earth System monitoring, modelling and prediction services focused on the cryosphere. GCW fosters international coordination and partnerships with the goal of prov...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Ubiquity Press
2020-02-01
|
| Series: | Data Science Journal |
| Subjects: | |
| Online Access: | https://datascience.codata.org/articles/1115 |
| _version_ | 1819106203215593472 |
|---|---|
| author | Mathias Bavay Joel Fiddes Øystein Godøy |
| author_facet | Mathias Bavay Joel Fiddes Øystein Godøy |
| author_sort | Mathias Bavay |
| collection | DOAJ |
| description | The Global Cryosphere Watch (GCW) was initiated by the World Meteorological Organization (WMO) as a mechanism to support the delivery of Earth System monitoring, modelling and prediction services focused on the cryosphere. GCW fosters international coordination and partnerships with the goal of providing authoritative, clear and usable data, information and analyses on the past, current and future state of the cryosphere. It fosters sustained and mutually beneficial partnerships between research and operational institutions, by linking research and operations as well as scientists and practitioners. This is important as most available cryospheric data come from the scientific community. It is generally managed by research institutes which often do not have the infrastructure, the resources, nor the mandate to enable FAIR data management, which is necessary for interoperability and discovery at data level. This implies that data do not fit into standardized systems or dataflows for broader data access and exchange (as exists at the WMO) and thus have been unavailable for operational meteorological and climate applications. This lack of standardization also impairs the reuse of data within the scientific community. GCW is bridging this gap through a data portal and software stack enabling the transformation of sparsely documented and highly variable data into standardized and well documented data suitable for downstream applications with data level interoperability. A processing engine converts raw data provided by the data producers into NetCDF-CF standard files with NetCDF Attribute Convention for Dataset Discovery (ACDD) metadata. The data portal web front end harvests the metadata necessary for its search engine through an OPeNDAP server so no manual editing of the medatadata is necessary. When a user downloads some data from the web portal, it gets the requested data through the OPeNDAP server. |
| first_indexed | 2024-12-22T02:34:24Z |
| format | Article |
| id | doaj.art-5d867cb5021a4264b73d662c71adfdbd |
| institution | Directory Open Access Journal |
| issn | 1683-1470 |
| language | English |
| last_indexed | 2024-12-22T02:34:24Z |
| publishDate | 2020-02-01 |
| publisher | Ubiquity Press |
| record_format | Article |
| series | Data Science Journal |
| spelling | doaj.art-5d867cb5021a4264b73d662c71adfdbd2022-12-21T18:41:47ZengUbiquity PressData Science Journal1683-14702020-02-0119110.5334/dsj-2020-006761Automatic Data Standardization for the Global Cryosphere Watch Data PortalMathias Bavay0Joel Fiddes1Øystein Godøy2Institute for Snow and Avalanche Research SLF, DavosWorld Meteorological Organization, Geneva, CH; Norwegian Meteorological Institute, OsloNorwegian Meteorological Institute, OsloThe Global Cryosphere Watch (GCW) was initiated by the World Meteorological Organization (WMO) as a mechanism to support the delivery of Earth System monitoring, modelling and prediction services focused on the cryosphere. GCW fosters international coordination and partnerships with the goal of providing authoritative, clear and usable data, information and analyses on the past, current and future state of the cryosphere. It fosters sustained and mutually beneficial partnerships between research and operational institutions, by linking research and operations as well as scientists and practitioners. This is important as most available cryospheric data come from the scientific community. It is generally managed by research institutes which often do not have the infrastructure, the resources, nor the mandate to enable FAIR data management, which is necessary for interoperability and discovery at data level. This implies that data do not fit into standardized systems or dataflows for broader data access and exchange (as exists at the WMO) and thus have been unavailable for operational meteorological and climate applications. This lack of standardization also impairs the reuse of data within the scientific community. GCW is bridging this gap through a data portal and software stack enabling the transformation of sparsely documented and highly variable data into standardized and well documented data suitable for downstream applications with data level interoperability. A processing engine converts raw data provided by the data producers into NetCDF-CF standard files with NetCDF Attribute Convention for Dataset Discovery (ACDD) metadata. The data portal web front end harvests the metadata necessary for its search engine through an OPeNDAP server so no manual editing of the medatadata is necessary. When a user downloads some data from the web portal, it gets the requested data through the OPeNDAP server.https://datascience.codata.org/articles/1115meteorological datadata processingstandardizationpublicationautomatic |
| spellingShingle | Mathias Bavay Joel Fiddes Øystein Godøy Automatic Data Standardization for the Global Cryosphere Watch Data Portal Data Science Journal meteorological data data processing standardization publication automatic |
| title | Automatic Data Standardization for the Global Cryosphere Watch Data Portal |
| title_full | Automatic Data Standardization for the Global Cryosphere Watch Data Portal |
| title_fullStr | Automatic Data Standardization for the Global Cryosphere Watch Data Portal |
| title_full_unstemmed | Automatic Data Standardization for the Global Cryosphere Watch Data Portal |
| title_short | Automatic Data Standardization for the Global Cryosphere Watch Data Portal |
| title_sort | automatic data standardization for the global cryosphere watch data portal |
| topic | meteorological data data processing standardization publication automatic |
| url | https://datascience.codata.org/articles/1115 |
| work_keys_str_mv | AT mathiasbavay automaticdatastandardizationfortheglobalcryospherewatchdataportal AT joelfiddes automaticdatastandardizationfortheglobalcryospherewatchdataportal AT øysteingodøy automaticdatastandardizationfortheglobalcryospherewatchdataportal |