SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
<p>The Sea Ice Evaluation Tool (SITool) described in this paper is a performance metrics and diagnostics tool developed to evaluate the skill of Arctic and Antarctic model reconstructions of sea ice concentration, extent, edge location, drift, thickness, and snow depth. It is a Python-based so...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2021-10-01
|
Series: | Geoscientific Model Development |
Online Access: | https://gmd.copernicus.org/articles/14/6331/2021/gmd-14-6331-2021.pdf |
_version_ | 1818743697201692672 |
---|---|
author | X. Lin X. Lin F. Massonnet T. Fichefet M. Vancoppenolle |
author_facet | X. Lin X. Lin F. Massonnet T. Fichefet M. Vancoppenolle |
author_sort | X. Lin |
collection | DOAJ |
description | <p>The Sea Ice Evaluation Tool (SITool) described in this
paper is a performance metrics and diagnostics tool developed to evaluate
the skill of Arctic and Antarctic model reconstructions of sea ice
concentration, extent, edge location, drift, thickness, and snow depth. It
is a Python-based software and consists of well-documented functions used to
derive various sea ice metrics and diagnostics. Here, SITool version 1.0
(v1.0) is introduced and documented, and is then used to evaluate the
performance of global sea ice reconstructions from nine models that provided
sea ice output under the experimental protocols of the Coupled Model
Intercomparison Project phase 6 (CMIP6) Ocean Model Intercomparison Project with
two different atmospheric forcing datasets: the Coordinated Ocean-ice
Reference Experiments version 2 (CORE-II) and the updated Japanese 55-year
atmospheric reanalysis (JRA55-do). Two sets of observational references for
the sea ice concentration, thickness, snow depth, and ice drift are
systematically used to reflect the impact of observational uncertainty on
model performance. Based on available model outputs and observational
references, the ice concentration, extent, and edge location during
1980–2007, as well as the ice thickness, snow depth, and ice drift during
2003–2007 are evaluated. In general, model biases are larger than
observational uncertainties, and model performance is primarily consistent
compared to different observational references. By changing the atmospheric
forcing from CORE-II to JRA55-do reanalysis data, the overall performance
(mean state, interannual variability, and trend) of the simulated sea ice
areal properties in both hemispheres, as well as the mean ice thickness
simulation in the Antarctic, the mean snow depth, and ice drift simulations
in both hemispheres are improved. The simulated sea ice areal properties are
also improved in the model with higher spatial resolution. For the
cross-metric analysis, there is no link between the performance in one
variable and the performance in another. SITool is an open-access
version-controlled software that can run on a wide range of CMIP6-compliant
sea ice outputs. The current version of SITool (v1.0) is primarily developed
to evaluate atmosphere-forced simulations and it could be eventually
extended to fully coupled models.</p> |
first_indexed | 2024-12-18T02:32:32Z |
format | Article |
id | doaj.art-0ccd6d2fca2f437ba4ab93e3de0d5185 |
institution | Directory Open Access Journal |
issn | 1991-959X 1991-9603 |
language | English |
last_indexed | 2024-12-18T02:32:32Z |
publishDate | 2021-10-01 |
publisher | Copernicus Publications |
record_format | Article |
series | Geoscientific Model Development |
spelling | doaj.art-0ccd6d2fca2f437ba4ab93e3de0d51852022-12-21T21:23:52ZengCopernicus PublicationsGeoscientific Model Development1991-959X1991-96032021-10-01146331635410.5194/gmd-14-6331-2021SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIPX. Lin0X. Lin1F. Massonnet2T. Fichefet3M. Vancoppenolle4Georges Lemaître Centre for Earth and Climate Research, Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, 1348, BelgiumSouthern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Zhuhai, 519000, ChinaGeorges Lemaître Centre for Earth and Climate Research, Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, 1348, BelgiumGeorges Lemaître Centre for Earth and Climate Research, Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, 1348, BelgiumLaboratoire d'Océanographie et du Climat, CNRS/IRD/MNHN, Sorbonne Université, 75252, Paris, France<p>The Sea Ice Evaluation Tool (SITool) described in this paper is a performance metrics and diagnostics tool developed to evaluate the skill of Arctic and Antarctic model reconstructions of sea ice concentration, extent, edge location, drift, thickness, and snow depth. It is a Python-based software and consists of well-documented functions used to derive various sea ice metrics and diagnostics. Here, SITool version 1.0 (v1.0) is introduced and documented, and is then used to evaluate the performance of global sea ice reconstructions from nine models that provided sea ice output under the experimental protocols of the Coupled Model Intercomparison Project phase 6 (CMIP6) Ocean Model Intercomparison Project with two different atmospheric forcing datasets: the Coordinated Ocean-ice Reference Experiments version 2 (CORE-II) and the updated Japanese 55-year atmospheric reanalysis (JRA55-do). Two sets of observational references for the sea ice concentration, thickness, snow depth, and ice drift are systematically used to reflect the impact of observational uncertainty on model performance. Based on available model outputs and observational references, the ice concentration, extent, and edge location during 1980–2007, as well as the ice thickness, snow depth, and ice drift during 2003–2007 are evaluated. In general, model biases are larger than observational uncertainties, and model performance is primarily consistent compared to different observational references. By changing the atmospheric forcing from CORE-II to JRA55-do reanalysis data, the overall performance (mean state, interannual variability, and trend) of the simulated sea ice areal properties in both hemispheres, as well as the mean ice thickness simulation in the Antarctic, the mean snow depth, and ice drift simulations in both hemispheres are improved. The simulated sea ice areal properties are also improved in the model with higher spatial resolution. For the cross-metric analysis, there is no link between the performance in one variable and the performance in another. SITool is an open-access version-controlled software that can run on a wide range of CMIP6-compliant sea ice outputs. The current version of SITool (v1.0) is primarily developed to evaluate atmosphere-forced simulations and it could be eventually extended to fully coupled models.</p>https://gmd.copernicus.org/articles/14/6331/2021/gmd-14-6331-2021.pdf |
spellingShingle | X. Lin X. Lin F. Massonnet T. Fichefet M. Vancoppenolle SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP Geoscientific Model Development |
title | SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP |
title_full | SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP |
title_fullStr | SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP |
title_full_unstemmed | SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP |
title_short | SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP |
title_sort | sitool v1 0 a new evaluation tool for large scale sea ice simulations application to cmip6 omip |
url | https://gmd.copernicus.org/articles/14/6331/2021/gmd-14-6331-2021.pdf |
work_keys_str_mv | AT xlin sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip AT xlin sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip AT fmassonnet sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip AT tfichefet sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip AT mvancoppenolle sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip |