SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP

<p>The Sea Ice Evaluation Tool (SITool) described in this paper is a performance metrics and diagnostics tool developed to evaluate the skill of Arctic and Antarctic model reconstructions of sea ice concentration, extent, edge location, drift, thickness, and snow depth. It is a Python-based so...

Full description

Bibliographic Details
Main Authors: X. Lin, F. Massonnet, T. Fichefet, M. Vancoppenolle
Format: Article
Language:English
Published: Copernicus Publications 2021-10-01
Series:Geoscientific Model Development
Online Access:https://gmd.copernicus.org/articles/14/6331/2021/gmd-14-6331-2021.pdf
_version_ 1818743697201692672
author X. Lin
X. Lin
F. Massonnet
T. Fichefet
M. Vancoppenolle
author_facet X. Lin
X. Lin
F. Massonnet
T. Fichefet
M. Vancoppenolle
author_sort X. Lin
collection DOAJ
description <p>The Sea Ice Evaluation Tool (SITool) described in this paper is a performance metrics and diagnostics tool developed to evaluate the skill of Arctic and Antarctic model reconstructions of sea ice concentration, extent, edge location, drift, thickness, and snow depth. It is a Python-based software and consists of well-documented functions used to derive various sea ice metrics and diagnostics. Here, SITool version 1.0 (v1.0) is introduced and documented, and is then used to evaluate the performance of global sea ice reconstructions from nine models that provided sea ice output under the experimental protocols of the Coupled Model Intercomparison Project phase 6 (CMIP6) Ocean Model Intercomparison Project with two different atmospheric forcing datasets: the Coordinated Ocean-ice Reference Experiments version 2 (CORE-II) and the updated Japanese 55-year atmospheric reanalysis (JRA55-do). Two sets of observational references for the sea ice concentration, thickness, snow depth, and ice drift are systematically used to reflect the impact of observational uncertainty on model performance. Based on available model outputs and observational references, the ice concentration, extent, and edge location during 1980–2007, as well as the ice thickness, snow depth, and ice drift during 2003–2007 are evaluated. In general, model biases are larger than observational uncertainties, and model performance is primarily consistent compared to different observational references. By changing the atmospheric forcing from CORE-II to JRA55-do reanalysis data, the overall performance (mean state, interannual variability, and trend) of the simulated sea ice areal properties in both hemispheres, as well as the mean ice thickness simulation in the Antarctic, the mean snow depth, and ice drift simulations in both hemispheres are improved. The simulated sea ice areal properties are also improved in the model with higher spatial resolution. For the cross-metric analysis, there is no link between the performance in one variable and the performance in another. SITool is an open-access version-controlled software that can run on a wide range of CMIP6-compliant sea ice outputs. The current version of SITool (v1.0) is primarily developed to evaluate atmosphere-forced simulations and it could be eventually extended to fully coupled models.</p>
first_indexed 2024-12-18T02:32:32Z
format Article
id doaj.art-0ccd6d2fca2f437ba4ab93e3de0d5185
institution Directory Open Access Journal
issn 1991-959X
1991-9603
language English
last_indexed 2024-12-18T02:32:32Z
publishDate 2021-10-01
publisher Copernicus Publications
record_format Article
series Geoscientific Model Development
spelling doaj.art-0ccd6d2fca2f437ba4ab93e3de0d51852022-12-21T21:23:52ZengCopernicus PublicationsGeoscientific Model Development1991-959X1991-96032021-10-01146331635410.5194/gmd-14-6331-2021SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIPX. Lin0X. Lin1F. Massonnet2T. Fichefet3M. Vancoppenolle4Georges Lemaître Centre for Earth and Climate Research, Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, 1348, BelgiumSouthern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Zhuhai, 519000, ChinaGeorges Lemaître Centre for Earth and Climate Research, Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, 1348, BelgiumGeorges Lemaître Centre for Earth and Climate Research, Earth and Life Institute, Université catholique de Louvain, Louvain-la-Neuve, 1348, BelgiumLaboratoire d'Océanographie et du Climat, CNRS/IRD/MNHN, Sorbonne Université, 75252, Paris, France<p>The Sea Ice Evaluation Tool (SITool) described in this paper is a performance metrics and diagnostics tool developed to evaluate the skill of Arctic and Antarctic model reconstructions of sea ice concentration, extent, edge location, drift, thickness, and snow depth. It is a Python-based software and consists of well-documented functions used to derive various sea ice metrics and diagnostics. Here, SITool version 1.0 (v1.0) is introduced and documented, and is then used to evaluate the performance of global sea ice reconstructions from nine models that provided sea ice output under the experimental protocols of the Coupled Model Intercomparison Project phase 6 (CMIP6) Ocean Model Intercomparison Project with two different atmospheric forcing datasets: the Coordinated Ocean-ice Reference Experiments version 2 (CORE-II) and the updated Japanese 55-year atmospheric reanalysis (JRA55-do). Two sets of observational references for the sea ice concentration, thickness, snow depth, and ice drift are systematically used to reflect the impact of observational uncertainty on model performance. Based on available model outputs and observational references, the ice concentration, extent, and edge location during 1980–2007, as well as the ice thickness, snow depth, and ice drift during 2003–2007 are evaluated. In general, model biases are larger than observational uncertainties, and model performance is primarily consistent compared to different observational references. By changing the atmospheric forcing from CORE-II to JRA55-do reanalysis data, the overall performance (mean state, interannual variability, and trend) of the simulated sea ice areal properties in both hemispheres, as well as the mean ice thickness simulation in the Antarctic, the mean snow depth, and ice drift simulations in both hemispheres are improved. The simulated sea ice areal properties are also improved in the model with higher spatial resolution. For the cross-metric analysis, there is no link between the performance in one variable and the performance in another. SITool is an open-access version-controlled software that can run on a wide range of CMIP6-compliant sea ice outputs. The current version of SITool (v1.0) is primarily developed to evaluate atmosphere-forced simulations and it could be eventually extended to fully coupled models.</p>https://gmd.copernicus.org/articles/14/6331/2021/gmd-14-6331-2021.pdf
spellingShingle X. Lin
X. Lin
F. Massonnet
T. Fichefet
M. Vancoppenolle
SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
Geoscientific Model Development
title SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_full SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_fullStr SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_full_unstemmed SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_short SITool (v1.0) – a new evaluation tool for large-scale sea ice simulations: application to CMIP6 OMIP
title_sort sitool v1 0 a new evaluation tool for large scale sea ice simulations application to cmip6 omip
url https://gmd.copernicus.org/articles/14/6331/2021/gmd-14-6331-2021.pdf
work_keys_str_mv AT xlin sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip
AT xlin sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip
AT fmassonnet sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip
AT tfichefet sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip
AT mvancoppenolle sitoolv10anewevaluationtoolforlargescaleseaicesimulationsapplicationtocmip6omip