Comparison of Critical Benchmark Experiment Similarity and Dissimilarity Measures in Application

Critical benchmark experiments are important basis for validation of nuclear criticality calculations, criticality safety assessment, validation of neutron transport methods and nuclear data validation. At present, there are about 5 000 critical benchmark experiments in ICSBEP handbook. In applicati...

Full description

Bibliographic Details
Main Author: FAN Kai;YIN Yanpeng;SONG Lingli;WANG Sanbing
Format: Article
Language:English
Published: Editorial Board of Atomic Energy Science and Technology 2023-11-01
Series:Yuanzineng kexue jishu
Subjects:
Online Access:https://www.aest.org.cn/CN/10.7538/yzk.2023.youxian.0486
_version_ 1827590173791092736
author FAN Kai;YIN Yanpeng;SONG Lingli;WANG Sanbing
author_facet FAN Kai;YIN Yanpeng;SONG Lingli;WANG Sanbing
author_sort FAN Kai;YIN Yanpeng;SONG Lingli;WANG Sanbing
collection DOAJ
description Critical benchmark experiments are important basis for validation of nuclear criticality calculations, criticality safety assessment, validation of neutron transport methods and nuclear data validation. At present, there are about 5 000 critical benchmark experiments in ICSBEP handbook. In applications such as validation of nuclear criticality calculations and critical safety assessment, critical benchmark experiments are generally selected according to the characteristics of the nuclear assembly to be validated. With the development of sensitivity & uncertainty analysis methods, critical benchmark experiments suitable for specific applications can be selected according to the similarity of their sensitivity vectors. Several similarity and dissimilarity measures have been proposed to be used to assess the similarity or dissimilarity between two critical benchmark experiments. However, there is no clear criterion to choose which similarity measure or dissimilarity measure to be used in specific application. Three parts of work were done to provide recommendations for selecting similarity or dissimilarity measures in applications. First, a brief analysis was conducted on the similarity and dissimilarity measures of the critical benchmark experiments which were used widely, and their preliminary numerical characteristics and physical meanings were obtained. The similarity and dissimilarity measures were analyzed include E, G, C, Euclidean distance, and nuclear data covariance weighted Euclidean distance (F). Second, the above similarity and dissimilarity measures were applied in hypothetical examples to demonstrate the characteristics of these similarity and dissimilarity measures. Finally, these similarity and dissimilarity measures were applied in the Pu-Met-Fast classification of critical benchmark experiments in ICSBEP handbook, and the reasons for their different performances were analyzed. Based on the analysis, the similarity or dissimilarity measures used in specific application were recommended. There are significant differences in the results between similarity or dissimilarity measures that use nuclear data covariance as weights (C and F) and similarity or dissimilarity measures that do not use nuclear data covariance (E, G and Euclidean distance). The main reason is that when using the nuclear data covariance as weights, the influence of the cross sections with large uncertainty will be highlighted. In validations of nuclear data, and in applications where nuclear data is the main source of uncertainty, it is recommended to use measures weighted by nuclear data covariance. When measuring the intrinsic similarity between two critical benchmark experiments, it is recommended to use a measure that does not use nuclear data covariance as a weight. It is recommended to use F dissimilarity measure in measures weighted by nuclear data covariance. The main reason is that the F similarity measure has a clear physical meaning, which can measure the difference between the calculated biases of two critical benchmark experiments. For measures that do not use nuclear data covariance as weights, it is recommended to use Euclidean distance, and its physical meaning is also clear. The E similarity measure only measures the similarity between two experiments through the angle between the sensitivity vectors, which performs poorly in some examples and is not recommended.
first_indexed 2024-03-09T01:13:08Z
format Article
id doaj.art-e58ba3f443b94c5bbec3d709fb603da7
institution Directory Open Access Journal
issn 1000-6931
language English
last_indexed 2024-03-09T01:13:08Z
publishDate 2023-11-01
publisher Editorial Board of Atomic Energy Science and Technology
record_format Article
series Yuanzineng kexue jishu
spelling doaj.art-e58ba3f443b94c5bbec3d709fb603da72023-12-11T02:57:23ZengEditorial Board of Atomic Energy Science and TechnologyYuanzineng kexue jishu1000-69312023-11-0157112182219110.7538/yzk.2023.youxian.0486Comparison of Critical Benchmark Experiment Similarity and Dissimilarity Measures in ApplicationFAN Kai;YIN Yanpeng;SONG Lingli;WANG Sanbing 0Institute of Nuclear Physics and Chemistry, China Academy of Engineering Physics, Mianyang 621900, ChinaCritical benchmark experiments are important basis for validation of nuclear criticality calculations, criticality safety assessment, validation of neutron transport methods and nuclear data validation. At present, there are about 5 000 critical benchmark experiments in ICSBEP handbook. In applications such as validation of nuclear criticality calculations and critical safety assessment, critical benchmark experiments are generally selected according to the characteristics of the nuclear assembly to be validated. With the development of sensitivity & uncertainty analysis methods, critical benchmark experiments suitable for specific applications can be selected according to the similarity of their sensitivity vectors. Several similarity and dissimilarity measures have been proposed to be used to assess the similarity or dissimilarity between two critical benchmark experiments. However, there is no clear criterion to choose which similarity measure or dissimilarity measure to be used in specific application. Three parts of work were done to provide recommendations for selecting similarity or dissimilarity measures in applications. First, a brief analysis was conducted on the similarity and dissimilarity measures of the critical benchmark experiments which were used widely, and their preliminary numerical characteristics and physical meanings were obtained. The similarity and dissimilarity measures were analyzed include E, G, C, Euclidean distance, and nuclear data covariance weighted Euclidean distance (F). Second, the above similarity and dissimilarity measures were applied in hypothetical examples to demonstrate the characteristics of these similarity and dissimilarity measures. Finally, these similarity and dissimilarity measures were applied in the Pu-Met-Fast classification of critical benchmark experiments in ICSBEP handbook, and the reasons for their different performances were analyzed. Based on the analysis, the similarity or dissimilarity measures used in specific application were recommended. There are significant differences in the results between similarity or dissimilarity measures that use nuclear data covariance as weights (C and F) and similarity or dissimilarity measures that do not use nuclear data covariance (E, G and Euclidean distance). The main reason is that when using the nuclear data covariance as weights, the influence of the cross sections with large uncertainty will be highlighted. In validations of nuclear data, and in applications where nuclear data is the main source of uncertainty, it is recommended to use measures weighted by nuclear data covariance. When measuring the intrinsic similarity between two critical benchmark experiments, it is recommended to use a measure that does not use nuclear data covariance as a weight. It is recommended to use F dissimilarity measure in measures weighted by nuclear data covariance. The main reason is that the F similarity measure has a clear physical meaning, which can measure the difference between the calculated biases of two critical benchmark experiments. For measures that do not use nuclear data covariance as weights, it is recommended to use Euclidean distance, and its physical meaning is also clear. The E similarity measure only measures the similarity between two experiments through the angle between the sensitivity vectors, which performs poorly in some examples and is not recommended.https://www.aest.org.cn/CN/10.7538/yzk.2023.youxian.0486critical benchmark experimentsensitivity analysis
spellingShingle FAN Kai;YIN Yanpeng;SONG Lingli;WANG Sanbing
Comparison of Critical Benchmark Experiment Similarity and Dissimilarity Measures in Application
Yuanzineng kexue jishu
critical benchmark experiment
sensitivity analysis
title Comparison of Critical Benchmark Experiment Similarity and Dissimilarity Measures in Application
title_full Comparison of Critical Benchmark Experiment Similarity and Dissimilarity Measures in Application
title_fullStr Comparison of Critical Benchmark Experiment Similarity and Dissimilarity Measures in Application
title_full_unstemmed Comparison of Critical Benchmark Experiment Similarity and Dissimilarity Measures in Application
title_short Comparison of Critical Benchmark Experiment Similarity and Dissimilarity Measures in Application
title_sort comparison of critical benchmark experiment similarity and dissimilarity measures in application
topic critical benchmark experiment
sensitivity analysis
url https://www.aest.org.cn/CN/10.7538/yzk.2023.youxian.0486
work_keys_str_mv AT fankaiyinyanpengsonglingliwangsanbing comparisonofcriticalbenchmarkexperimentsimilarityanddissimilaritymeasuresinapplication