A content analysis-based approach to explore simulation verification and identify its current challenges.

Verification is a crucial process to facilitate the identification and removal of errors within simulations. This study explores semantic changes to the concept of simulation verification over the past six decades using a data-supported, automated content analysis approach. We collect and utilize a...

Full description

Bibliographic Details
Main Authors: Christopher J Lynch, Saikou Y Diallo, Hamdi Kavak, Jose J Padilla
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2020-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0232929
_version_ 1818399126177447936
author Christopher J Lynch
Saikou Y Diallo
Hamdi Kavak
Jose J Padilla
author_facet Christopher J Lynch
Saikou Y Diallo
Hamdi Kavak
Jose J Padilla
author_sort Christopher J Lynch
collection DOAJ
description Verification is a crucial process to facilitate the identification and removal of errors within simulations. This study explores semantic changes to the concept of simulation verification over the past six decades using a data-supported, automated content analysis approach. We collect and utilize a corpus of 4,047 peer-reviewed Modeling and Simulation (M&S) publications dealing with a wide range of studies of simulation verification from 1963 to 2015. We group the selected papers by decade of publication to provide insights and explore the corpus from four perspectives: (i) the positioning of prominent concepts across the corpus as a whole; (ii) a comparison of the prominence of verification, validation, and Verification and Validation (V&V) as separate concepts; (iii) the positioning of the concepts specifically associated with verification; and (iv) an evaluation of verification's defining characteristics within each decade. Our analysis reveals unique characterizations of verification in each decade. The insights gathered helped to identify and discuss three categories of verification challenges as avenues of future research, awareness, and understanding for researchers, students, and practitioners. These categories include conveying confidence and maintaining ease of use; techniques' coverage abilities for handling increasing simulation complexities; and new ways to provide error feedback to model users.
first_indexed 2024-12-14T07:15:43Z
format Article
id doaj.art-3a2bf8db32d740439d4a75ab838031c1
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-12-14T07:15:43Z
publishDate 2020-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-3a2bf8db32d740439d4a75ab838031c12022-12-21T23:11:42ZengPublic Library of Science (PLoS)PLoS ONE1932-62032020-01-01155e023292910.1371/journal.pone.0232929A content analysis-based approach to explore simulation verification and identify its current challenges.Christopher J LynchSaikou Y DialloHamdi KavakJose J PadillaVerification is a crucial process to facilitate the identification and removal of errors within simulations. This study explores semantic changes to the concept of simulation verification over the past six decades using a data-supported, automated content analysis approach. We collect and utilize a corpus of 4,047 peer-reviewed Modeling and Simulation (M&S) publications dealing with a wide range of studies of simulation verification from 1963 to 2015. We group the selected papers by decade of publication to provide insights and explore the corpus from four perspectives: (i) the positioning of prominent concepts across the corpus as a whole; (ii) a comparison of the prominence of verification, validation, and Verification and Validation (V&V) as separate concepts; (iii) the positioning of the concepts specifically associated with verification; and (iv) an evaluation of verification's defining characteristics within each decade. Our analysis reveals unique characterizations of verification in each decade. The insights gathered helped to identify and discuss three categories of verification challenges as avenues of future research, awareness, and understanding for researchers, students, and practitioners. These categories include conveying confidence and maintaining ease of use; techniques' coverage abilities for handling increasing simulation complexities; and new ways to provide error feedback to model users.https://doi.org/10.1371/journal.pone.0232929
spellingShingle Christopher J Lynch
Saikou Y Diallo
Hamdi Kavak
Jose J Padilla
A content analysis-based approach to explore simulation verification and identify its current challenges.
PLoS ONE
title A content analysis-based approach to explore simulation verification and identify its current challenges.
title_full A content analysis-based approach to explore simulation verification and identify its current challenges.
title_fullStr A content analysis-based approach to explore simulation verification and identify its current challenges.
title_full_unstemmed A content analysis-based approach to explore simulation verification and identify its current challenges.
title_short A content analysis-based approach to explore simulation verification and identify its current challenges.
title_sort content analysis based approach to explore simulation verification and identify its current challenges
url https://doi.org/10.1371/journal.pone.0232929
work_keys_str_mv AT christopherjlynch acontentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges
AT saikouydiallo acontentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges
AT hamdikavak acontentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges
AT josejpadilla acontentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges
AT christopherjlynch contentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges
AT saikouydiallo contentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges
AT hamdikavak contentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges
AT josejpadilla contentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges