A content analysis-based approach to explore simulation verification and identify its current challenges.
Verification is a crucial process to facilitate the identification and removal of errors within simulations. This study explores semantic changes to the concept of simulation verification over the past six decades using a data-supported, automated content analysis approach. We collect and utilize a...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2020-01-01
|
Series: | PLoS ONE |
Online Access: | https://doi.org/10.1371/journal.pone.0232929 |
_version_ | 1818399126177447936 |
---|---|
author | Christopher J Lynch Saikou Y Diallo Hamdi Kavak Jose J Padilla |
author_facet | Christopher J Lynch Saikou Y Diallo Hamdi Kavak Jose J Padilla |
author_sort | Christopher J Lynch |
collection | DOAJ |
description | Verification is a crucial process to facilitate the identification and removal of errors within simulations. This study explores semantic changes to the concept of simulation verification over the past six decades using a data-supported, automated content analysis approach. We collect and utilize a corpus of 4,047 peer-reviewed Modeling and Simulation (M&S) publications dealing with a wide range of studies of simulation verification from 1963 to 2015. We group the selected papers by decade of publication to provide insights and explore the corpus from four perspectives: (i) the positioning of prominent concepts across the corpus as a whole; (ii) a comparison of the prominence of verification, validation, and Verification and Validation (V&V) as separate concepts; (iii) the positioning of the concepts specifically associated with verification; and (iv) an evaluation of verification's defining characteristics within each decade. Our analysis reveals unique characterizations of verification in each decade. The insights gathered helped to identify and discuss three categories of verification challenges as avenues of future research, awareness, and understanding for researchers, students, and practitioners. These categories include conveying confidence and maintaining ease of use; techniques' coverage abilities for handling increasing simulation complexities; and new ways to provide error feedback to model users. |
first_indexed | 2024-12-14T07:15:43Z |
format | Article |
id | doaj.art-3a2bf8db32d740439d4a75ab838031c1 |
institution | Directory Open Access Journal |
issn | 1932-6203 |
language | English |
last_indexed | 2024-12-14T07:15:43Z |
publishDate | 2020-01-01 |
publisher | Public Library of Science (PLoS) |
record_format | Article |
series | PLoS ONE |
spelling | doaj.art-3a2bf8db32d740439d4a75ab838031c12022-12-21T23:11:42ZengPublic Library of Science (PLoS)PLoS ONE1932-62032020-01-01155e023292910.1371/journal.pone.0232929A content analysis-based approach to explore simulation verification and identify its current challenges.Christopher J LynchSaikou Y DialloHamdi KavakJose J PadillaVerification is a crucial process to facilitate the identification and removal of errors within simulations. This study explores semantic changes to the concept of simulation verification over the past six decades using a data-supported, automated content analysis approach. We collect and utilize a corpus of 4,047 peer-reviewed Modeling and Simulation (M&S) publications dealing with a wide range of studies of simulation verification from 1963 to 2015. We group the selected papers by decade of publication to provide insights and explore the corpus from four perspectives: (i) the positioning of prominent concepts across the corpus as a whole; (ii) a comparison of the prominence of verification, validation, and Verification and Validation (V&V) as separate concepts; (iii) the positioning of the concepts specifically associated with verification; and (iv) an evaluation of verification's defining characteristics within each decade. Our analysis reveals unique characterizations of verification in each decade. The insights gathered helped to identify and discuss three categories of verification challenges as avenues of future research, awareness, and understanding for researchers, students, and practitioners. These categories include conveying confidence and maintaining ease of use; techniques' coverage abilities for handling increasing simulation complexities; and new ways to provide error feedback to model users.https://doi.org/10.1371/journal.pone.0232929 |
spellingShingle | Christopher J Lynch Saikou Y Diallo Hamdi Kavak Jose J Padilla A content analysis-based approach to explore simulation verification and identify its current challenges. PLoS ONE |
title | A content analysis-based approach to explore simulation verification and identify its current challenges. |
title_full | A content analysis-based approach to explore simulation verification and identify its current challenges. |
title_fullStr | A content analysis-based approach to explore simulation verification and identify its current challenges. |
title_full_unstemmed | A content analysis-based approach to explore simulation verification and identify its current challenges. |
title_short | A content analysis-based approach to explore simulation verification and identify its current challenges. |
title_sort | content analysis based approach to explore simulation verification and identify its current challenges |
url | https://doi.org/10.1371/journal.pone.0232929 |
work_keys_str_mv | AT christopherjlynch acontentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges AT saikouydiallo acontentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges AT hamdikavak acontentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges AT josejpadilla acontentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges AT christopherjlynch contentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges AT saikouydiallo contentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges AT hamdikavak contentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges AT josejpadilla contentanalysisbasedapproachtoexploresimulationverificationandidentifyitscurrentchallenges |