Avoiding false positive conclusions in molecular simulation: The importance of replicas

Molecular simulations are a computational technique used to investigate the dynamics of proteins and other molecules. The free energy landscape of these simulations is often rugged, and minor differences in the initial velocities, floating-point precision, or underlying hardware can cause identical...

Full description

Bibliographic Details
Main Authors: Knapp, B, Ospina, L, Deane, C
Format: Journal article
Published: American Chemical Society 2018
_version_ 1797081675323146240
author Knapp, B
Ospina, L
Deane, C
author_facet Knapp, B
Ospina, L
Deane, C
author_sort Knapp, B
collection OXFORD
description Molecular simulations are a computational technique used to investigate the dynamics of proteins and other molecules. The free energy landscape of these simulations is often rugged, and minor differences in the initial velocities, floating-point precision, or underlying hardware can cause identical simulations (replicas) to take different paths in the landscape. In this study we investigated the magnitude of these effects based on 310 000 ns of simulation time. We performed 100 identically parametrized replicas of 3000 ns each for a small 10 amino acid system as well as 100 identically parametrized replicas of 100 ns each for an 827 residue T-cell receptor/MHC system. Comparing randomly chosen subgroups within these replica sets, we estimated the reproducibility and reliability that can be achieved by a given number of replicas at a given simulation time. These results demonstrate that conclusions drawn from single simulations are often not reproducible and that conclusions drawn from multiple shorter replicas are more reliable than those from a single longer simulation. The actual number of replicas needed will always depend on the question asked and the level of reliability sought. On the basis of our data, it appears that a good rule of thumb is to perform a minimum of five to 10 replicas.
first_indexed 2024-03-07T01:17:25Z
format Journal article
id oxford-uuid:8f2b00e5-5fd4-44ff-977c-b278e2864526
institution University of Oxford
last_indexed 2024-03-07T01:17:25Z
publishDate 2018
publisher American Chemical Society
record_format dspace
spelling oxford-uuid:8f2b00e5-5fd4-44ff-977c-b278e28645262022-03-26T23:02:32ZAvoiding false positive conclusions in molecular simulation: The importance of replicasJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:8f2b00e5-5fd4-44ff-977c-b278e2864526Symplectic Elements at OxfordAmerican Chemical Society2018Knapp, BOspina, LDeane, CMolecular simulations are a computational technique used to investigate the dynamics of proteins and other molecules. The free energy landscape of these simulations is often rugged, and minor differences in the initial velocities, floating-point precision, or underlying hardware can cause identical simulations (replicas) to take different paths in the landscape. In this study we investigated the magnitude of these effects based on 310 000 ns of simulation time. We performed 100 identically parametrized replicas of 3000 ns each for a small 10 amino acid system as well as 100 identically parametrized replicas of 100 ns each for an 827 residue T-cell receptor/MHC system. Comparing randomly chosen subgroups within these replica sets, we estimated the reproducibility and reliability that can be achieved by a given number of replicas at a given simulation time. These results demonstrate that conclusions drawn from single simulations are often not reproducible and that conclusions drawn from multiple shorter replicas are more reliable than those from a single longer simulation. The actual number of replicas needed will always depend on the question asked and the level of reliability sought. On the basis of our data, it appears that a good rule of thumb is to perform a minimum of five to 10 replicas.
spellingShingle Knapp, B
Ospina, L
Deane, C
Avoiding false positive conclusions in molecular simulation: The importance of replicas
title Avoiding false positive conclusions in molecular simulation: The importance of replicas
title_full Avoiding false positive conclusions in molecular simulation: The importance of replicas
title_fullStr Avoiding false positive conclusions in molecular simulation: The importance of replicas
title_full_unstemmed Avoiding false positive conclusions in molecular simulation: The importance of replicas
title_short Avoiding false positive conclusions in molecular simulation: The importance of replicas
title_sort avoiding false positive conclusions in molecular simulation the importance of replicas
work_keys_str_mv AT knappb avoidingfalsepositiveconclusionsinmolecularsimulationtheimportanceofreplicas
AT ospinal avoidingfalsepositiveconclusionsinmolecularsimulationtheimportanceofreplicas
AT deanec avoidingfalsepositiveconclusionsinmolecularsimulationtheimportanceofreplicas