Universally sloppy parameter sensitivities in systems biology models.

Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collective...

Full description

Bibliographic Details
Main Authors: Ryan N Gutenkunst, Joshua J Waterfall, Fergal P Casey, Kevin S Brown, Christopher R Myers, James P Sethna
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2007-10-01
Series:PLoS Computational Biology
Online Access:http://europepmc.org/articles/PMC2000971?pdf=render
_version_ 1828552922606075904
author Ryan N Gutenkunst
Joshua J Waterfall
Fergal P Casey
Kevin S Brown
Christopher R Myers
James P Sethna
author_facet Ryan N Gutenkunst
Joshua J Waterfall
Fergal P Casey
Kevin S Brown
Christopher R Myers
James P Sethna
author_sort Ryan N Gutenkunst
collection DOAJ
description Quantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collectively fitting them to other experimental data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a "sloppy" spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our growth-factor-signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters.
first_indexed 2024-12-12T05:08:38Z
format Article
id doaj.art-7946c35be1c14192b260ae11c1c21d0f
institution Directory Open Access Journal
issn 1553-734X
1553-7358
language English
last_indexed 2024-12-12T05:08:38Z
publishDate 2007-10-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS Computational Biology
spelling doaj.art-7946c35be1c14192b260ae11c1c21d0f2022-12-22T00:36:59ZengPublic Library of Science (PLoS)PLoS Computational Biology1553-734X1553-73582007-10-013101871187810.1371/journal.pcbi.0030189Universally sloppy parameter sensitivities in systems biology models.Ryan N GutenkunstJoshua J WaterfallFergal P CaseyKevin S BrownChristopher R MyersJames P SethnaQuantitative computational models play an increasingly important role in modern biology. Such models typically involve many free parameters, and assigning their values is often a substantial obstacle to model development. Directly measuring in vivo biochemical parameters is difficult, and collectively fitting them to other experimental data often yields large parameter uncertainties. Nevertheless, in earlier work we showed in a growth-factor-signaling model that collective fitting could yield well-constrained predictions, even when it left individual parameters very poorly constrained. We also showed that the model had a "sloppy" spectrum of parameter sensitivities, with eigenvalues roughly evenly distributed over many decades. Here we use a collection of models from the literature to test whether such sloppy spectra are common in systems biology. Strikingly, we find that every model we examine has a sloppy spectrum of sensitivities. We also test several consequences of this sloppiness for building predictive models. In particular, sloppiness suggests that collective fits to even large amounts of ideal time-series data will often leave many parameters poorly constrained. Tests over our model collection are consistent with this suggestion. This difficulty with collective fits may seem to argue for direct parameter measurements, but sloppiness also implies that such measurements must be formidably precise and complete to usefully constrain many model predictions. We confirm this implication in our growth-factor-signaling model. Our results suggest that sloppy sensitivity spectra are universal in systems biology models. The prevalence of sloppiness highlights the power of collective fits and suggests that modelers should focus on predictions rather than on parameters.http://europepmc.org/articles/PMC2000971?pdf=render
spellingShingle Ryan N Gutenkunst
Joshua J Waterfall
Fergal P Casey
Kevin S Brown
Christopher R Myers
James P Sethna
Universally sloppy parameter sensitivities in systems biology models.
PLoS Computational Biology
title Universally sloppy parameter sensitivities in systems biology models.
title_full Universally sloppy parameter sensitivities in systems biology models.
title_fullStr Universally sloppy parameter sensitivities in systems biology models.
title_full_unstemmed Universally sloppy parameter sensitivities in systems biology models.
title_short Universally sloppy parameter sensitivities in systems biology models.
title_sort universally sloppy parameter sensitivities in systems biology models
url http://europepmc.org/articles/PMC2000971?pdf=render
work_keys_str_mv AT ryanngutenkunst universallysloppyparametersensitivitiesinsystemsbiologymodels
AT joshuajwaterfall universallysloppyparametersensitivitiesinsystemsbiologymodels
AT fergalpcasey universallysloppyparametersensitivitiesinsystemsbiologymodels
AT kevinsbrown universallysloppyparametersensitivitiesinsystemsbiologymodels
AT christopherrmyers universallysloppyparametersensitivitiesinsystemsbiologymodels
AT jamespsethna universallysloppyparametersensitivitiesinsystemsbiologymodels