Extrapolation of urn models via poissonization: accurate measurements of the microbial unknown.

The availability of high-throughput parallel methods for sequencing microbial communities is increasing our knowledge of the microbial world at an unprecedented rate. Though most attention has focused on determining lower-bounds on the α-diversity i.e. the total number of different species present i...

Full description

Bibliographic Details
Main Authors: Manuel E Lladser, Raúl Gouet, Jens Reeder
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2011-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC3125174?pdf=render
_version_ 1830487053757841408
author Manuel E Lladser
Raúl Gouet
Jens Reeder
author_facet Manuel E Lladser
Raúl Gouet
Jens Reeder
author_sort Manuel E Lladser
collection DOAJ
description The availability of high-throughput parallel methods for sequencing microbial communities is increasing our knowledge of the microbial world at an unprecedented rate. Though most attention has focused on determining lower-bounds on the α-diversity i.e. the total number of different species present in the environment, tight bounds on this quantity may be highly uncertain because a small fraction of the environment could be composed of a vast number of different species. To better assess what remains unknown, we propose instead to predict the fraction of the environment that belongs to unsampled classes. Modeling samples as draws with replacement of colored balls from an urn with an unknown composition, and under the sole assumption that there are still undiscovered species, we show that conditionally unbiased predictors and exact prediction intervals (of constant length in logarithmic scale) are possible for the fraction of the environment that belongs to unsampled classes. Our predictions are based on a poissonization argument, which we have implemented in what we call the Embedding algorithm. In fixed i.e. non-randomized sample sizes, the algorithm leads to very accurate predictions on a sub-sample of the original sample. We quantify the effect of fixed sample sizes on our prediction intervals and test our methods and others found in the literature against simulated environments, which we devise taking into account datasets from a human-gut and -hand microbiota. Our methodology applies to any dataset that can be conceptualized as a sample with replacement from an urn. In particular, it could be applied, for example, to quantify the proportion of all the unseen solutions to a binding site problem in a random RNA pool, or to reassess the surveillance of a certain terrorist group, predicting the conditional probability that it deploys a new tactic in a next attack.
first_indexed 2024-12-21T18:54:55Z
format Article
id doaj.art-440f5be266594a648759255e197e3afa
institution Directory Open Access Journal
issn 1932-6203
language English
last_indexed 2024-12-21T18:54:55Z
publishDate 2011-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLoS ONE
spelling doaj.art-440f5be266594a648759255e197e3afa2022-12-21T18:53:39ZengPublic Library of Science (PLoS)PLoS ONE1932-62032011-01-0166e2110510.1371/journal.pone.0021105Extrapolation of urn models via poissonization: accurate measurements of the microbial unknown.Manuel E LladserRaúl GouetJens ReederThe availability of high-throughput parallel methods for sequencing microbial communities is increasing our knowledge of the microbial world at an unprecedented rate. Though most attention has focused on determining lower-bounds on the α-diversity i.e. the total number of different species present in the environment, tight bounds on this quantity may be highly uncertain because a small fraction of the environment could be composed of a vast number of different species. To better assess what remains unknown, we propose instead to predict the fraction of the environment that belongs to unsampled classes. Modeling samples as draws with replacement of colored balls from an urn with an unknown composition, and under the sole assumption that there are still undiscovered species, we show that conditionally unbiased predictors and exact prediction intervals (of constant length in logarithmic scale) are possible for the fraction of the environment that belongs to unsampled classes. Our predictions are based on a poissonization argument, which we have implemented in what we call the Embedding algorithm. In fixed i.e. non-randomized sample sizes, the algorithm leads to very accurate predictions on a sub-sample of the original sample. We quantify the effect of fixed sample sizes on our prediction intervals and test our methods and others found in the literature against simulated environments, which we devise taking into account datasets from a human-gut and -hand microbiota. Our methodology applies to any dataset that can be conceptualized as a sample with replacement from an urn. In particular, it could be applied, for example, to quantify the proportion of all the unseen solutions to a binding site problem in a random RNA pool, or to reassess the surveillance of a certain terrorist group, predicting the conditional probability that it deploys a new tactic in a next attack.http://europepmc.org/articles/PMC3125174?pdf=render
spellingShingle Manuel E Lladser
Raúl Gouet
Jens Reeder
Extrapolation of urn models via poissonization: accurate measurements of the microbial unknown.
PLoS ONE
title Extrapolation of urn models via poissonization: accurate measurements of the microbial unknown.
title_full Extrapolation of urn models via poissonization: accurate measurements of the microbial unknown.
title_fullStr Extrapolation of urn models via poissonization: accurate measurements of the microbial unknown.
title_full_unstemmed Extrapolation of urn models via poissonization: accurate measurements of the microbial unknown.
title_short Extrapolation of urn models via poissonization: accurate measurements of the microbial unknown.
title_sort extrapolation of urn models via poissonization accurate measurements of the microbial unknown
url http://europepmc.org/articles/PMC3125174?pdf=render
work_keys_str_mv AT manuelelladser extrapolationofurnmodelsviapoissonizationaccuratemeasurementsofthemicrobialunknown
AT raulgouet extrapolationofurnmodelsviapoissonizationaccuratemeasurementsofthemicrobialunknown
AT jensreeder extrapolationofurnmodelsviapoissonizationaccuratemeasurementsofthemicrobialunknown