Biological plausibility in environmental health systematic reviews: a GRADE concept paper

Background: “Biological plausibility” is a concept frequently referred to in environmental and public health when researchers are evaluating how confident they are in the results and inferences of a study or evidence review. Biological plausibility is not, however, a domain of one of the most widely...

Full description

Bibliographic Details
Main Authors: Paul Whaley, Thomas Piggott, Rebecca L. Morgan, Sebastian Hoffmann, Katya Tsaioun, Lukas Schwingshackl, Mohammed T. Ansari, Kristina A. Thayer, Holger J. Schünemann
Format: Article
Language:English
Published: Elsevier 2022-04-01
Series:Environment International
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S0160412022000356
_version_ 1830228284214870016
author Paul Whaley
Thomas Piggott
Rebecca L. Morgan
Sebastian Hoffmann
Katya Tsaioun
Lukas Schwingshackl
Mohammed T. Ansari
Kristina A. Thayer
Holger J. Schünemann
author_facet Paul Whaley
Thomas Piggott
Rebecca L. Morgan
Sebastian Hoffmann
Katya Tsaioun
Lukas Schwingshackl
Mohammed T. Ansari
Kristina A. Thayer
Holger J. Schünemann
author_sort Paul Whaley
collection DOAJ
description Background: “Biological plausibility” is a concept frequently referred to in environmental and public health when researchers are evaluating how confident they are in the results and inferences of a study or evidence review. Biological plausibility is not, however, a domain of one of the most widely-used approaches for assessing the certainty of evidence (CoE) which underpins the findings of a systematic review, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) CoE Framework. Whether the omission of biological plausibility is a potential limitation of the GRADE CoE Framework is a topic that is regularly discussed, especially in the context of environmental health systematic reviews. Objectives: We analyse how the concept of “biological plausibility”, as applied in the context of assessing certainty of the evidence that supports the findings of a systematic review, is accommodated under the processes of systematic review and the existing GRADE domains. Results and discussion: We argue that “biological plausibility” is a concept which primarily comes into play when direct evidence about the effects of an exposure on a population of concern (usually humans) is absent, at high risk of bias, is inconsistent, or limited in other ways. In such circumstances, researchers look toward evidence from other study designs in order to draw conclusions. In this respect, we can consider experimental animal and in vitro evidence as “surrogates” for the target populations, exposures, comparators and outcomes of actual interest. Through discussion of 10 examples of experimental surrogates, we propose that the concept of biological plausibility consists of two principal aspects: a “generalisability aspect” and a “mechanistic aspect”. The “generalisability aspect” concerns the validity of inferences from experimental models to human scenarios, and asks the same question as does the assessment of external validity or indirectness in systematic reviews. The “mechanistic aspect” concerns certainty in knowledge of biological mechanisms and would inform judgements of indirectness under GRADE, and thus the overall CoE. While both aspects are accommodated under the indirectness domain of the GRADE CoE Framework, further research is needed to determine how to use knowledge of biological mechanisms in the assessment of indirectness of the evidence in systematic reviews.
first_indexed 2024-12-18T10:11:24Z
format Article
id doaj.art-edea3c9737d54f26b7ec5e186943bf83
institution Directory Open Access Journal
issn 0160-4120
language English
last_indexed 2024-12-18T10:11:24Z
publishDate 2022-04-01
publisher Elsevier
record_format Article
series Environment International
spelling doaj.art-edea3c9737d54f26b7ec5e186943bf832022-12-21T21:11:25ZengElsevierEnvironment International0160-41202022-04-01162107109Biological plausibility in environmental health systematic reviews: a GRADE concept paperPaul Whaley0Thomas Piggott1Rebecca L. Morgan2Sebastian Hoffmann3Katya Tsaioun4Lukas Schwingshackl5Mohammed T. Ansari6Kristina A. Thayer7Holger J. Schünemann8Lancaster Environment Centre, Lancaster University, UK; Evidence-based Toxicology Collaboration at Johns Hopkins Bloomberg School of Public Health (EBTC), USADepartment of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St West, Hamilton, ON L8N 3Z5, CanadaDepartment of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St West, Hamilton, ON L8N 3Z5, CanadaEvidence-based Toxicology Collaboration at Johns Hopkins Bloomberg School of Public Health (EBTC), USAEvidence-based Toxicology Collaboration at Johns Hopkins Bloomberg School of Public Health (EBTC), USAInstitute for Evidence in Medicine, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, GermanySchool of Epidemiology and Public Health, University of Ottawa, Room 101, 600 Peter Morand Crescent, Ottawa, Ontario K1G 5Z3, CanadaU.S. Environmental Protection Agency (US EPA), Office of Research and Development, Center for Public Health and Environmental Assessment (CPHEA), Chemical Pollutant Assessment Division (CPAD), 1200 Pennsylvania Avenue, NW (8623R), Washington, DC 20460, USADepartment of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St West, Hamilton, ON L8N 3Z5, Canada; Michael G DeGroote Cochrane Canada and McMaster GRADE Centres, McMaster University, HSC-2C, 1280 Main St West, Hamilton, ON L8N 3Z5, Canada; Dipartimento di Scienze Biomediche, Humanitas University, Via Rita Levi Montalcini, 4, 20090 Pieve Emanuele, Milan, Italy; Corresponding author.Background: “Biological plausibility” is a concept frequently referred to in environmental and public health when researchers are evaluating how confident they are in the results and inferences of a study or evidence review. Biological plausibility is not, however, a domain of one of the most widely-used approaches for assessing the certainty of evidence (CoE) which underpins the findings of a systematic review, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) CoE Framework. Whether the omission of biological plausibility is a potential limitation of the GRADE CoE Framework is a topic that is regularly discussed, especially in the context of environmental health systematic reviews. Objectives: We analyse how the concept of “biological plausibility”, as applied in the context of assessing certainty of the evidence that supports the findings of a systematic review, is accommodated under the processes of systematic review and the existing GRADE domains. Results and discussion: We argue that “biological plausibility” is a concept which primarily comes into play when direct evidence about the effects of an exposure on a population of concern (usually humans) is absent, at high risk of bias, is inconsistent, or limited in other ways. In such circumstances, researchers look toward evidence from other study designs in order to draw conclusions. In this respect, we can consider experimental animal and in vitro evidence as “surrogates” for the target populations, exposures, comparators and outcomes of actual interest. Through discussion of 10 examples of experimental surrogates, we propose that the concept of biological plausibility consists of two principal aspects: a “generalisability aspect” and a “mechanistic aspect”. The “generalisability aspect” concerns the validity of inferences from experimental models to human scenarios, and asks the same question as does the assessment of external validity or indirectness in systematic reviews. The “mechanistic aspect” concerns certainty in knowledge of biological mechanisms and would inform judgements of indirectness under GRADE, and thus the overall CoE. While both aspects are accommodated under the indirectness domain of the GRADE CoE Framework, further research is needed to determine how to use knowledge of biological mechanisms in the assessment of indirectness of the evidence in systematic reviews.http://www.sciencedirect.com/science/article/pii/S0160412022000356Systematic reviewBiological plausibilitySurrogatesEnvironmental healthToxicologyEpidemiology
spellingShingle Paul Whaley
Thomas Piggott
Rebecca L. Morgan
Sebastian Hoffmann
Katya Tsaioun
Lukas Schwingshackl
Mohammed T. Ansari
Kristina A. Thayer
Holger J. Schünemann
Biological plausibility in environmental health systematic reviews: a GRADE concept paper
Environment International
Systematic review
Biological plausibility
Surrogates
Environmental health
Toxicology
Epidemiology
title Biological plausibility in environmental health systematic reviews: a GRADE concept paper
title_full Biological plausibility in environmental health systematic reviews: a GRADE concept paper
title_fullStr Biological plausibility in environmental health systematic reviews: a GRADE concept paper
title_full_unstemmed Biological plausibility in environmental health systematic reviews: a GRADE concept paper
title_short Biological plausibility in environmental health systematic reviews: a GRADE concept paper
title_sort biological plausibility in environmental health systematic reviews a grade concept paper
topic Systematic review
Biological plausibility
Surrogates
Environmental health
Toxicology
Epidemiology
url http://www.sciencedirect.com/science/article/pii/S0160412022000356
work_keys_str_mv AT paulwhaley biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper
AT thomaspiggott biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper
AT rebeccalmorgan biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper
AT sebastianhoffmann biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper
AT katyatsaioun biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper
AT lukasschwingshackl biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper
AT mohammedtansari biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper
AT kristinaathayer biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper
AT holgerjschunemann biologicalplausibilityinenvironmentalhealthsystematicreviewsagradeconceptpaper