Assessing the Reliability of SARS-CoV-2 Neutralization Studies That Use Post-Vaccination Sera
Assessing COVID-19 vaccine effectiveness against emerging SARS-CoV-2 variants is crucial for determining future vaccination strategies and other public health strategies. When clinical effectiveness data are unavailable, a common method of assessing vaccine performance is to utilize neutralization a...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-05-01
|
| Series: | Vaccines |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-393X/10/6/850 |
| _version_ | 1797481610312941568 |
|---|---|
| author | Henning Jacobsen Ioannis Sitaras Marley Jurgensmeyer Mick N. Mulders David Goldblatt Daniel R. Feikin Naor Bar-Zeev Melissa M. Higdon Maria Deloria Knoll |
| author_facet | Henning Jacobsen Ioannis Sitaras Marley Jurgensmeyer Mick N. Mulders David Goldblatt Daniel R. Feikin Naor Bar-Zeev Melissa M. Higdon Maria Deloria Knoll |
| author_sort | Henning Jacobsen |
| collection | DOAJ |
| description | Assessing COVID-19 vaccine effectiveness against emerging SARS-CoV-2 variants is crucial for determining future vaccination strategies and other public health strategies. When clinical effectiveness data are unavailable, a common method of assessing vaccine performance is to utilize neutralization assays using post-vaccination sera. Neutralization studies are typically performed across a wide array of settings, populations and vaccination strategies, and using different methodologies. For any comparison and meta-analysis to be meaningful, the design and methodology of the studies used must at minimum address aspects that confer a certain degree of reliability and comparability. We identified and characterized three important categories in which studies differ (cohort details, assay details and data reporting details) and that can affect the overall reliability and/or usefulness of neutralization assay results. We define reliability as a measure of methodological accuracy, proper study setting concerning subjects, samples and viruses, and reporting quality. Each category comprises a set of several relevant key parameters. To each parameter, we assigned a possible impact (ranging from low to high) on overall study reliability depending on its potential to influence the results. We then developed a reliability assessment tool that assesses the aggregate reliability of a study across all parameters. The reliability assessment tool provides explicit selection criteria for inclusion of comparable studies in meta-analyses of neutralization activity of SARS-CoV-2 variants in post-vaccination sera and can also both guide the design of future neutralization studies and serve as a checklist for including important details on key parameters in publications. |
| first_indexed | 2024-03-09T22:17:03Z |
| format | Article |
| id | doaj.art-3065f4b2fcff4dbdaec73ab65e3bda63 |
| institution | Directory Open Access Journal |
| issn | 2076-393X |
| language | English |
| last_indexed | 2024-03-09T22:17:03Z |
| publishDate | 2022-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Vaccines |
| spelling | doaj.art-3065f4b2fcff4dbdaec73ab65e3bda632023-11-23T19:20:17ZengMDPI AGVaccines2076-393X2022-05-0110685010.3390/vaccines10060850Assessing the Reliability of SARS-CoV-2 Neutralization Studies That Use Post-Vaccination SeraHenning Jacobsen0Ioannis Sitaras1Marley Jurgensmeyer2Mick N. Mulders3David Goldblatt4Daniel R. Feikin5Naor Bar-Zeev6Melissa M. Higdon7Maria Deloria Knoll8Department of Viral Immunology, Helmholtz Centre for Infection Research, 38124 Braunschweig, GermanyW. Harry Feinstone Department of Molecular Microbiology and Immunology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD 21205, USAInternational Vaccine Access Center, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD 21205, USADepartment of Immunizations, Vaccines and Biologicals, World Health Organization, 1211 Geneva, SwitzerlandGreat Ormond Street Institute of Child Health, NIHR Biomedical Research Centre, University College London, London WC1E 6BT, UKDepartment of Immunizations, Vaccines and Biologicals, World Health Organization, 1211 Geneva, SwitzerlandInternational Vaccine Access Center, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD 21205, USAInternational Vaccine Access Center, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD 21205, USAInternational Vaccine Access Center, Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD 21205, USAAssessing COVID-19 vaccine effectiveness against emerging SARS-CoV-2 variants is crucial for determining future vaccination strategies and other public health strategies. When clinical effectiveness data are unavailable, a common method of assessing vaccine performance is to utilize neutralization assays using post-vaccination sera. Neutralization studies are typically performed across a wide array of settings, populations and vaccination strategies, and using different methodologies. For any comparison and meta-analysis to be meaningful, the design and methodology of the studies used must at minimum address aspects that confer a certain degree of reliability and comparability. We identified and characterized three important categories in which studies differ (cohort details, assay details and data reporting details) and that can affect the overall reliability and/or usefulness of neutralization assay results. We define reliability as a measure of methodological accuracy, proper study setting concerning subjects, samples and viruses, and reporting quality. Each category comprises a set of several relevant key parameters. To each parameter, we assigned a possible impact (ranging from low to high) on overall study reliability depending on its potential to influence the results. We then developed a reliability assessment tool that assesses the aggregate reliability of a study across all parameters. The reliability assessment tool provides explicit selection criteria for inclusion of comparable studies in meta-analyses of neutralization activity of SARS-CoV-2 variants in post-vaccination sera and can also both guide the design of future neutralization studies and serve as a checklist for including important details on key parameters in publications.https://www.mdpi.com/2076-393X/10/6/850COVID-19vaccineserologyantibody neutralizationSARS-CoV-2 |
| spellingShingle | Henning Jacobsen Ioannis Sitaras Marley Jurgensmeyer Mick N. Mulders David Goldblatt Daniel R. Feikin Naor Bar-Zeev Melissa M. Higdon Maria Deloria Knoll Assessing the Reliability of SARS-CoV-2 Neutralization Studies That Use Post-Vaccination Sera Vaccines COVID-19 vaccine serology antibody neutralization SARS-CoV-2 |
| title | Assessing the Reliability of SARS-CoV-2 Neutralization Studies That Use Post-Vaccination Sera |
| title_full | Assessing the Reliability of SARS-CoV-2 Neutralization Studies That Use Post-Vaccination Sera |
| title_fullStr | Assessing the Reliability of SARS-CoV-2 Neutralization Studies That Use Post-Vaccination Sera |
| title_full_unstemmed | Assessing the Reliability of SARS-CoV-2 Neutralization Studies That Use Post-Vaccination Sera |
| title_short | Assessing the Reliability of SARS-CoV-2 Neutralization Studies That Use Post-Vaccination Sera |
| title_sort | assessing the reliability of sars cov 2 neutralization studies that use post vaccination sera |
| topic | COVID-19 vaccine serology antibody neutralization SARS-CoV-2 |
| url | https://www.mdpi.com/2076-393X/10/6/850 |
| work_keys_str_mv | AT henningjacobsen assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera AT ioannissitaras assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera AT marleyjurgensmeyer assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera AT micknmulders assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera AT davidgoldblatt assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera AT danielrfeikin assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera AT naorbarzeev assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera AT melissamhigdon assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera AT mariadeloriaknoll assessingthereliabilityofsarscov2neutralizationstudiesthatusepostvaccinationsera |