Methodology over metrics: current scientific standards are a disservice to patients and society
Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly addres...
| Main Authors: | , , , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Elsevier
2021
|
| _version_ | 1797089049119293440 |
|---|---|
| author | Van Calster, B Wynants, L Riley, RD van Smeden, M Collins, GS |
| author_facet | Van Calster, B Wynants, L Riley, RD van Smeden, M Collins, GS |
| author_sort | Van Calster, B |
| collection | OXFORD |
| description | Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society. |
| first_indexed | 2024-03-07T02:58:53Z |
| format | Journal article |
| id | oxford-uuid:b045aa96-382e-479a-8cd8-fd5c38632230 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T02:58:53Z |
| publishDate | 2021 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | oxford-uuid:b045aa96-382e-479a-8cd8-fd5c386322302022-03-27T03:55:13ZMethodology over metrics: current scientific standards are a disservice to patients and societyJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:b045aa96-382e-479a-8cd8-fd5c38632230EnglishSymplectic ElementsElsevier2021Van Calster, BWynants, LRiley, RDvan Smeden, MCollins, GSCovid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society. |
| spellingShingle | Van Calster, B Wynants, L Riley, RD van Smeden, M Collins, GS Methodology over metrics: current scientific standards are a disservice to patients and society |
| title | Methodology over metrics: current scientific standards are a disservice to patients and society |
| title_full | Methodology over metrics: current scientific standards are a disservice to patients and society |
| title_fullStr | Methodology over metrics: current scientific standards are a disservice to patients and society |
| title_full_unstemmed | Methodology over metrics: current scientific standards are a disservice to patients and society |
| title_short | Methodology over metrics: current scientific standards are a disservice to patients and society |
| title_sort | methodology over metrics current scientific standards are a disservice to patients and society |
| work_keys_str_mv | AT vancalsterb methodologyovermetricscurrentscientificstandardsareadisservicetopatientsandsociety AT wynantsl methodologyovermetricscurrentscientificstandardsareadisservicetopatientsandsociety AT rileyrd methodologyovermetricscurrentscientificstandardsareadisservicetopatientsandsociety AT vansmedenm methodologyovermetricscurrentscientificstandardsareadisservicetopatientsandsociety AT collinsgs methodologyovermetricscurrentscientificstandardsareadisservicetopatientsandsociety |