High impact = high statistical standards? Not necessarily so.
What are the statistical practices of articles published in journals with a high impact factor? Are there differences compared with articles published in journals with a somewhat lower impact factor that have adopted editorial policies to reduce the impact of limitations of Null Hypothesis Significa...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2013-01-01
|
| Series: | PLoS ONE |
| Online Access: | http://europepmc.org/articles/PMC3571951?pdf=render |
| _version_ | 1818177955740778496 |
|---|---|
| author | Patrizio E Tressoldi David Giofré Francesco Sella Geoff Cumming |
| author_facet | Patrizio E Tressoldi David Giofré Francesco Sella Geoff Cumming |
| author_sort | Patrizio E Tressoldi |
| collection | DOAJ |
| description | What are the statistical practices of articles published in journals with a high impact factor? Are there differences compared with articles published in journals with a somewhat lower impact factor that have adopted editorial policies to reduce the impact of limitations of Null Hypothesis Significance Testing? To investigate these questions, the current study analyzed all articles related to psychological, neuropsychological and medical issues, published in 2011 in four journals with high impact factors: Science, Nature, The New England Journal of Medicine and The Lancet, and three journals with relatively lower impact factors: Neuropsychology, Journal of Experimental Psychology-Applied and the American Journal of Public Health. Results show that Null Hypothesis Significance Testing without any use of confidence intervals, effect size, prospective power and model estimation, is the prevalent statistical practice used in articles published in Nature, 89%, followed by articles published in Science, 42%. By contrast, in all other journals, both with high and lower impact factors, most articles report confidence intervals and/or effect size measures. We interpreted these differences as consequences of the editorial policies adopted by the journal editors, which are probably the most effective means to improve the statistical practices in journals with high or low impact factors. |
| first_indexed | 2024-12-11T20:40:19Z |
| format | Article |
| id | doaj.art-bf39d2d35b614780901794e384eaf090 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-11T20:40:19Z |
| publishDate | 2013-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-bf39d2d35b614780901794e384eaf0902022-12-22T00:51:33ZengPublic Library of Science (PLoS)PLoS ONE1932-62032013-01-0182e5618010.1371/journal.pone.0056180High impact = high statistical standards? Not necessarily so.Patrizio E TressoldiDavid GiofréFrancesco SellaGeoff CummingWhat are the statistical practices of articles published in journals with a high impact factor? Are there differences compared with articles published in journals with a somewhat lower impact factor that have adopted editorial policies to reduce the impact of limitations of Null Hypothesis Significance Testing? To investigate these questions, the current study analyzed all articles related to psychological, neuropsychological and medical issues, published in 2011 in four journals with high impact factors: Science, Nature, The New England Journal of Medicine and The Lancet, and three journals with relatively lower impact factors: Neuropsychology, Journal of Experimental Psychology-Applied and the American Journal of Public Health. Results show that Null Hypothesis Significance Testing without any use of confidence intervals, effect size, prospective power and model estimation, is the prevalent statistical practice used in articles published in Nature, 89%, followed by articles published in Science, 42%. By contrast, in all other journals, both with high and lower impact factors, most articles report confidence intervals and/or effect size measures. We interpreted these differences as consequences of the editorial policies adopted by the journal editors, which are probably the most effective means to improve the statistical practices in journals with high or low impact factors.http://europepmc.org/articles/PMC3571951?pdf=render |
| spellingShingle | Patrizio E Tressoldi David Giofré Francesco Sella Geoff Cumming High impact = high statistical standards? Not necessarily so. PLoS ONE |
| title | High impact = high statistical standards? Not necessarily so. |
| title_full | High impact = high statistical standards? Not necessarily so. |
| title_fullStr | High impact = high statistical standards? Not necessarily so. |
| title_full_unstemmed | High impact = high statistical standards? Not necessarily so. |
| title_short | High impact = high statistical standards? Not necessarily so. |
| title_sort | high impact high statistical standards not necessarily so |
| url | http://europepmc.org/articles/PMC3571951?pdf=render |
| work_keys_str_mv | AT patrizioetressoldi highimpacthighstatisticalstandardsnotnecessarilyso AT davidgiofre highimpacthighstatisticalstandardsnotnecessarilyso AT francescosella highimpacthighstatisticalstandardsnotnecessarilyso AT geoffcumming highimpacthighstatisticalstandardsnotnecessarilyso |