Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved]
Although thoroughly criticized, null hypothesis significance testing (NHST) remains the statistical method of choice used to provide evidence for an effect, in biological, biomedical and social sciences. In this short guide, I first summarize the concepts behind the method, distinguishing test of si...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
F1000 Research Ltd
2017-10-01
|
| Series: | F1000Research |
| Subjects: | |
| Online Access: | https://f1000research.com/articles/4-621/v5 |
| _version_ | 1818244264051605504 |
|---|---|
| author | Cyril Pernet |
| author_facet | Cyril Pernet |
| author_sort | Cyril Pernet |
| collection | DOAJ |
| description | Although thoroughly criticized, null hypothesis significance testing (NHST) remains the statistical method of choice used to provide evidence for an effect, in biological, biomedical and social sciences. In this short guide, I first summarize the concepts behind the method, distinguishing test of significance (Fisher) and test of acceptance (Newman-Pearson) and point to common interpretation errors regarding the p-value. I then present the related concepts of confidence intervals and again point to common interpretation errors. Finally, I discuss what should be reported in which context. The goal is to clarify concepts to avoid interpretation errors and propose simple reporting practices. |
| first_indexed | 2024-12-12T14:14:15Z |
| format | Article |
| id | doaj.art-7c664598dac54217adc0c7f2c0451433 |
| institution | Directory Open Access Journal |
| issn | 2046-1402 |
| language | English |
| last_indexed | 2024-12-12T14:14:15Z |
| publishDate | 2017-10-01 |
| publisher | F1000 Research Ltd |
| record_format | Article |
| series | F1000Research |
| spelling | doaj.art-7c664598dac54217adc0c7f2c04514332022-12-22T00:21:58ZengF1000 Research LtdF1000Research2046-14022017-10-01410.12688/f1000research.6963.513986Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved]Cyril Pernet0Centre for Clinical Brain Sciences (CCBS), Neuroimaging Sciences, The University of Edinburgh, Edinburgh, UKAlthough thoroughly criticized, null hypothesis significance testing (NHST) remains the statistical method of choice used to provide evidence for an effect, in biological, biomedical and social sciences. In this short guide, I first summarize the concepts behind the method, distinguishing test of significance (Fisher) and test of acceptance (Newman-Pearson) and point to common interpretation errors regarding the p-value. I then present the related concepts of confidence intervals and again point to common interpretation errors. Finally, I discuss what should be reported in which context. The goal is to clarify concepts to avoid interpretation errors and propose simple reporting practices.https://f1000research.com/articles/4-621/v5Statistical Methodologies & Health Informatics |
| spellingShingle | Cyril Pernet Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved] F1000Research Statistical Methodologies & Health Informatics |
| title | Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved] |
| title_full | Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved] |
| title_fullStr | Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved] |
| title_full_unstemmed | Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved] |
| title_short | Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved] |
| title_sort | null hypothesis significance testing a guide to commonly misunderstood concepts and recommendations for good practice version 5 referees 2 approved 2 not approved |
| topic | Statistical Methodologies & Health Informatics |
| url | https://f1000research.com/articles/4-621/v5 |
| work_keys_str_mv | AT cyrilpernet nullhypothesissignificancetestingaguidetocommonlymisunderstoodconceptsandrecommendationsforgoodpracticeversion5referees2approved2notapproved |