Null hypothesis significance testing: a guide to commonly misunderstood concepts and recommendations for good practice [version 5; referees: 2 approved, 2 not approved]

Although thoroughly criticized, null hypothesis significance testing (NHST) remains the statistical method of choice used to provide evidence for an effect, in biological, biomedical and social sciences. In this short guide, I first summarize the concepts behind the method, distinguishing test of si...

Full description

Bibliographic Details
Main Author: Cyril Pernet
Format: Article
Language:English
Published: F1000 Research Ltd 2017-10-01
Series:F1000Research
Subjects:
Online Access:https://f1000research.com/articles/4-621/v5
Description
Summary:Although thoroughly criticized, null hypothesis significance testing (NHST) remains the statistical method of choice used to provide evidence for an effect, in biological, biomedical and social sciences. In this short guide, I first summarize the concepts behind the method, distinguishing test of significance (Fisher) and test of acceptance (Newman-Pearson) and point to common interpretation errors regarding the p-value. I then present the related concepts of confidence intervals and again point to common interpretation errors. Finally, I discuss what should be reported in which context. The goal is to clarify concepts to avoid interpretation errors and propose simple reporting practices.
ISSN:2046-1402