The Understanding on How to Determine Sample Size in Psychological Science: Data and Simulation

The lack of knowledge on how to determine sample sizes in experiments is arguably one of the main reasons underlying the replication crisis in psychological science. A survey distributed among Indonesian students and researchers concerning 1) familiarity and understanding of statistical concepts rel...

Full description

Bibliographic Details
Main Authors: Wisnu Wiradhany, Krisna Adiasto, Jony Eko Yulianto, Indra Y. Kiling
Format: Article
Language:Indonesian
Published: Universitas Gadjah Mada 2019-08-01
Series:Jurnal Psikologi
Subjects:
Online Access:https://jurnal.ugm.ac.id/jpsi/article/view/24260
Description
Summary:The lack of knowledge on how to determine sample sizes in experiments is arguably one of the main reasons underlying the replication crisis in psychological science. A survey distributed among Indonesian students and researchers concerning 1) familiarity and understanding of statistical concepts related to sample size determination, 2) current sample size determination practices in experiments, and 3) ideal sample sizes for experiments. Subsequently, we simulated expected statistical power given the sample sizes reported in the survey. Results demonstrated that 1) while a majority of participants were somewhat familiar with statistical concepts related to sample size determination, they did not always endorse the correct and/or complete definition of each concept. Furthermore, 2) participants relied on practical considerations in determining sample sizes. Consequently, 3) the reported sample sizes did not have sufficient power to detect small to medium effect sizes, which are commonly present in psychological science.
ISSN:2460-867X
0215-8884