The Understanding on How to Determine Sample Size in Psychological Science: Data and Simulation
The lack of knowledge on how to determine sample sizes in experiments is arguably one of the main reasons underlying the replication crisis in psychological science. A survey distributed among Indonesian students and researchers concerning 1) familiarity and understanding of statistical concepts rel...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | Indonesian |
| Published: |
Universitas Gadjah Mada
2019-08-01
|
| Series: | Jurnal Psikologi |
| Subjects: | |
| Online Access: | https://jurnal.ugm.ac.id/jpsi/article/view/24260 |
| _version_ | 1818178243902046208 |
|---|---|
| author | Wisnu Wiradhany Krisna Adiasto Jony Eko Yulianto Indra Y. Kiling |
| author_facet | Wisnu Wiradhany Krisna Adiasto Jony Eko Yulianto Indra Y. Kiling |
| author_sort | Wisnu Wiradhany |
| collection | DOAJ |
| description | The lack of knowledge on how to determine sample sizes in experiments is arguably one of the main reasons underlying the replication crisis in psychological science. A survey distributed among Indonesian students and researchers concerning 1) familiarity and understanding of statistical concepts related to sample size determination, 2) current sample size determination practices in experiments, and 3) ideal sample sizes for experiments. Subsequently, we simulated expected statistical power given the sample sizes reported in the survey. Results demonstrated that 1) while a majority of participants were somewhat familiar with statistical concepts related to sample size determination, they did not always endorse the correct and/or complete definition of each concept. Furthermore, 2) participants relied on practical considerations in determining sample sizes. Consequently, 3) the reported sample sizes did not have sufficient power to detect small to medium effect sizes, which are commonly present in psychological science. |
| first_indexed | 2024-12-11T20:44:53Z |
| format | Article |
| id | doaj.art-b5d6f774432d48fc97fb43eaabc01398 |
| institution | Directory Open Access Journal |
| issn | 2460-867X 0215-8884 |
| language | Indonesian |
| last_indexed | 2024-12-11T20:44:53Z |
| publishDate | 2019-08-01 |
| publisher | Universitas Gadjah Mada |
| record_format | Article |
| series | Jurnal Psikologi |
| spelling | doaj.art-b5d6f774432d48fc97fb43eaabc013982022-12-22T00:51:25ZindUniversitas Gadjah MadaJurnal Psikologi2460-867X0215-88842019-08-0146214516210.22146/jpsi.2426024785The Understanding on How to Determine Sample Size in Psychological Science: Data and SimulationWisnu Wiradhany0Krisna Adiasto1Jony Eko Yulianto2Indra Y. Kiling3Departemen Psikologi Eksperimen, University of GroningenProgram Research Master Behavioural Science, Radboud UniversityFakultas Psikologi, Universitas CiputraSchool of Psychology, The University of AdelaideThe lack of knowledge on how to determine sample sizes in experiments is arguably one of the main reasons underlying the replication crisis in psychological science. A survey distributed among Indonesian students and researchers concerning 1) familiarity and understanding of statistical concepts related to sample size determination, 2) current sample size determination practices in experiments, and 3) ideal sample sizes for experiments. Subsequently, we simulated expected statistical power given the sample sizes reported in the survey. Results demonstrated that 1) while a majority of participants were somewhat familiar with statistical concepts related to sample size determination, they did not always endorse the correct and/or complete definition of each concept. Furthermore, 2) participants relied on practical considerations in determining sample sizes. Consequently, 3) the reported sample sizes did not have sufficient power to detect small to medium effect sizes, which are commonly present in psychological science.https://jurnal.ugm.ac.id/jpsi/article/view/24260effect sizereplication crisissample sizestatistical power |
| spellingShingle | Wisnu Wiradhany Krisna Adiasto Jony Eko Yulianto Indra Y. Kiling The Understanding on How to Determine Sample Size in Psychological Science: Data and Simulation Jurnal Psikologi effect size replication crisis sample size statistical power |
| title | The Understanding on How to Determine Sample Size in Psychological Science: Data and Simulation |
| title_full | The Understanding on How to Determine Sample Size in Psychological Science: Data and Simulation |
| title_fullStr | The Understanding on How to Determine Sample Size in Psychological Science: Data and Simulation |
| title_full_unstemmed | The Understanding on How to Determine Sample Size in Psychological Science: Data and Simulation |
| title_short | The Understanding on How to Determine Sample Size in Psychological Science: Data and Simulation |
| title_sort | understanding on how to determine sample size in psychological science data and simulation |
| topic | effect size replication crisis sample size statistical power |
| url | https://jurnal.ugm.ac.id/jpsi/article/view/24260 |
| work_keys_str_mv | AT wisnuwiradhany theunderstandingonhowtodeterminesamplesizeinpsychologicalsciencedataandsimulation AT krisnaadiasto theunderstandingonhowtodeterminesamplesizeinpsychologicalsciencedataandsimulation AT jonyekoyulianto theunderstandingonhowtodeterminesamplesizeinpsychologicalsciencedataandsimulation AT indraykiling theunderstandingonhowtodeterminesamplesizeinpsychologicalsciencedataandsimulation AT wisnuwiradhany understandingonhowtodeterminesamplesizeinpsychologicalsciencedataandsimulation AT krisnaadiasto understandingonhowtodeterminesamplesizeinpsychologicalsciencedataandsimulation AT jonyekoyulianto understandingonhowtodeterminesamplesizeinpsychologicalsciencedataandsimulation AT indraykiling understandingonhowtodeterminesamplesizeinpsychologicalsciencedataandsimulation |