Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective
A robust dialogue about the (un)reliability of psychological science findings has emerged in recent years. In response, metascience researchers have developed innovative tools to increase rigor, transparency, and reproducibility, stimulating rapid improvement and adoption of open science practices....
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
University of California Press
2020-05-01
|
| Series: | Collabra: Psychology |
| Subjects: | |
| Online Access: | https://www.collabra.org/articles/284 |
| _version_ | 1828454042189168640 |
|---|---|
| author | Hollen N. Reischer Henry R. Cowan |
| author_facet | Hollen N. Reischer Henry R. Cowan |
| author_sort | Hollen N. Reischer |
| collection | DOAJ |
| description | A robust dialogue about the (un)reliability of psychological science findings has emerged in recent years. In response, metascience researchers have developed innovative tools to increase rigor, transparency, and reproducibility, stimulating rapid improvement and adoption of open science practices. However, existing reproducibility guidelines are geared toward purely quantitative study designs. This leaves some ambiguity as to how such guidelines should be implemented in mixed methods (MM) studies, which combine quantitative and qualitative research. Drawing on extant literature, our own experiences, and feedback from 79 self-identified MM researchers, the current paper addresses two main questions: (a) how and to what extent do existing reproducibility guidelines apply to MM study designs; and (b) can existing reproducibility guidelines be improved by incorporating best practices from qualitative research and epistemology? In answer, we offer 10 key recommendations for use within and outside of MM research. Finally, we argue that good science and good ethical practice are mutually reinforcing and lead to meaningful, credible science. |
| first_indexed | 2024-12-11T00:15:46Z |
| format | Article |
| id | doaj.art-e69b08a7b1ed4b65a65eba9ed1043ea2 |
| institution | Directory Open Access Journal |
| issn | 2474-7394 |
| language | English |
| last_indexed | 2024-12-11T00:15:46Z |
| publishDate | 2020-05-01 |
| publisher | University of California Press |
| record_format | Article |
| series | Collabra: Psychology |
| spelling | doaj.art-e69b08a7b1ed4b65a65eba9ed1043ea22022-12-22T01:27:57ZengUniversity of California PressCollabra: Psychology2474-73942020-05-016110.1525/collabra.284194Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods PerspectiveHollen N. Reischer0Henry R. Cowan1Northwestern University, Evanston, IllinoisNorthwestern University, Evanston, IllinoisA robust dialogue about the (un)reliability of psychological science findings has emerged in recent years. In response, metascience researchers have developed innovative tools to increase rigor, transparency, and reproducibility, stimulating rapid improvement and adoption of open science practices. However, existing reproducibility guidelines are geared toward purely quantitative study designs. This leaves some ambiguity as to how such guidelines should be implemented in mixed methods (MM) studies, which combine quantitative and qualitative research. Drawing on extant literature, our own experiences, and feedback from 79 self-identified MM researchers, the current paper addresses two main questions: (a) how and to what extent do existing reproducibility guidelines apply to MM study designs; and (b) can existing reproducibility guidelines be improved by incorporating best practices from qualitative research and epistemology? In answer, we offer 10 key recommendations for use within and outside of MM research. Finally, we argue that good science and good ethical practice are mutually reinforcing and lead to meaningful, credible science.https://www.collabra.org/articles/284reproducibilityreplicabilitymixed methodsopen scienceethics |
| spellingShingle | Hollen N. Reischer Henry R. Cowan Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective Collabra: Psychology reproducibility replicability mixed methods open science ethics |
| title | Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective |
| title_full | Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective |
| title_fullStr | Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective |
| title_full_unstemmed | Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective |
| title_short | Quantity Over Quality? Reproducible Psychological Science from a Mixed Methods Perspective |
| title_sort | quantity over quality reproducible psychological science from a mixed methods perspective |
| topic | reproducibility replicability mixed methods open science ethics |
| url | https://www.collabra.org/articles/284 |
| work_keys_str_mv | AT hollennreischer quantityoverqualityreproduciblepsychologicalsciencefromamixedmethodsperspective AT henryrcowan quantityoverqualityreproduciblepsychologicalsciencefromamixedmethodsperspective |