Statistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand Lab
Abstract Background We present the results of a reanalysis of four articles from the Cornell Food and Brand Lab based on data collected from diners at an Italian restaurant buffet. Method We calculated whether the means, standard deviations, and test statistics were compatible with the sample size....
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2017-07-01
|
| Series: | BMC Nutrition |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s40795-017-0167-x |
| _version_ | 1818992440157143040 |
|---|---|
| author | Tim van der Zee Jordan Anaya Nicholas J. L. Brown |
| author_facet | Tim van der Zee Jordan Anaya Nicholas J. L. Brown |
| author_sort | Tim van der Zee |
| collection | DOAJ |
| description | Abstract Background We present the results of a reanalysis of four articles from the Cornell Food and Brand Lab based on data collected from diners at an Italian restaurant buffet. Method We calculated whether the means, standard deviations, and test statistics were compatible with the sample size. Test statistics and p values were recalculated. We also applied deductive logic to see whether the claims made in each article were compatible with the claims made in the others. We have so far been unable to obtain the data from the authors of the four articles. Results A thorough reading of the articles and careful reanalysis of the results revealed a wide range of problems. The sample sizes for the number of diners in each condition are incongruous both within and between the four articles. In some cases, the degrees of freedom of between-participant test statistics are larger than the sample size, which is impossible. Many of the computed F and t statistics are inconsistent with the reported means and standard deviations. In some cases, the number of possible inconsistencies for a single statistic was such that we were unable to determine which of the components of that statistic were incorrect. Our Appendix reports approximately 150 inconsistencies in these four articles, which we were able to identify from the reported statistics alone. Conclusions We hope that our analysis will encourage readers, using and extending the simple methods that we describe, to undertake their own efforts to verify published results, and that such initiatives will improve the accuracy and reproducibility of the scientific literature. We also anticipate that the editors of the journals that published these four articles may wish to consider whether any corrective action is required. |
| first_indexed | 2024-12-20T20:26:11Z |
| format | Article |
| id | doaj.art-dbb2fcdba08f4b6ea42a471aac37a9c3 |
| institution | Directory Open Access Journal |
| issn | 2055-0928 |
| language | English |
| last_indexed | 2024-12-20T20:26:11Z |
| publishDate | 2017-07-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Nutrition |
| spelling | doaj.art-dbb2fcdba08f4b6ea42a471aac37a9c32022-12-21T19:27:29ZengBMCBMC Nutrition2055-09282017-07-013111510.1186/s40795-017-0167-xStatistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand LabTim van der Zee0Jordan Anaya1Nicholas J. L. Brown2Graduate School of Teaching (ICLON)Omnes ResUniversity Medical Center, University of GroningenAbstract Background We present the results of a reanalysis of four articles from the Cornell Food and Brand Lab based on data collected from diners at an Italian restaurant buffet. Method We calculated whether the means, standard deviations, and test statistics were compatible with the sample size. Test statistics and p values were recalculated. We also applied deductive logic to see whether the claims made in each article were compatible with the claims made in the others. We have so far been unable to obtain the data from the authors of the four articles. Results A thorough reading of the articles and careful reanalysis of the results revealed a wide range of problems. The sample sizes for the number of diners in each condition are incongruous both within and between the four articles. In some cases, the degrees of freedom of between-participant test statistics are larger than the sample size, which is impossible. Many of the computed F and t statistics are inconsistent with the reported means and standard deviations. In some cases, the number of possible inconsistencies for a single statistic was such that we were unable to determine which of the components of that statistic were incorrect. Our Appendix reports approximately 150 inconsistencies in these four articles, which we were able to identify from the reported statistics alone. Conclusions We hope that our analysis will encourage readers, using and extending the simple methods that we describe, to undertake their own efforts to verify published results, and that such initiatives will improve the accuracy and reproducibility of the scientific literature. We also anticipate that the editors of the journals that published these four articles may wish to consider whether any corrective action is required.http://link.springer.com/article/10.1186/s40795-017-0167-xStatisticsReproducibilityReplicationReanalysis |
| spellingShingle | Tim van der Zee Jordan Anaya Nicholas J. L. Brown Statistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand Lab BMC Nutrition Statistics Reproducibility Replication Reanalysis |
| title | Statistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand Lab |
| title_full | Statistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand Lab |
| title_fullStr | Statistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand Lab |
| title_full_unstemmed | Statistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand Lab |
| title_short | Statistical heartburn: an attempt to digest four pizza publications from the Cornell Food and Brand Lab |
| title_sort | statistical heartburn an attempt to digest four pizza publications from the cornell food and brand lab |
| topic | Statistics Reproducibility Replication Reanalysis |
| url | http://link.springer.com/article/10.1186/s40795-017-0167-x |
| work_keys_str_mv | AT timvanderzee statisticalheartburnanattempttodigestfourpizzapublicationsfromthecornellfoodandbrandlab AT jordananaya statisticalheartburnanattempttodigestfourpizzapublicationsfromthecornellfoodandbrandlab AT nicholasjlbrown statisticalheartburnanattempttodigestfourpizzapublicationsfromthecornellfoodandbrandlab |