A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019)
This study replicates the paper “Brown, J. P., Lambert, D. M., & Wojan, T. R. (2019). The effect of the conservation reserve program on rural economies: deriving a statistical verdict from a null finding. American Journal of Agricultural Economics, 101(2), 528–540” and their procedure for calcul...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
De Gruyter
2023-04-01
|
| Series: | Economics: Journal Articles |
| Subjects: | |
| Online Access: | https://doi.org/10.1515/econ-2022-0036 |
| _version_ | 1797817635820273664 |
|---|---|
| author | Tian Jiarui (Alex) |
| author_facet | Tian Jiarui (Alex) |
| author_sort | Tian Jiarui (Alex) |
| collection | DOAJ |
| description | This study replicates the paper “Brown, J. P., Lambert, D. M., & Wojan, T. R. (2019). The effect of the conservation reserve program on rural economies: deriving a statistical verdict from a null finding. American Journal of Agricultural Economics, 101(2), 528–540” and their procedure for calculating the so-called ex post power of statistical tests of significance for regression coefficients. There appears no generally accepted method for calculating ex post power, and Brown, Lambert, and Wojan (BLW) provided a bootstrapping method that can be applied after the parameter of interest is estimated. They recommend researchers to use this procedure to investigate whether a statistically insignificant finding is likely to be due to a low power property of the significance test. This study makes two main contributions. First, it verifies whether the data and code that BLW provided are reliable to reproduce their results. Second, it constructs Monte Carlo experiments to assess the performance of BLW’s method. The results indicate that their method produces ex post power estimates that are relatively close to the true power values. Mean power estimates are generally unbiased, and 95% of the estimates lie within +/− 5% points of the true power. In conclusion, my replication provides further evidence of the reliability of BLW’s method. |
| first_indexed | 2024-03-13T08:56:25Z |
| format | Article |
| id | doaj.art-7086776292da4f349275e8d7357a26fd |
| institution | Directory Open Access Journal |
| issn | 1864-6042 |
| language | English |
| last_indexed | 2024-03-13T08:56:25Z |
| publishDate | 2023-04-01 |
| publisher | De Gruyter |
| record_format | Article |
| series | Economics: Journal Articles |
| spelling | doaj.art-7086776292da4f349275e8d7357a26fd2023-05-28T20:01:10ZengDe GruyterEconomics: Journal Articles1864-60422023-04-0117152854010.1515/econ-2022-0036A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019)Tian Jiarui (Alex)0Department of Economics and Finance, University of Canterbury, Christchurch, New ZealandThis study replicates the paper “Brown, J. P., Lambert, D. M., & Wojan, T. R. (2019). The effect of the conservation reserve program on rural economies: deriving a statistical verdict from a null finding. American Journal of Agricultural Economics, 101(2), 528–540” and their procedure for calculating the so-called ex post power of statistical tests of significance for regression coefficients. There appears no generally accepted method for calculating ex post power, and Brown, Lambert, and Wojan (BLW) provided a bootstrapping method that can be applied after the parameter of interest is estimated. They recommend researchers to use this procedure to investigate whether a statistically insignificant finding is likely to be due to a low power property of the significance test. This study makes two main contributions. First, it verifies whether the data and code that BLW provided are reliable to reproduce their results. Second, it constructs Monte Carlo experiments to assess the performance of BLW’s method. The results indicate that their method produces ex post power estimates that are relatively close to the true power values. Mean power estimates are generally unbiased, and 95% of the estimates lie within +/− 5% points of the true power. In conclusion, my replication provides further evidence of the reliability of BLW’s method.https://doi.org/10.1515/econ-2022-0036ex post powerstatistical insignificancemonte carlo experimentsbootstrappingreplicationc12c15c18 |
| spellingShingle | Tian Jiarui (Alex) A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019) Economics: Journal Articles ex post power statistical insignificance monte carlo experiments bootstrapping replication c12 c15 c18 |
| title | A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019) |
| title_full | A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019) |
| title_fullStr | A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019) |
| title_full_unstemmed | A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019) |
| title_short | A Replication of “The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding” (American Journal of Agricultural Economics, 2019) |
| title_sort | replication of the effect of the conservation reserve program on rural economies deriving a statistical verdict from a null finding american journal of agricultural economics 2019 |
| topic | ex post power statistical insignificance monte carlo experiments bootstrapping replication c12 c15 c18 |
| url | https://doi.org/10.1515/econ-2022-0036 |
| work_keys_str_mv | AT tianjiaruialex areplicationoftheeffectoftheconservationreserveprogramonruraleconomiesderivingastatisticalverdictfromanullfindingamericanjournalofagriculturaleconomics2019 AT tianjiaruialex replicationoftheeffectoftheconservationreserveprogramonruraleconomiesderivingastatisticalverdictfromanullfindingamericanjournalofagriculturaleconomics2019 |