On not evaluating economic models by forecast outcomes
<p style="text-align:justify;"> Even in scientific disciplines, forecast failures occur. Four possible states of nature (a model is good or bad, and it forecasts well or badly) are examined using a forecast-error taxonomy, which traces the many possible sources of forecast errors....
Main Authors: | , |
---|---|
Format: | Working paper |
Published: |
University of Oxford
2011
|
_version_ | 1826304912967860224 |
---|---|
author | Castle, J Hendry, D |
author_facet | Castle, J Hendry, D |
author_sort | Castle, J |
collection | OXFORD |
description | <p style="text-align:justify;"> Even in scientific disciplines, forecast failures occur. Four possible states of nature (a model is good or bad, and it forecasts well or badly) are examined using a forecast-error taxonomy, which traces the many possible sources of forecast errors. This analysis shows that a valid model can forecast badly, and a poor model can forecast successfully. Delineating the main causes of forecast failure reveals transformations that can correct failure without altering the 'quality' of the model in use. We conclude that judging a model by the accuracy of its forecasts is more like fools' gold than a gold standard. </p> |
first_indexed | 2024-03-07T06:24:55Z |
format | Working paper |
id | oxford-uuid:f3f372e6-3af6-4c62-8f61-e44966476a16 |
institution | University of Oxford |
last_indexed | 2024-03-07T06:24:55Z |
publishDate | 2011 |
publisher | University of Oxford |
record_format | dspace |
spelling | oxford-uuid:f3f372e6-3af6-4c62-8f61-e44966476a162022-03-27T12:16:02ZOn not evaluating economic models by forecast outcomesWorking paperhttp://purl.org/coar/resource_type/c_8042uuid:f3f372e6-3af6-4c62-8f61-e44966476a16Symplectic Elements at OxfordUniversity of Oxford2011Castle, JHendry, D <p style="text-align:justify;"> Even in scientific disciplines, forecast failures occur. Four possible states of nature (a model is good or bad, and it forecasts well or badly) are examined using a forecast-error taxonomy, which traces the many possible sources of forecast errors. This analysis shows that a valid model can forecast badly, and a poor model can forecast successfully. Delineating the main causes of forecast failure reveals transformations that can correct failure without altering the 'quality' of the model in use. We conclude that judging a model by the accuracy of its forecasts is more like fools' gold than a gold standard. </p> |
spellingShingle | Castle, J Hendry, D On not evaluating economic models by forecast outcomes |
title | On not evaluating economic models by forecast outcomes |
title_full | On not evaluating economic models by forecast outcomes |
title_fullStr | On not evaluating economic models by forecast outcomes |
title_full_unstemmed | On not evaluating economic models by forecast outcomes |
title_short | On not evaluating economic models by forecast outcomes |
title_sort | on not evaluating economic models by forecast outcomes |
work_keys_str_mv | AT castlej onnotevaluatingeconomicmodelsbyforecastoutcomes AT hendryd onnotevaluatingeconomicmodelsbyforecastoutcomes |