On not evaluating economic models by forecast outcomes

<p style="text-align:justify;"> Even in scientific disciplines, forecast failures occur. Four possible states of nature (a model is good or bad, and it forecasts well or badly) are examined using a forecast-error taxonomy, which traces the many possible sources of forecast errors....

Full description

Bibliographic Details
Main Authors: Castle, J, Hendry, D
Format: Working paper
Published: University of Oxford 2011
_version_ 1826304912967860224
author Castle, J
Hendry, D
author_facet Castle, J
Hendry, D
author_sort Castle, J
collection OXFORD
description <p style="text-align:justify;"> Even in scientific disciplines, forecast failures occur. Four possible states of nature (a model is good or bad, and it forecasts well or badly) are examined using a forecast-error taxonomy, which traces the many possible sources of forecast errors. This analysis shows that a valid model can forecast badly, and a poor model can forecast successfully. Delineating the main causes of forecast failure reveals transformations that can correct failure without altering the 'quality' of the model in use. We conclude that judging a model by the accuracy of its forecasts is more like fools' gold than a gold standard. </p>
first_indexed 2024-03-07T06:24:55Z
format Working paper
id oxford-uuid:f3f372e6-3af6-4c62-8f61-e44966476a16
institution University of Oxford
last_indexed 2024-03-07T06:24:55Z
publishDate 2011
publisher University of Oxford
record_format dspace
spelling oxford-uuid:f3f372e6-3af6-4c62-8f61-e44966476a162022-03-27T12:16:02ZOn not evaluating economic models by forecast outcomesWorking paperhttp://purl.org/coar/resource_type/c_8042uuid:f3f372e6-3af6-4c62-8f61-e44966476a16Symplectic Elements at OxfordUniversity of Oxford2011Castle, JHendry, D <p style="text-align:justify;"> Even in scientific disciplines, forecast failures occur. Four possible states of nature (a model is good or bad, and it forecasts well or badly) are examined using a forecast-error taxonomy, which traces the many possible sources of forecast errors. This analysis shows that a valid model can forecast badly, and a poor model can forecast successfully. Delineating the main causes of forecast failure reveals transformations that can correct failure without altering the 'quality' of the model in use. We conclude that judging a model by the accuracy of its forecasts is more like fools' gold than a gold standard. </p>
spellingShingle Castle, J
Hendry, D
On not evaluating economic models by forecast outcomes
title On not evaluating economic models by forecast outcomes
title_full On not evaluating economic models by forecast outcomes
title_fullStr On not evaluating economic models by forecast outcomes
title_full_unstemmed On not evaluating economic models by forecast outcomes
title_short On not evaluating economic models by forecast outcomes
title_sort on not evaluating economic models by forecast outcomes
work_keys_str_mv AT castlej onnotevaluatingeconomicmodelsbyforecastoutcomes
AT hendryd onnotevaluatingeconomicmodelsbyforecastoutcomes