Evaluating quantile-bounded and expectile-bounded interval forecasts
In many different contexts, decision making is improved by the availability of probabilistic predictions. The accuracy of probabilistic forecasting methods can be compared using scoring functions, and insight provided by calibration tests. These tests evaluate the consistency of predictions with the...
| Main Author: | |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Elsevier
2020
|
| _version_ | 1826308623494545408 |
|---|---|
| author | Taylor, J |
| author_facet | Taylor, J |
| author_sort | Taylor, J |
| collection | OXFORD |
| description | In many different contexts, decision making is improved by the availability of probabilistic predictions. The accuracy of probabilistic forecasting methods can be compared using scoring functions, and insight provided by calibration tests. These tests evaluate the consistency of predictions with the observations. Our main agenda in this paper is interval forecasts and their evaluation. Such forecasts are usually bounded by two quantile forecasts. However, a limitation of quantiles is that they convey no information regarding the size of potential exceedances. By contrast, the location of an expectile is dictated by the whole distribution. This prompts us to propose expectile-bounded intervals. We provide interpretation, a consistent scoring function and a calibration test. Before doing this, we reflect on the evaluation of forecasts of quantile bounded intervals and expectiles, and suggest extensions of previously proposed calibration
tests in order to guard against strategic forecasting. We illustrate ideas using day-ahead electricity price forecasting. |
| first_indexed | 2024-03-07T07:22:04Z |
| format | Journal article |
| id | oxford-uuid:f390813b-ae3a-4683-8027-3a80508c92af |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T07:22:04Z |
| publishDate | 2020 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | oxford-uuid:f390813b-ae3a-4683-8027-3a80508c92af2022-10-14T09:35:32ZEvaluating quantile-bounded and expectile-bounded interval forecastsJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:f390813b-ae3a-4683-8027-3a80508c92afEnglishSymplectic ElementsElsevier2020Taylor, JIn many different contexts, decision making is improved by the availability of probabilistic predictions. The accuracy of probabilistic forecasting methods can be compared using scoring functions, and insight provided by calibration tests. These tests evaluate the consistency of predictions with the observations. Our main agenda in this paper is interval forecasts and their evaluation. Such forecasts are usually bounded by two quantile forecasts. However, a limitation of quantiles is that they convey no information regarding the size of potential exceedances. By contrast, the location of an expectile is dictated by the whole distribution. This prompts us to propose expectile-bounded intervals. We provide interpretation, a consistent scoring function and a calibration test. Before doing this, we reflect on the evaluation of forecasts of quantile bounded intervals and expectiles, and suggest extensions of previously proposed calibration tests in order to guard against strategic forecasting. We illustrate ideas using day-ahead electricity price forecasting. |
| spellingShingle | Taylor, J Evaluating quantile-bounded and expectile-bounded interval forecasts |
| title | Evaluating quantile-bounded and expectile-bounded interval forecasts |
| title_full | Evaluating quantile-bounded and expectile-bounded interval forecasts |
| title_fullStr | Evaluating quantile-bounded and expectile-bounded interval forecasts |
| title_full_unstemmed | Evaluating quantile-bounded and expectile-bounded interval forecasts |
| title_short | Evaluating quantile-bounded and expectile-bounded interval forecasts |
| title_sort | evaluating quantile bounded and expectile bounded interval forecasts |
| work_keys_str_mv | AT taylorj evaluatingquantileboundedandexpectileboundedintervalforecasts |