Pauci ex tanto numero: reduce redundancy in multi-model ensembles
We explicitly address the fundamental issue of member diversity in multi-model ensembles. To date, no attempts in this direction have been documented within the air quality (AQ) community despite the extensive use of ensembles in this field. <i>Common biases</i> and <i>redundancy&l...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2013-08-01
|
| Series: | Atmospheric Chemistry and Physics |
| Online Access: | http://www.atmos-chem-phys.net/13/8315/2013/acp-13-8315-2013.pdf |
| _version_ | 1818033845072560128 |
|---|---|
| author | E. Solazzo A. Riccio I. Kioutsioukis S. Galmarini |
| author_facet | E. Solazzo A. Riccio I. Kioutsioukis S. Galmarini |
| author_sort | E. Solazzo |
| collection | DOAJ |
| description | We explicitly address the fundamental issue of member diversity in multi-model ensembles. To date, no attempts in this direction have been documented within the air quality (AQ) community despite the extensive use of ensembles in this field. <i>Common biases</i> and <i>redundancy</i> are the two issues directly deriving from lack of independence, undermining the significance of a multi-model ensemble, and are the subject of this study. Shared, dependant biases among models do not cancel out but will instead determine a biased ensemble. Redundancy derives from having too large a portion of common variance among the members of the ensemble, producing overconfidence in the predictions and underestimation of the uncertainty. The two issues of common biases and redundancy are analysed in detail using the AQMEII ensemble of AQ model results for four air pollutants in two European regions. We show that models share large portions of bias and variance, extending well beyond those induced by common inputs. We make use of several techniques to further show that subsets of models can explain the same amount of variance as the full ensemble with the advantage of being poorly correlated. Selecting the members for generating skilful, non-redundant ensembles from such subsets proved, however, non-trivial. We propose and discuss various methods of member selection and rate the ensemble performance they produce. In most cases, the full ensemble is outscored by the reduced ones. We conclude that, although independence of outputs may not always guarantee enhancement of scores (but this depends upon the skill being investigated), we discourage selecting the members of the ensemble simply on the basis of scores; that is, independence and skills need to be considered disjointly. |
| first_indexed | 2024-12-10T06:29:44Z |
| format | Article |
| id | doaj.art-d9cc99075cd244148f060956b331dd19 |
| institution | Directory Open Access Journal |
| issn | 1680-7316 1680-7324 |
| language | English |
| last_indexed | 2024-12-10T06:29:44Z |
| publishDate | 2013-08-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | Atmospheric Chemistry and Physics |
| spelling | doaj.art-d9cc99075cd244148f060956b331dd192022-12-22T01:59:08ZengCopernicus PublicationsAtmospheric Chemistry and Physics1680-73161680-73242013-08-0113168315833310.5194/acp-13-8315-2013Pauci ex tanto numero: reduce redundancy in multi-model ensemblesE. SolazzoA. RiccioI. KioutsioukisS. GalmariniWe explicitly address the fundamental issue of member diversity in multi-model ensembles. To date, no attempts in this direction have been documented within the air quality (AQ) community despite the extensive use of ensembles in this field. <i>Common biases</i> and <i>redundancy</i> are the two issues directly deriving from lack of independence, undermining the significance of a multi-model ensemble, and are the subject of this study. Shared, dependant biases among models do not cancel out but will instead determine a biased ensemble. Redundancy derives from having too large a portion of common variance among the members of the ensemble, producing overconfidence in the predictions and underestimation of the uncertainty. The two issues of common biases and redundancy are analysed in detail using the AQMEII ensemble of AQ model results for four air pollutants in two European regions. We show that models share large portions of bias and variance, extending well beyond those induced by common inputs. We make use of several techniques to further show that subsets of models can explain the same amount of variance as the full ensemble with the advantage of being poorly correlated. Selecting the members for generating skilful, non-redundant ensembles from such subsets proved, however, non-trivial. We propose and discuss various methods of member selection and rate the ensemble performance they produce. In most cases, the full ensemble is outscored by the reduced ones. We conclude that, although independence of outputs may not always guarantee enhancement of scores (but this depends upon the skill being investigated), we discourage selecting the members of the ensemble simply on the basis of scores; that is, independence and skills need to be considered disjointly.http://www.atmos-chem-phys.net/13/8315/2013/acp-13-8315-2013.pdf |
| spellingShingle | E. Solazzo A. Riccio I. Kioutsioukis S. Galmarini Pauci ex tanto numero: reduce redundancy in multi-model ensembles Atmospheric Chemistry and Physics |
| title | Pauci ex tanto numero: reduce redundancy in multi-model ensembles |
| title_full | Pauci ex tanto numero: reduce redundancy in multi-model ensembles |
| title_fullStr | Pauci ex tanto numero: reduce redundancy in multi-model ensembles |
| title_full_unstemmed | Pauci ex tanto numero: reduce redundancy in multi-model ensembles |
| title_short | Pauci ex tanto numero: reduce redundancy in multi-model ensembles |
| title_sort | pauci ex tanto numero reduce redundancy in multi model ensembles |
| url | http://www.atmos-chem-phys.net/13/8315/2013/acp-13-8315-2013.pdf |
| work_keys_str_mv | AT esolazzo pauciextantonumeroreduceredundancyinmultimodelensembles AT ariccio pauciextantonumeroreduceredundancyinmultimodelensembles AT ikioutsioukis pauciextantonumeroreduceredundancyinmultimodelensembles AT sgalmarini pauciextantonumeroreduceredundancyinmultimodelensembles |