Evaluation of the performance of short-term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the AusPollen Partnership project 2016–2020
When providing pollen forecasts to the community, there is a need to verify the accuracy of curated forecasts, but evaluation is not routinely reported. This study of the AusPollen Partnership compared multi-category grass pollen forecasts for up to six days ahead with daily airborne grass pollen co...
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2022-10-01
|
| Series: | Atmospheric Environment: X |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2590162122000375 |
| _version_ | 1818480170564059136 |
|---|---|
| author | K.M. Emmerson E. Addison-Smith E. Ebert A. Milic D. Vicendese E.R. Lampugnani B. Erbas D.E. Medek A. Huete P. Beggs C.H. Katelaris S.G. Haberle E. Newbigin J.M. Davies |
| author_facet | K.M. Emmerson E. Addison-Smith E. Ebert A. Milic D. Vicendese E.R. Lampugnani B. Erbas D.E. Medek A. Huete P. Beggs C.H. Katelaris S.G. Haberle E. Newbigin J.M. Davies |
| author_sort | K.M. Emmerson |
| collection | DOAJ |
| description | When providing pollen forecasts to the community, there is a need to verify the accuracy of curated forecasts, but evaluation is not routinely reported. This study of the AusPollen Partnership compared multi-category grass pollen forecasts for up to six days ahead with daily airborne grass pollen concentrations measured in Brisbane, Canberra, Melbourne, and Sydney, Australia during four pollen seasons from 2016 to 2020. The accuracy of categorical grass pollen forecasts predicting grass pollen concentrations in the high and greater, or moderate and greater categories, were assessed as often applied in meteorology using Gerrity scores, equitable threat scores, false alarm ratios, success ratios, and probability of detection of correct category. The skill of grass pollen forecasts curated by aerobiologists were compared with two retrospectively calculated naïve reference forecast methods; climatology and persistence. For Brisbane and Melbourne, high or greater grass pollen levels occurred on average 32% and 22% of days, whereas for Canberra and Sydney, there were few high days, but moderate or greater pollen levels occurred on average 26% and 19% of days, respectively. Average annual Gerrity scores for curated forecasts of high or greater improved with experience from 0.20 to 0.66 in Brisbane, and from 0.39 to 0.55 in Melbourne between 2016 and 2019. Average Gerrity Scores for moderate or greater categories in Sydney were 0.45 and 0.43 in 2016 and 2018 respectively, and in Canberra were 0.34 and 0.41, in the same years. The skill of curated forecasts was usually better than persistence forecasts, but the accuracy of the curated forecasts decreased with longer lead times. Although persistence grass pollen forecasts consistently performed better than climatologies, persistence depends on previous day pollen concentrations being available. Short-term curated daily grass pollen forecasts of the AusPollen Partnership offer useful information for people with allergic rhinitis and asthma, to help facilitate behavioural change and reduce the health burden. There is a need in Australia to extend local pollen records through sustained pollen monitoring to track climate-related changes as well as improve reliability of daily pollen forecasts. Globally, continued evaluation will enable reporting of accurate pollen forecasts to community, clinicians and government stakeholders. |
| first_indexed | 2024-12-10T11:19:52Z |
| format | Article |
| id | doaj.art-e01ca4b864ee4b339093c064ac43c630 |
| institution | Directory Open Access Journal |
| issn | 2590-1621 |
| language | English |
| last_indexed | 2024-12-10T11:19:52Z |
| publishDate | 2022-10-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Atmospheric Environment: X |
| spelling | doaj.art-e01ca4b864ee4b339093c064ac43c6302022-12-22T01:51:01ZengElsevierAtmospheric Environment: X2590-16212022-10-0115100183Evaluation of the performance of short-term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the AusPollen Partnership project 2016–2020K.M. Emmerson0E. Addison-Smith1E. Ebert2A. Milic3D. Vicendese4E.R. Lampugnani5B. Erbas6D.E. Medek7A. Huete8P. Beggs9C.H. Katelaris10S.G. Haberle11E. Newbigin12J.M. Davies13CSIRO Oceans and Atmosphere, Aspendale, 3195, Victoria, AustraliaCentre for Immunology and Infection Control and Centre for Environment, School of Biomedical Sciences, Queensland University of Technology, Herston, 4006, Queensland, AustraliaBureau of Meteorology, Melbourne, Victoria, AustraliaCentre for Immunology and Infection Control and Centre for Environment, School of Biomedical Sciences, Queensland University of Technology, Herston, 4006, Queensland, AustraliaThe Melbourne School of Population and Global Health, University of Melbourne, Parkville, 3010, Victoria, Australia; The Department of Mathematics and Statistics, La Trobe University, Bundoora, 3068, Victoria, AustraliaSchool of BioSciences, University of Melbourne, Parkville, 3010, Victoria, AustraliaSchool of Psychology and Public Health, La Trobe University, Bundoora, 3068, Victoria, AustraliaGold Coast University Hospital, 1 Hospital Boulevard, Southport, Queensland, AustraliaUniversity of Technology Sydney, Ultimo, 2007, NSW, AustraliaDepartment of Earth and Environmental Sciences, Faculty of Science and Engineering, Macquarie University, Sydney, 2109, New South Wales, AustraliaSchool of Medicine, Western Sydney University, Sydney, New South Wales, 2751, AustraliaSchool of Culture, History and Language, College of Asia and the Pacific, Australian National University, Canberra, 2601, Australian Capital Territory, Australia; ARC Centre of Excellence for Australian Biodiversity and Heritage, Australian National University, Canberra, 2601, Australian Capital Territory, AustraliaSchool of BioSciences, University of Melbourne, Parkville, 3010, Victoria, AustraliaCentre for Immunology and Infection Control and Centre for Environment, School of Biomedical Sciences, Queensland University of Technology, Herston, 4006, Queensland, Australia; Metro North Hospital and Health Service, Office of Research, Herston, 4006, Queensland, Australia; Corresponding author. School of Biomedical Sciences, Centre for Immunology and Infection Control and Centre for Environment, Queensland University of Technology, Herston, 4006, Queensland, Australia.When providing pollen forecasts to the community, there is a need to verify the accuracy of curated forecasts, but evaluation is not routinely reported. This study of the AusPollen Partnership compared multi-category grass pollen forecasts for up to six days ahead with daily airborne grass pollen concentrations measured in Brisbane, Canberra, Melbourne, and Sydney, Australia during four pollen seasons from 2016 to 2020. The accuracy of categorical grass pollen forecasts predicting grass pollen concentrations in the high and greater, or moderate and greater categories, were assessed as often applied in meteorology using Gerrity scores, equitable threat scores, false alarm ratios, success ratios, and probability of detection of correct category. The skill of grass pollen forecasts curated by aerobiologists were compared with two retrospectively calculated naïve reference forecast methods; climatology and persistence. For Brisbane and Melbourne, high or greater grass pollen levels occurred on average 32% and 22% of days, whereas for Canberra and Sydney, there were few high days, but moderate or greater pollen levels occurred on average 26% and 19% of days, respectively. Average annual Gerrity scores for curated forecasts of high or greater improved with experience from 0.20 to 0.66 in Brisbane, and from 0.39 to 0.55 in Melbourne between 2016 and 2019. Average Gerrity Scores for moderate or greater categories in Sydney were 0.45 and 0.43 in 2016 and 2018 respectively, and in Canberra were 0.34 and 0.41, in the same years. The skill of curated forecasts was usually better than persistence forecasts, but the accuracy of the curated forecasts decreased with longer lead times. Although persistence grass pollen forecasts consistently performed better than climatologies, persistence depends on previous day pollen concentrations being available. Short-term curated daily grass pollen forecasts of the AusPollen Partnership offer useful information for people with allergic rhinitis and asthma, to help facilitate behavioural change and reduce the health burden. There is a need in Australia to extend local pollen records through sustained pollen monitoring to track climate-related changes as well as improve reliability of daily pollen forecasts. Globally, continued evaluation will enable reporting of accurate pollen forecasts to community, clinicians and government stakeholders.http://www.sciencedirect.com/science/article/pii/S2590162122000375PollenAerobiologyForecast systemsEvaluationPollen concentrationsGrass pollen |
| spellingShingle | K.M. Emmerson E. Addison-Smith E. Ebert A. Milic D. Vicendese E.R. Lampugnani B. Erbas D.E. Medek A. Huete P. Beggs C.H. Katelaris S.G. Haberle E. Newbigin J.M. Davies Evaluation of the performance of short-term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the AusPollen Partnership project 2016–2020 Atmospheric Environment: X Pollen Aerobiology Forecast systems Evaluation Pollen concentrations Grass pollen |
| title | Evaluation of the performance of short-term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the AusPollen Partnership project 2016–2020 |
| title_full | Evaluation of the performance of short-term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the AusPollen Partnership project 2016–2020 |
| title_fullStr | Evaluation of the performance of short-term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the AusPollen Partnership project 2016–2020 |
| title_full_unstemmed | Evaluation of the performance of short-term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the AusPollen Partnership project 2016–2020 |
| title_short | Evaluation of the performance of short-term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the AusPollen Partnership project 2016–2020 |
| title_sort | evaluation of the performance of short term curated daily airborne grass pollen forecasts in diverse biogeographical regions during the auspollen partnership project 2016 2020 |
| topic | Pollen Aerobiology Forecast systems Evaluation Pollen concentrations Grass pollen |
| url | http://www.sciencedirect.com/science/article/pii/S2590162122000375 |
| work_keys_str_mv | AT kmemmerson evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT eaddisonsmith evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT eebert evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT amilic evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT dvicendese evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT erlampugnani evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT berbas evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT demedek evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT ahuete evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT pbeggs evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT chkatelaris evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT sghaberle evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT enewbigin evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 AT jmdavies evaluationoftheperformanceofshorttermcurateddailyairbornegrasspollenforecastsindiversebiogeographicalregionsduringtheauspollenpartnershipproject20162020 |