Avalanche size estimation and avalanche outline determination by experts: reliability and implications for practice
<p>Consistent estimates of avalanche size are crucial for communicating not only among avalanche practitioners but also between avalanche forecasters and the public, for instance in public avalanche forecasts. Moreover, applications such as risk management and numerical avalanche simulations r...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2023-08-01
|
| Series: | Natural Hazards and Earth System Sciences |
| Online Access: | https://nhess.copernicus.org/articles/23/2895/2023/nhess-23-2895-2023.pdf |
| _version_ | 1827855885096976384 |
|---|---|
| author | E. D. Hafner E. D. Hafner E. D. Hafner F. Techel R. C. Daudt J. D. Wegner J. D. Wegner K. Schindler Y. Bühler Y. Bühler |
| author_facet | E. D. Hafner E. D. Hafner E. D. Hafner F. Techel R. C. Daudt J. D. Wegner J. D. Wegner K. Schindler Y. Bühler Y. Bühler |
| author_sort | E. D. Hafner |
| collection | DOAJ |
| description | <p>Consistent estimates of avalanche size are crucial for communicating not only among avalanche practitioners but also between avalanche forecasters and the public, for instance in public avalanche forecasts. Moreover, applications such as risk management and numerical avalanche simulations rely on accurately mapped outlines of past avalanche events. Since there is not a widely applicable and objective way to measure avalanche size or to determine the outlines of an avalanche, we need to rely on human estimations. Therefore, knowing about the reliability of avalanche size estimates and avalanche outlines is essential as errors will impact applications relying on this kind of data. In the first of three user studies, we investigate the reliability in avalanche size estimates by comparing estimates for 10 avalanches made by 170 avalanche professionals working in Europe or North America. In the other two studies, both completed as pilot studies, we explore reliability in the mappings of six avalanches from oblique photographs from 10 participants and the mappings of avalanches visible on 2.9 km<span class="inline-formula"><sup>2</sup></span> of remotely sensed imagery in four different spatial resolutions from 5 participants.
We observed an average agreement of 66 % in the most frequently given avalanche size, while agreement with the avalanche size considered “correct” was 74 %. Moreover, European avalanche practitioners rated avalanches significantly larger for 8 out of 10 avalanches, compared to North Americans. Assuming that participants are equally competent in the estimation of avalanche size, we calculated a score describing the factor required to obtain the observed agreement rate between any two size estimates. This factor was 0.72 in our dataset. It can be regarded as the certainty related to a size estimate by an individual and thus provides an indication of the reliability of a label. For the outlines mapped from oblique photographs, we noted a mean overlapping proportion of 52 % for any two avalanche mappings and 60 % compared to a reference mapping. The outlines mapped from remotely sensed imagery had a mean overlapping proportion of 46 % (image resolution of 2 m) to 68 % (25 <span class="inline-formula">cm</span>) between any two mappings and 64 % (2 m) to 80 % (25 <span class="inline-formula">cm</span>) when compared to the reference.
The presented findings demonstrate that the reliability of size estimates and of mapped avalanche outlines is limited. As these data are often used as reference data or even ground truth to validate further applications, the identified limitations and uncertainties may influence results and should be considered.</p> |
| first_indexed | 2024-03-12T12:16:21Z |
| format | Article |
| id | doaj.art-0ec65682a18347c38dccfc28d282e25b |
| institution | Directory Open Access Journal |
| issn | 1561-8633 1684-9981 |
| language | English |
| last_indexed | 2024-03-12T12:16:21Z |
| publishDate | 2023-08-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | Natural Hazards and Earth System Sciences |
| spelling | doaj.art-0ec65682a18347c38dccfc28d282e25b2023-08-30T10:42:05ZengCopernicus PublicationsNatural Hazards and Earth System Sciences1561-86331684-99812023-08-01232895291410.5194/nhess-23-2895-2023Avalanche size estimation and avalanche outline determination by experts: reliability and implications for practiceE. D. Hafner0E. D. Hafner1E. D. Hafner2F. Techel3R. C. Daudt4J. D. Wegner5J. D. Wegner6K. Schindler7Y. Bühler8Y. Bühler9WSL Institute for Snow and Avalanche Research SLF, Davos Dorf, 7260, SwitzerlandClimate Change, Extremes, and Natural Hazards in Alpine Regions Research Center CERC, Davos Dorf, 7260, SwitzerlandEcoVision Lab, Photogrammetry and Remote Sensing, ETH Zurich, Zurich, 8093, SwitzerlandWSL Institute for Snow and Avalanche Research SLF, Davos Dorf, 7260, SwitzerlandEcoVision Lab, Photogrammetry and Remote Sensing, ETH Zurich, Zurich, 8093, SwitzerlandEcoVision Lab, Photogrammetry and Remote Sensing, ETH Zurich, Zurich, 8093, SwitzerlandInstitute for Computational Science, University of Zurich, Zurich, 8057, SwitzerlandEcoVision Lab, Photogrammetry and Remote Sensing, ETH Zurich, Zurich, 8093, SwitzerlandWSL Institute for Snow and Avalanche Research SLF, Davos Dorf, 7260, SwitzerlandClimate Change, Extremes, and Natural Hazards in Alpine Regions Research Center CERC, Davos Dorf, 7260, Switzerland<p>Consistent estimates of avalanche size are crucial for communicating not only among avalanche practitioners but also between avalanche forecasters and the public, for instance in public avalanche forecasts. Moreover, applications such as risk management and numerical avalanche simulations rely on accurately mapped outlines of past avalanche events. Since there is not a widely applicable and objective way to measure avalanche size or to determine the outlines of an avalanche, we need to rely on human estimations. Therefore, knowing about the reliability of avalanche size estimates and avalanche outlines is essential as errors will impact applications relying on this kind of data. In the first of three user studies, we investigate the reliability in avalanche size estimates by comparing estimates for 10 avalanches made by 170 avalanche professionals working in Europe or North America. In the other two studies, both completed as pilot studies, we explore reliability in the mappings of six avalanches from oblique photographs from 10 participants and the mappings of avalanches visible on 2.9 km<span class="inline-formula"><sup>2</sup></span> of remotely sensed imagery in four different spatial resolutions from 5 participants. We observed an average agreement of 66 % in the most frequently given avalanche size, while agreement with the avalanche size considered “correct” was 74 %. Moreover, European avalanche practitioners rated avalanches significantly larger for 8 out of 10 avalanches, compared to North Americans. Assuming that participants are equally competent in the estimation of avalanche size, we calculated a score describing the factor required to obtain the observed agreement rate between any two size estimates. This factor was 0.72 in our dataset. It can be regarded as the certainty related to a size estimate by an individual and thus provides an indication of the reliability of a label. For the outlines mapped from oblique photographs, we noted a mean overlapping proportion of 52 % for any two avalanche mappings and 60 % compared to a reference mapping. The outlines mapped from remotely sensed imagery had a mean overlapping proportion of 46 % (image resolution of 2 m) to 68 % (25 <span class="inline-formula">cm</span>) between any two mappings and 64 % (2 m) to 80 % (25 <span class="inline-formula">cm</span>) when compared to the reference. The presented findings demonstrate that the reliability of size estimates and of mapped avalanche outlines is limited. As these data are often used as reference data or even ground truth to validate further applications, the identified limitations and uncertainties may influence results and should be considered.</p>https://nhess.copernicus.org/articles/23/2895/2023/nhess-23-2895-2023.pdf |
| spellingShingle | E. D. Hafner E. D. Hafner E. D. Hafner F. Techel R. C. Daudt J. D. Wegner J. D. Wegner K. Schindler Y. Bühler Y. Bühler Avalanche size estimation and avalanche outline determination by experts: reliability and implications for practice Natural Hazards and Earth System Sciences |
| title | Avalanche size estimation and avalanche outline determination by experts: reliability and implications for practice |
| title_full | Avalanche size estimation and avalanche outline determination by experts: reliability and implications for practice |
| title_fullStr | Avalanche size estimation and avalanche outline determination by experts: reliability and implications for practice |
| title_full_unstemmed | Avalanche size estimation and avalanche outline determination by experts: reliability and implications for practice |
| title_short | Avalanche size estimation and avalanche outline determination by experts: reliability and implications for practice |
| title_sort | avalanche size estimation and avalanche outline determination by experts reliability and implications for practice |
| url | https://nhess.copernicus.org/articles/23/2895/2023/nhess-23-2895-2023.pdf |
| work_keys_str_mv | AT edhafner avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT edhafner avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT edhafner avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT ftechel avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT rcdaudt avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT jdwegner avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT jdwegner avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT kschindler avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT ybuhler avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice AT ybuhler avalanchesizeestimationandavalancheoutlinedeterminationbyexpertsreliabilityandimplicationsforpractice |