How do accuracy and model agreement vary with versioning, scale, and landscape heterogeneity for satellite-derived vegetation maps in sagebrush steppe?

Maps of the distribution and abundance of dominant plants derived from satellite data are essential for ecological research and management, particularly in the vast semiarid shrub-steppe. Appropriate application of these maps requires an understanding of model accuracy and precision, and how it migh...

Full description

Bibliographic Details
Main Authors: Cara Applestein, Matthew J. Germino
Format: Article
Language:English
Published: Elsevier 2022-06-01
Series:Ecological Indicators
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S1470160X2200406X
_version_ 1818549961113993216
author Cara Applestein
Matthew J. Germino
author_facet Cara Applestein
Matthew J. Germino
author_sort Cara Applestein
collection DOAJ
description Maps of the distribution and abundance of dominant plants derived from satellite data are essential for ecological research and management, particularly in the vast semiarid shrub-steppe. Appropriate application of these maps requires an understanding of model accuracy and precision, and how it might vary across space, time, and different vegetation types. For a 113 k Ha burn area, we compared modeled maps of different vegetation cover types created from satellite data to ‘benchmark” models based on intensive field sampling (∼1500–2000 plots resampled annually for 5 years) for three new satellite-derived models: USDA Rangeland Analysis Platform (RAP), the USGS Rangeland Condition Monitoring Assessment and Projection (RCMAP), and USGS fractional estimate of exotic annual grass cover (USGS-fractional-EAG). We assessed out-of-sample point accuracy and asked if and how accuracy changed each year due to vegetation shifts, new images, and model improvements (i.e. model versions). We also assessed how map agreement between satellite-based and field-based models changed with scale of application, topography, and time since fire.Accuracy and map agreement varied considerably among the vegetation types and across time and space (r2 ranging from 0 to 0.53), and some of the variability was predictable. All models tended to over or underestimate cover when field-measured cover was relatively low or high, respectively, i.e. a “false moderating effect”. Accuracy was greater and improved with newer versions of RAP (+0.05 to 0.29 r2) compared to RCMAP and USGS fractional model estimates, and in some cases was greater than field-based models. Variability in map agreement tended to decrease with larger areas sampled (particularly in areas >12 km), and this scale dependency was more evident in RAP and USGS-fractional-EAG models. Creating a “fair” basis for comparison of spatial models of low-statured semiarid vegetation derived from satellite compared to field data is not trivial because scaling the field data to the scale of large satellite pixels (or downscaling satellite-based models to field scale) requires modeling and associated model uncertainty. Accuracy can vary considerably and understanding the variation can help guide application of the models to the appropriate time, place, and variables.
first_indexed 2024-12-12T08:40:05Z
format Article
id doaj.art-d32b9736ee0c4284b17ae2081895b2aa
institution Directory Open Access Journal
issn 1470-160X
language English
last_indexed 2024-12-12T08:40:05Z
publishDate 2022-06-01
publisher Elsevier
record_format Article
series Ecological Indicators
spelling doaj.art-d32b9736ee0c4284b17ae2081895b2aa2022-12-22T00:30:49ZengElsevierEcological Indicators1470-160X2022-06-01139108935How do accuracy and model agreement vary with versioning, scale, and landscape heterogeneity for satellite-derived vegetation maps in sagebrush steppe?Cara Applestein0Matthew J. Germino1Corresponding author.; U.S. Geological Survey, Forest and Rangeland Ecosystem Science Center, 230 N Collins Road, Building 4, Boise, ID 83702, United StatesU.S. Geological Survey, Forest and Rangeland Ecosystem Science Center, 230 N Collins Road, Building 4, Boise, ID 83702, United StatesMaps of the distribution and abundance of dominant plants derived from satellite data are essential for ecological research and management, particularly in the vast semiarid shrub-steppe. Appropriate application of these maps requires an understanding of model accuracy and precision, and how it might vary across space, time, and different vegetation types. For a 113 k Ha burn area, we compared modeled maps of different vegetation cover types created from satellite data to ‘benchmark” models based on intensive field sampling (∼1500–2000 plots resampled annually for 5 years) for three new satellite-derived models: USDA Rangeland Analysis Platform (RAP), the USGS Rangeland Condition Monitoring Assessment and Projection (RCMAP), and USGS fractional estimate of exotic annual grass cover (USGS-fractional-EAG). We assessed out-of-sample point accuracy and asked if and how accuracy changed each year due to vegetation shifts, new images, and model improvements (i.e. model versions). We also assessed how map agreement between satellite-based and field-based models changed with scale of application, topography, and time since fire.Accuracy and map agreement varied considerably among the vegetation types and across time and space (r2 ranging from 0 to 0.53), and some of the variability was predictable. All models tended to over or underestimate cover when field-measured cover was relatively low or high, respectively, i.e. a “false moderating effect”. Accuracy was greater and improved with newer versions of RAP (+0.05 to 0.29 r2) compared to RCMAP and USGS fractional model estimates, and in some cases was greater than field-based models. Variability in map agreement tended to decrease with larger areas sampled (particularly in areas >12 km), and this scale dependency was more evident in RAP and USGS-fractional-EAG models. Creating a “fair” basis for comparison of spatial models of low-statured semiarid vegetation derived from satellite compared to field data is not trivial because scaling the field data to the scale of large satellite pixels (or downscaling satellite-based models to field scale) requires modeling and associated model uncertainty. Accuracy can vary considerably and understanding the variation can help guide application of the models to the appropriate time, place, and variables.http://www.sciencedirect.com/science/article/pii/S1470160X2200406XVegetation mappingAccuracy assessmentRemote-sensingField monitoringWildland fireSagebrush steppe
spellingShingle Cara Applestein
Matthew J. Germino
How do accuracy and model agreement vary with versioning, scale, and landscape heterogeneity for satellite-derived vegetation maps in sagebrush steppe?
Ecological Indicators
Vegetation mapping
Accuracy assessment
Remote-sensing
Field monitoring
Wildland fire
Sagebrush steppe
title How do accuracy and model agreement vary with versioning, scale, and landscape heterogeneity for satellite-derived vegetation maps in sagebrush steppe?
title_full How do accuracy and model agreement vary with versioning, scale, and landscape heterogeneity for satellite-derived vegetation maps in sagebrush steppe?
title_fullStr How do accuracy and model agreement vary with versioning, scale, and landscape heterogeneity for satellite-derived vegetation maps in sagebrush steppe?
title_full_unstemmed How do accuracy and model agreement vary with versioning, scale, and landscape heterogeneity for satellite-derived vegetation maps in sagebrush steppe?
title_short How do accuracy and model agreement vary with versioning, scale, and landscape heterogeneity for satellite-derived vegetation maps in sagebrush steppe?
title_sort how do accuracy and model agreement vary with versioning scale and landscape heterogeneity for satellite derived vegetation maps in sagebrush steppe
topic Vegetation mapping
Accuracy assessment
Remote-sensing
Field monitoring
Wildland fire
Sagebrush steppe
url http://www.sciencedirect.com/science/article/pii/S1470160X2200406X
work_keys_str_mv AT caraapplestein howdoaccuracyandmodelagreementvarywithversioningscaleandlandscapeheterogeneityforsatellitederivedvegetationmapsinsagebrushsteppe
AT matthewjgermino howdoaccuracyandmodelagreementvarywithversioningscaleandlandscapeheterogeneityforsatellitederivedvegetationmapsinsagebrushsteppe