Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries

Abstract Background Microscale environmental features are usually evaluated using direct on-street observations. This study assessed inter-rater reliability of the Microscale Audit of Pedestrian Streetscapes, Global version (MAPS-Global), in an international context, comparing on-street with more ef...

Full description

Bibliographic Details
Main Authors: Ana Queralt, Javier Molina-García, Marta Terrón-Pérez, Ester Cerin, Anthony Barnett, Anna Timperio, Jenny Veitch, Rodrigo Reis, Alexandre Augusto Paula Silva, Ariane Ghekiere, Delfien Van Dyck, Terry L. Conway, Kelli L. Cain, Carrie M. Geremia, James F. Sallis
Format: Article
Language:English
Published: BMC 2021-01-01
Series:International Journal of Health Geographics
Subjects:
Online Access:https://doi.org/10.1186/s12942-021-00261-5
_version_ 1818930750621220864
author Ana Queralt
Javier Molina-García
Marta Terrón-Pérez
Ester Cerin
Anthony Barnett
Anna Timperio
Jenny Veitch
Rodrigo Reis
Alexandre Augusto Paula Silva
Ariane Ghekiere
Delfien Van Dyck
Terry L. Conway
Kelli L. Cain
Carrie M. Geremia
James F. Sallis
author_facet Ana Queralt
Javier Molina-García
Marta Terrón-Pérez
Ester Cerin
Anthony Barnett
Anna Timperio
Jenny Veitch
Rodrigo Reis
Alexandre Augusto Paula Silva
Ariane Ghekiere
Delfien Van Dyck
Terry L. Conway
Kelli L. Cain
Carrie M. Geremia
James F. Sallis
author_sort Ana Queralt
collection DOAJ
description Abstract Background Microscale environmental features are usually evaluated using direct on-street observations. This study assessed inter-rater reliability of the Microscale Audit of Pedestrian Streetscapes, Global version (MAPS-Global), in an international context, comparing on-street with more efficient online observation methods in five countries with varying levels of walkability. Methods Data were collected along likely walking routes of study participants, from residential starting points toward commercial clusters in Melbourne (Australia), Ghent (Belgium), Curitiba (Brazil), Hong Kong (China), and Valencia (Spain). In-person on the street and online using Google Street View audits were carried out by two independent trained raters in each city. The final sample included 349 routes, 1228 street segments, 799 crossings, and 16 cul-de-sacs. Inter-rater reliability analyses were performed using Kappa statistics or Intraclass Correlation Coefficients (ICC). Results Overall mean assessment times were the same for on-street and online evaluations (22 ± 12 min). Only a few subscales had Kappa or ICC values < 0.70, with aesthetic and social environment variables having the lowest overall reliability values, though still in the “good to excellent” category. Overall scores for each section (route, segment, crossing) showed good to excellent reliability (ICCs: 0.813, 0.929 and 0.885, respectively), and the MAPS-Global grand score had excellent reliability (ICC: 0.861) between the two methods. Conclusions MAPS-Global is a feasible and reliable instrument that can be used both on-street and online to analyze microscale environmental characteristics in diverse international urban settings.
first_indexed 2024-12-20T04:05:40Z
format Article
id doaj.art-27c148b8164d482392a35628b6956003
institution Directory Open Access Journal
issn 1476-072X
language English
last_indexed 2024-12-20T04:05:40Z
publishDate 2021-01-01
publisher BMC
record_format Article
series International Journal of Health Geographics
spelling doaj.art-27c148b8164d482392a35628b69560032022-12-21T19:54:03ZengBMCInternational Journal of Health Geographics1476-072X2021-01-0120111110.1186/s12942-021-00261-5Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countriesAna Queralt0Javier Molina-García1Marta Terrón-Pérez2Ester Cerin3Anthony Barnett4Anna Timperio5Jenny Veitch6Rodrigo Reis7Alexandre Augusto Paula Silva8Ariane Ghekiere9Delfien Van Dyck10Terry L. Conway11Kelli L. Cain12Carrie M. Geremia13James F. Sallis14Department of Nursing, University of ValenciaDepartment of Teaching of Musical, Visual and Corporal Expression, University of ValenciaDepartment of Nursing, University of ValenciaMary Mackillop Institute for Health Research, Australian Catholic UniversityMary Mackillop Institute for Health Research, Australian Catholic UniversityInstitute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin UniversityInstitute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin UniversityPrevention Research Center, Brown School, Washington University in St. LouisResearch Group on Physical Activity and Quality of Life, Pontificia Universidade Catolica do ParanaDepartment of Public Health, Ghent UniversityResearch Foundation Flanders (FWO)Department of Family Medicine and Public Health, University of California San DiegoMary Mackillop Institute for Health Research, Australian Catholic UniversityDepartment of Family Medicine and Public Health, University of California San DiegoMary Mackillop Institute for Health Research, Australian Catholic UniversityAbstract Background Microscale environmental features are usually evaluated using direct on-street observations. This study assessed inter-rater reliability of the Microscale Audit of Pedestrian Streetscapes, Global version (MAPS-Global), in an international context, comparing on-street with more efficient online observation methods in five countries with varying levels of walkability. Methods Data were collected along likely walking routes of study participants, from residential starting points toward commercial clusters in Melbourne (Australia), Ghent (Belgium), Curitiba (Brazil), Hong Kong (China), and Valencia (Spain). In-person on the street and online using Google Street View audits were carried out by two independent trained raters in each city. The final sample included 349 routes, 1228 street segments, 799 crossings, and 16 cul-de-sacs. Inter-rater reliability analyses were performed using Kappa statistics or Intraclass Correlation Coefficients (ICC). Results Overall mean assessment times were the same for on-street and online evaluations (22 ± 12 min). Only a few subscales had Kappa or ICC values < 0.70, with aesthetic and social environment variables having the lowest overall reliability values, though still in the “good to excellent” category. Overall scores for each section (route, segment, crossing) showed good to excellent reliability (ICCs: 0.813, 0.929 and 0.885, respectively), and the MAPS-Global grand score had excellent reliability (ICC: 0.861) between the two methods. Conclusions MAPS-Global is a feasible and reliable instrument that can be used both on-street and online to analyze microscale environmental characteristics in diverse international urban settings.https://doi.org/10.1186/s12942-021-00261-5Built environmentMeasurementPhysical activityDirect observationNeighborhood
spellingShingle Ana Queralt
Javier Molina-García
Marta Terrón-Pérez
Ester Cerin
Anthony Barnett
Anna Timperio
Jenny Veitch
Rodrigo Reis
Alexandre Augusto Paula Silva
Ariane Ghekiere
Delfien Van Dyck
Terry L. Conway
Kelli L. Cain
Carrie M. Geremia
James F. Sallis
Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries
International Journal of Health Geographics
Built environment
Measurement
Physical activity
Direct observation
Neighborhood
title Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries
title_full Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries
title_fullStr Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries
title_full_unstemmed Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries
title_short Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries
title_sort reliability of streetscape audits comparing on street and online observations maps global in 5 countries
topic Built environment
Measurement
Physical activity
Direct observation
Neighborhood
url https://doi.org/10.1186/s12942-021-00261-5
work_keys_str_mv AT anaqueralt reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT javiermolinagarcia reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT martaterronperez reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT estercerin reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT anthonybarnett reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT annatimperio reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT jennyveitch reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT rodrigoreis reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT alexandreaugustopaulasilva reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT arianeghekiere reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT delfienvandyck reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT terrylconway reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT kellilcain reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT carriemgeremia reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries
AT jamesfsallis reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries