Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries
Abstract Background Microscale environmental features are usually evaluated using direct on-street observations. This study assessed inter-rater reliability of the Microscale Audit of Pedestrian Streetscapes, Global version (MAPS-Global), in an international context, comparing on-street with more ef...
Main Authors: | , , , , , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2021-01-01
|
Series: | International Journal of Health Geographics |
Subjects: | |
Online Access: | https://doi.org/10.1186/s12942-021-00261-5 |
_version_ | 1818930750621220864 |
---|---|
author | Ana Queralt Javier Molina-García Marta Terrón-Pérez Ester Cerin Anthony Barnett Anna Timperio Jenny Veitch Rodrigo Reis Alexandre Augusto Paula Silva Ariane Ghekiere Delfien Van Dyck Terry L. Conway Kelli L. Cain Carrie M. Geremia James F. Sallis |
author_facet | Ana Queralt Javier Molina-García Marta Terrón-Pérez Ester Cerin Anthony Barnett Anna Timperio Jenny Veitch Rodrigo Reis Alexandre Augusto Paula Silva Ariane Ghekiere Delfien Van Dyck Terry L. Conway Kelli L. Cain Carrie M. Geremia James F. Sallis |
author_sort | Ana Queralt |
collection | DOAJ |
description | Abstract Background Microscale environmental features are usually evaluated using direct on-street observations. This study assessed inter-rater reliability of the Microscale Audit of Pedestrian Streetscapes, Global version (MAPS-Global), in an international context, comparing on-street with more efficient online observation methods in five countries with varying levels of walkability. Methods Data were collected along likely walking routes of study participants, from residential starting points toward commercial clusters in Melbourne (Australia), Ghent (Belgium), Curitiba (Brazil), Hong Kong (China), and Valencia (Spain). In-person on the street and online using Google Street View audits were carried out by two independent trained raters in each city. The final sample included 349 routes, 1228 street segments, 799 crossings, and 16 cul-de-sacs. Inter-rater reliability analyses were performed using Kappa statistics or Intraclass Correlation Coefficients (ICC). Results Overall mean assessment times were the same for on-street and online evaluations (22 ± 12 min). Only a few subscales had Kappa or ICC values < 0.70, with aesthetic and social environment variables having the lowest overall reliability values, though still in the “good to excellent” category. Overall scores for each section (route, segment, crossing) showed good to excellent reliability (ICCs: 0.813, 0.929 and 0.885, respectively), and the MAPS-Global grand score had excellent reliability (ICC: 0.861) between the two methods. Conclusions MAPS-Global is a feasible and reliable instrument that can be used both on-street and online to analyze microscale environmental characteristics in diverse international urban settings. |
first_indexed | 2024-12-20T04:05:40Z |
format | Article |
id | doaj.art-27c148b8164d482392a35628b6956003 |
institution | Directory Open Access Journal |
issn | 1476-072X |
language | English |
last_indexed | 2024-12-20T04:05:40Z |
publishDate | 2021-01-01 |
publisher | BMC |
record_format | Article |
series | International Journal of Health Geographics |
spelling | doaj.art-27c148b8164d482392a35628b69560032022-12-21T19:54:03ZengBMCInternational Journal of Health Geographics1476-072X2021-01-0120111110.1186/s12942-021-00261-5Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countriesAna Queralt0Javier Molina-García1Marta Terrón-Pérez2Ester Cerin3Anthony Barnett4Anna Timperio5Jenny Veitch6Rodrigo Reis7Alexandre Augusto Paula Silva8Ariane Ghekiere9Delfien Van Dyck10Terry L. Conway11Kelli L. Cain12Carrie M. Geremia13James F. Sallis14Department of Nursing, University of ValenciaDepartment of Teaching of Musical, Visual and Corporal Expression, University of ValenciaDepartment of Nursing, University of ValenciaMary Mackillop Institute for Health Research, Australian Catholic UniversityMary Mackillop Institute for Health Research, Australian Catholic UniversityInstitute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin UniversityInstitute for Physical Activity and Nutrition (IPAN), School of Exercise and Nutrition Sciences, Deakin UniversityPrevention Research Center, Brown School, Washington University in St. LouisResearch Group on Physical Activity and Quality of Life, Pontificia Universidade Catolica do ParanaDepartment of Public Health, Ghent UniversityResearch Foundation Flanders (FWO)Department of Family Medicine and Public Health, University of California San DiegoMary Mackillop Institute for Health Research, Australian Catholic UniversityDepartment of Family Medicine and Public Health, University of California San DiegoMary Mackillop Institute for Health Research, Australian Catholic UniversityAbstract Background Microscale environmental features are usually evaluated using direct on-street observations. This study assessed inter-rater reliability of the Microscale Audit of Pedestrian Streetscapes, Global version (MAPS-Global), in an international context, comparing on-street with more efficient online observation methods in five countries with varying levels of walkability. Methods Data were collected along likely walking routes of study participants, from residential starting points toward commercial clusters in Melbourne (Australia), Ghent (Belgium), Curitiba (Brazil), Hong Kong (China), and Valencia (Spain). In-person on the street and online using Google Street View audits were carried out by two independent trained raters in each city. The final sample included 349 routes, 1228 street segments, 799 crossings, and 16 cul-de-sacs. Inter-rater reliability analyses were performed using Kappa statistics or Intraclass Correlation Coefficients (ICC). Results Overall mean assessment times were the same for on-street and online evaluations (22 ± 12 min). Only a few subscales had Kappa or ICC values < 0.70, with aesthetic and social environment variables having the lowest overall reliability values, though still in the “good to excellent” category. Overall scores for each section (route, segment, crossing) showed good to excellent reliability (ICCs: 0.813, 0.929 and 0.885, respectively), and the MAPS-Global grand score had excellent reliability (ICC: 0.861) between the two methods. Conclusions MAPS-Global is a feasible and reliable instrument that can be used both on-street and online to analyze microscale environmental characteristics in diverse international urban settings.https://doi.org/10.1186/s12942-021-00261-5Built environmentMeasurementPhysical activityDirect observationNeighborhood |
spellingShingle | Ana Queralt Javier Molina-García Marta Terrón-Pérez Ester Cerin Anthony Barnett Anna Timperio Jenny Veitch Rodrigo Reis Alexandre Augusto Paula Silva Ariane Ghekiere Delfien Van Dyck Terry L. Conway Kelli L. Cain Carrie M. Geremia James F. Sallis Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries International Journal of Health Geographics Built environment Measurement Physical activity Direct observation Neighborhood |
title | Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries |
title_full | Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries |
title_fullStr | Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries |
title_full_unstemmed | Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries |
title_short | Reliability of streetscape audits comparing on‐street and online observations: MAPS-Global in 5 countries |
title_sort | reliability of streetscape audits comparing on street and online observations maps global in 5 countries |
topic | Built environment Measurement Physical activity Direct observation Neighborhood |
url | https://doi.org/10.1186/s12942-021-00261-5 |
work_keys_str_mv | AT anaqueralt reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT javiermolinagarcia reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT martaterronperez reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT estercerin reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT anthonybarnett reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT annatimperio reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT jennyveitch reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT rodrigoreis reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT alexandreaugustopaulasilva reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT arianeghekiere reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT delfienvandyck reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT terrylconway reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT kellilcain reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT carriemgeremia reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries AT jamesfsallis reliabilityofstreetscapeauditscomparingonstreetandonlineobservationsmapsglobalin5countries |