Evaluating the reliability and validity of secondary reporting to measure gender-based violence in conflict and disaster

Abstract Background Accurately identifying the magnitude of gender-based violence (GBV) in humanitarian settings is hindered by logistical and methodological complexities. The ‘Neighborhood Method’, an adapted household survey that uses primary and secondary reporting to assess the prevalence of GBV...

Full description

Bibliographic Details
Main Authors: Lindsay Stark, Les Roberts, Gary Yu, Timothy M. Tan, Aishwarya Nagar, Alastair Ager
Format: Article
Language:English
Published: BMC 2020-08-01
Series:Conflict and Health
Subjects:
Online Access:http://link.springer.com/article/10.1186/s13031-020-00301-0
_version_ 1817987846360793088
author Lindsay Stark
Les Roberts
Gary Yu
Timothy M. Tan
Aishwarya Nagar
Alastair Ager
author_facet Lindsay Stark
Les Roberts
Gary Yu
Timothy M. Tan
Aishwarya Nagar
Alastair Ager
author_sort Lindsay Stark
collection DOAJ
description Abstract Background Accurately identifying the magnitude of gender-based violence (GBV) in humanitarian settings is hindered by logistical and methodological complexities. The ‘Neighborhood Method’, an adapted household survey that uses primary and secondary reporting to assess the prevalence of GBV in humanitarian settings, reduces the length of time and cost associated with traditional surveys. Primary female adult respondents disclose incidents of physical violence, intimate and non-intimate partner rape for themselves, other females in their homes (standard reporting) and other women and children in their social networks (secondary reporting). This study examines the reliability and validity of this inclusion of secondary reporting to determine the comparability of the Neighborhood Method to a traditional survey approach. Methods Drawing on data from 1180 women reporting on 3744 females in respondent households and 15,086 in neighboring households across four humanitarian settings (Ethiopia/ Somalia, Liberia, Sri Lanka, and Uganda), reliability of secondary reporting was measured through intra-class correlation coefficients (ICCs) and Cohen’s kappas. Validity was assessed using two-sample z-tests for differences between standard versus secondary reporting. Results Prevalence estimates comparing a respondent’s household with a neighboring household show closer agreement (ICC: 0.999–0.986) than self-reports vs. secondary reporting on a female counterpoint in a neighboring home (ICC: 0.939–0.98). Kappa statistics analyzing the reliability of two separate neighbors reporting on a third neighbor showed moderate agreement beyond chance alone (κ = 0.45 for physical violence and 0.48 for rape). Prevalence rates corresponded between standard and secondary reports (i.e. showed no statistical difference) in 18 out of 24 compared populations. Conclusions For prevalence of GBV, secondary reporting about neighbors can serve as a useful adjunct to standard survey methodology. Findings offer important initial insights into the consistency and accuracy of secondary reporting as a tool for field epidemiologists in humanitarian settings.
first_indexed 2024-04-14T00:26:19Z
format Article
id doaj.art-4ad18c11e58742e2bc50a9577302537e
institution Directory Open Access Journal
issn 1752-1505
language English
last_indexed 2024-04-14T00:26:19Z
publishDate 2020-08-01
publisher BMC
record_format Article
series Conflict and Health
spelling doaj.art-4ad18c11e58742e2bc50a9577302537e2022-12-22T02:22:42ZengBMCConflict and Health1752-15052020-08-011411910.1186/s13031-020-00301-0Evaluating the reliability and validity of secondary reporting to measure gender-based violence in conflict and disasterLindsay Stark0Les Roberts1Gary Yu2Timothy M. Tan3Aishwarya Nagar4Alastair Ager5Brown School at Washington University in St LouisMailman School of Public HealthNYU Rory Meyers College of NursingDepartment of Emergency Medicine, New York Health + Hospitals/QueensIris Group, IncMailman School of Public HealthAbstract Background Accurately identifying the magnitude of gender-based violence (GBV) in humanitarian settings is hindered by logistical and methodological complexities. The ‘Neighborhood Method’, an adapted household survey that uses primary and secondary reporting to assess the prevalence of GBV in humanitarian settings, reduces the length of time and cost associated with traditional surveys. Primary female adult respondents disclose incidents of physical violence, intimate and non-intimate partner rape for themselves, other females in their homes (standard reporting) and other women and children in their social networks (secondary reporting). This study examines the reliability and validity of this inclusion of secondary reporting to determine the comparability of the Neighborhood Method to a traditional survey approach. Methods Drawing on data from 1180 women reporting on 3744 females in respondent households and 15,086 in neighboring households across four humanitarian settings (Ethiopia/ Somalia, Liberia, Sri Lanka, and Uganda), reliability of secondary reporting was measured through intra-class correlation coefficients (ICCs) and Cohen’s kappas. Validity was assessed using two-sample z-tests for differences between standard versus secondary reporting. Results Prevalence estimates comparing a respondent’s household with a neighboring household show closer agreement (ICC: 0.999–0.986) than self-reports vs. secondary reporting on a female counterpoint in a neighboring home (ICC: 0.939–0.98). Kappa statistics analyzing the reliability of two separate neighbors reporting on a third neighbor showed moderate agreement beyond chance alone (κ = 0.45 for physical violence and 0.48 for rape). Prevalence rates corresponded between standard and secondary reports (i.e. showed no statistical difference) in 18 out of 24 compared populations. Conclusions For prevalence of GBV, secondary reporting about neighbors can serve as a useful adjunct to standard survey methodology. Findings offer important initial insights into the consistency and accuracy of secondary reporting as a tool for field epidemiologists in humanitarian settings.http://link.springer.com/article/10.1186/s13031-020-00301-0Gender-based violenceIntimate partner violenceRapeSecondary reportingSurvey methodsNeighborhood method
spellingShingle Lindsay Stark
Les Roberts
Gary Yu
Timothy M. Tan
Aishwarya Nagar
Alastair Ager
Evaluating the reliability and validity of secondary reporting to measure gender-based violence in conflict and disaster
Conflict and Health
Gender-based violence
Intimate partner violence
Rape
Secondary reporting
Survey methods
Neighborhood method
title Evaluating the reliability and validity of secondary reporting to measure gender-based violence in conflict and disaster
title_full Evaluating the reliability and validity of secondary reporting to measure gender-based violence in conflict and disaster
title_fullStr Evaluating the reliability and validity of secondary reporting to measure gender-based violence in conflict and disaster
title_full_unstemmed Evaluating the reliability and validity of secondary reporting to measure gender-based violence in conflict and disaster
title_short Evaluating the reliability and validity of secondary reporting to measure gender-based violence in conflict and disaster
title_sort evaluating the reliability and validity of secondary reporting to measure gender based violence in conflict and disaster
topic Gender-based violence
Intimate partner violence
Rape
Secondary reporting
Survey methods
Neighborhood method
url http://link.springer.com/article/10.1186/s13031-020-00301-0
work_keys_str_mv AT lindsaystark evaluatingthereliabilityandvalidityofsecondaryreportingtomeasuregenderbasedviolenceinconflictanddisaster
AT lesroberts evaluatingthereliabilityandvalidityofsecondaryreportingtomeasuregenderbasedviolenceinconflictanddisaster
AT garyyu evaluatingthereliabilityandvalidityofsecondaryreportingtomeasuregenderbasedviolenceinconflictanddisaster
AT timothymtan evaluatingthereliabilityandvalidityofsecondaryreportingtomeasuregenderbasedviolenceinconflictanddisaster
AT aishwaryanagar evaluatingthereliabilityandvalidityofsecondaryreportingtomeasuregenderbasedviolenceinconflictanddisaster
AT alastairager evaluatingthereliabilityandvalidityofsecondaryreportingtomeasuregenderbasedviolenceinconflictanddisaster