Assessing Bias in Population Size Estimates Among Hidden Populations When Using the Service Multiplier Method Combined With Respondent-Driven Sampling Surveys: Survey Study
BackgroundPopulation size estimates (PSEs) for hidden populations at increased risk of HIV, including female sex workers (FSWs), are important to inform public health policy and resource allocation. The service multiplier method (SMM) is commonly used to estimate the sizes of hidden populations. We...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2020-06-01
|
| Series: | JMIR Public Health and Surveillance |
| Online Access: | http://publichealth.jmir.org/2020/2/e15044/ |
| _version_ | 1818565694455808000 |
|---|---|
| author | Chabata, Sungai T Fearon, Elizabeth Webb, Emily L Weiss, Helen A Hargreaves, James R Cowan, Frances M |
| author_facet | Chabata, Sungai T Fearon, Elizabeth Webb, Emily L Weiss, Helen A Hargreaves, James R Cowan, Frances M |
| author_sort | Chabata, Sungai T |
| collection | DOAJ |
| description | BackgroundPopulation size estimates (PSEs) for hidden populations at increased risk of HIV, including female sex workers (FSWs), are important to inform public health policy and resource allocation. The service multiplier method (SMM) is commonly used to estimate the sizes of hidden populations. We used this method to obtain PSEs for FSWs at 9 sites in Zimbabwe and explored methods for assessing potential biases that could arise in using this approach.
ObjectiveThis study aimed to guide the assessment of biases that arise when estimating the population sizes of hidden populations using the SMM combined with respondent-driven sampling (RDS) surveys.
MethodsWe conducted RDS surveys at 9 sites in late 2013, where the Sisters with a Voice program (the program), which collects program visit data of FSWs, was also present. Using the SMM, we obtained PSEs for FSWs at each site by dividing the number of FSWs who attended the program, based on program records, by the RDS-II weighted proportion of FSWs who reported attending this program in the previous 6 months in the RDS surveys. Both the RDS weighting and SMM make a number of assumptions, potentially leading to biases if the assumptions are not met. To test these assumptions, we used convergence and bottleneck plots to assess seed dependence of RDS-II proportion estimates, chi-square tests to assess if there was an association between the characteristics of FSWs and their knowledge of program existence, and logistic regression to compare the characteristics of FSWs attending the program with those recruited to RDS surveys.
ResultsThe PSEs ranged from 194 (95% CI 62-325) to 805 (95% CI 456-1142) across 9 sites from May to November 2013. The 95% CIs for the majority of sites were wide. In some sites, the RDS-II proportion of women who reported program use in the RDS surveys may have been influenced by the characteristics of selected seeds, and we also observed bottlenecks in some sites. There was no evidence of association between characteristics of FSWs and knowledge of program existence, and in the majority of sites, there was no evidence that the characteristics of the populations differed between RDS and program data.
ConclusionsWe used a series of rigorous methods to explore potential biases in our PSEs. We were able to identify the biases and their potential direction, but we could not determine the ultimate direction of these biases in our PSEs. We have evidence that the PSEs in most sites may be biased and a suggestion that the bias is toward underestimation, and this should be considered if the PSEs are to be used. These tests for bias should be included when undertaking population size estimation using the SMM combined with RDS surveys. |
| first_indexed | 2024-12-14T01:44:25Z |
| format | Article |
| id | doaj.art-099c4a38fc354a60a66cbfc1da938a47 |
| institution | Directory Open Access Journal |
| issn | 2369-2960 |
| language | English |
| last_indexed | 2024-12-14T01:44:25Z |
| publishDate | 2020-06-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Public Health and Surveillance |
| spelling | doaj.art-099c4a38fc354a60a66cbfc1da938a472022-12-21T23:21:37ZengJMIR PublicationsJMIR Public Health and Surveillance2369-29602020-06-0162e1504410.2196/15044Assessing Bias in Population Size Estimates Among Hidden Populations When Using the Service Multiplier Method Combined With Respondent-Driven Sampling Surveys: Survey StudyChabata, Sungai TFearon, ElizabethWebb, Emily LWeiss, Helen AHargreaves, James RCowan, Frances MBackgroundPopulation size estimates (PSEs) for hidden populations at increased risk of HIV, including female sex workers (FSWs), are important to inform public health policy and resource allocation. The service multiplier method (SMM) is commonly used to estimate the sizes of hidden populations. We used this method to obtain PSEs for FSWs at 9 sites in Zimbabwe and explored methods for assessing potential biases that could arise in using this approach. ObjectiveThis study aimed to guide the assessment of biases that arise when estimating the population sizes of hidden populations using the SMM combined with respondent-driven sampling (RDS) surveys. MethodsWe conducted RDS surveys at 9 sites in late 2013, where the Sisters with a Voice program (the program), which collects program visit data of FSWs, was also present. Using the SMM, we obtained PSEs for FSWs at each site by dividing the number of FSWs who attended the program, based on program records, by the RDS-II weighted proportion of FSWs who reported attending this program in the previous 6 months in the RDS surveys. Both the RDS weighting and SMM make a number of assumptions, potentially leading to biases if the assumptions are not met. To test these assumptions, we used convergence and bottleneck plots to assess seed dependence of RDS-II proportion estimates, chi-square tests to assess if there was an association between the characteristics of FSWs and their knowledge of program existence, and logistic regression to compare the characteristics of FSWs attending the program with those recruited to RDS surveys. ResultsThe PSEs ranged from 194 (95% CI 62-325) to 805 (95% CI 456-1142) across 9 sites from May to November 2013. The 95% CIs for the majority of sites were wide. In some sites, the RDS-II proportion of women who reported program use in the RDS surveys may have been influenced by the characteristics of selected seeds, and we also observed bottlenecks in some sites. There was no evidence of association between characteristics of FSWs and knowledge of program existence, and in the majority of sites, there was no evidence that the characteristics of the populations differed between RDS and program data. ConclusionsWe used a series of rigorous methods to explore potential biases in our PSEs. We were able to identify the biases and their potential direction, but we could not determine the ultimate direction of these biases in our PSEs. We have evidence that the PSEs in most sites may be biased and a suggestion that the bias is toward underestimation, and this should be considered if the PSEs are to be used. These tests for bias should be included when undertaking population size estimation using the SMM combined with RDS surveys.http://publichealth.jmir.org/2020/2/e15044/ |
| spellingShingle | Chabata, Sungai T Fearon, Elizabeth Webb, Emily L Weiss, Helen A Hargreaves, James R Cowan, Frances M Assessing Bias in Population Size Estimates Among Hidden Populations When Using the Service Multiplier Method Combined With Respondent-Driven Sampling Surveys: Survey Study JMIR Public Health and Surveillance |
| title | Assessing Bias in Population Size Estimates Among Hidden Populations When Using the Service Multiplier Method Combined With Respondent-Driven Sampling Surveys: Survey Study |
| title_full | Assessing Bias in Population Size Estimates Among Hidden Populations When Using the Service Multiplier Method Combined With Respondent-Driven Sampling Surveys: Survey Study |
| title_fullStr | Assessing Bias in Population Size Estimates Among Hidden Populations When Using the Service Multiplier Method Combined With Respondent-Driven Sampling Surveys: Survey Study |
| title_full_unstemmed | Assessing Bias in Population Size Estimates Among Hidden Populations When Using the Service Multiplier Method Combined With Respondent-Driven Sampling Surveys: Survey Study |
| title_short | Assessing Bias in Population Size Estimates Among Hidden Populations When Using the Service Multiplier Method Combined With Respondent-Driven Sampling Surveys: Survey Study |
| title_sort | assessing bias in population size estimates among hidden populations when using the service multiplier method combined with respondent driven sampling surveys survey study |
| url | http://publichealth.jmir.org/2020/2/e15044/ |
| work_keys_str_mv | AT chabatasungait assessingbiasinpopulationsizeestimatesamonghiddenpopulationswhenusingtheservicemultipliermethodcombinedwithrespondentdrivensamplingsurveyssurveystudy AT fearonelizabeth assessingbiasinpopulationsizeestimatesamonghiddenpopulationswhenusingtheservicemultipliermethodcombinedwithrespondentdrivensamplingsurveyssurveystudy AT webbemilyl assessingbiasinpopulationsizeestimatesamonghiddenpopulationswhenusingtheservicemultipliermethodcombinedwithrespondentdrivensamplingsurveyssurveystudy AT weisshelena assessingbiasinpopulationsizeestimatesamonghiddenpopulationswhenusingtheservicemultipliermethodcombinedwithrespondentdrivensamplingsurveyssurveystudy AT hargreavesjamesr assessingbiasinpopulationsizeestimatesamonghiddenpopulationswhenusingtheservicemultipliermethodcombinedwithrespondentdrivensamplingsurveyssurveystudy AT cowanfrancesm assessingbiasinpopulationsizeestimatesamonghiddenpopulationswhenusingtheservicemultipliermethodcombinedwithrespondentdrivensamplingsurveyssurveystudy |