Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative Methods
BackgroundIncreasingly, survey researchers rely on hybrid samples to improve coverage and increase the number of respondents by combining independent samples. For instance, it is possible to combine 2 probability samples with one relying on telephone and another on mail. More...
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2024-03-01
|
| Series: | JMIR Public Health and Surveillance |
| Online Access: | https://publichealth.jmir.org/2024/1/e48186 |
| _version_ | 1797270008910315520 |
|---|---|
| author | Mansour Fahimi Elizabeth C Hair Elizabeth K Do Jennifer M Kreslake Xiaolu Yan Elisa Chan Frances M Barlas Abigail Giles Larry Osborn |
| author_facet | Mansour Fahimi Elizabeth C Hair Elizabeth K Do Jennifer M Kreslake Xiaolu Yan Elisa Chan Frances M Barlas Abigail Giles Larry Osborn |
| author_sort | Mansour Fahimi |
| collection | DOAJ |
| description |
BackgroundIncreasingly, survey researchers rely on hybrid samples to improve coverage and increase the number of respondents by combining independent samples. For instance, it is possible to combine 2 probability samples with one relying on telephone and another on mail. More commonly, however, researchers are now supplementing probability samples with those from online panels that are less costly. Setting aside ad hoc approaches that are void of rigor, traditionally, the method of composite estimation has been used to blend results from different sample surveys. This means individual point estimates from different surveys are pooled together, 1 estimate at a time. Given that for a typical study many estimates must be produced, this piecemeal approach is computationally burdensome and subject to the inferential limitations of the individual surveys that are used in this process.
ObjectiveIn this paper, we will provide a comprehensive review of the traditional method of composite estimation. Subsequently, the method of composite weighting is introduced, which is significantly more efficient, both computationally and inferentially when pooling data from multiple surveys. With the growing interest in hybrid sampling alternatives, we hope to offer an accessible methodology for improving the efficiency of inferences from such sample surveys without sacrificing rigor.
MethodsSpecifically, we will illustrate why the many ad hoc procedures for blending survey data from multiple surveys are void of scientific integrity and subject to misleading inferences. Moreover, we will demonstrate how the traditional approach of composite estimation fails to offer a pragmatic and scalable solution in practice. By relying on theoretical and empirical justifications, in contrast, we will show how our proposed methodology of composite weighting is both scientifically sound and inferentially and computationally superior to the old method of composite estimation.
ResultsUsing data from 3 large surveys that have relied on hybrid samples composed of probability-based and supplemental sample components from online panels, we illustrate that our proposed method of composite weighting is superior to the traditional method of composite estimation in 2 distinct ways. Computationally, it is vastly less demanding and hence more accessible for practitioners. Inferentially, it produces more efficient estimates with higher levels of external validity when pooling data from multiple surveys.
ConclusionsThe new realities of the digital age have brought about a number of resilient challenges for survey researchers, which in turn have exposed some of the inefficiencies associated with the traditional methods this community has relied upon for decades. The resilience of such challenges suggests that piecemeal approaches that may have limited applicability or restricted accessibility will prove to be inadequate and transient. It is from this perspective that our proposed method of composite weighting has aimed to introduce a durable and accessible solution for hybrid sample surveys. |
| first_indexed | 2024-04-25T01:57:27Z |
| format | Article |
| id | doaj.art-6cdbf8993f124985820bcfb5c22c1c98 |
| institution | Directory Open Access Journal |
| issn | 2369-2960 |
| language | English |
| last_indexed | 2024-04-25T01:57:27Z |
| publishDate | 2024-03-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Public Health and Surveillance |
| spelling | doaj.art-6cdbf8993f124985820bcfb5c22c1c982024-03-07T15:45:36ZengJMIR PublicationsJMIR Public Health and Surveillance2369-29602024-03-0110e4818610.2196/48186Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative MethodsMansour Fahimihttps://orcid.org/0009-0009-6411-2566Elizabeth C Hairhttps://orcid.org/0000-0003-0536-2409Elizabeth K Dohttps://orcid.org/0000-0003-3503-1731Jennifer M Kreslakehttps://orcid.org/0000-0001-6605-1327Xiaolu Yanhttps://orcid.org/0009-0006-7754-6054Elisa Chanhttps://orcid.org/0009-0001-1757-3062Frances M Barlashttps://orcid.org/0009-0007-9683-5019Abigail Gileshttps://orcid.org/0009-0000-2192-4614Larry Osbornhttps://orcid.org/0009-0001-5642-5724 BackgroundIncreasingly, survey researchers rely on hybrid samples to improve coverage and increase the number of respondents by combining independent samples. For instance, it is possible to combine 2 probability samples with one relying on telephone and another on mail. More commonly, however, researchers are now supplementing probability samples with those from online panels that are less costly. Setting aside ad hoc approaches that are void of rigor, traditionally, the method of composite estimation has been used to blend results from different sample surveys. This means individual point estimates from different surveys are pooled together, 1 estimate at a time. Given that for a typical study many estimates must be produced, this piecemeal approach is computationally burdensome and subject to the inferential limitations of the individual surveys that are used in this process. ObjectiveIn this paper, we will provide a comprehensive review of the traditional method of composite estimation. Subsequently, the method of composite weighting is introduced, which is significantly more efficient, both computationally and inferentially when pooling data from multiple surveys. With the growing interest in hybrid sampling alternatives, we hope to offer an accessible methodology for improving the efficiency of inferences from such sample surveys without sacrificing rigor. MethodsSpecifically, we will illustrate why the many ad hoc procedures for blending survey data from multiple surveys are void of scientific integrity and subject to misleading inferences. Moreover, we will demonstrate how the traditional approach of composite estimation fails to offer a pragmatic and scalable solution in practice. By relying on theoretical and empirical justifications, in contrast, we will show how our proposed methodology of composite weighting is both scientifically sound and inferentially and computationally superior to the old method of composite estimation. ResultsUsing data from 3 large surveys that have relied on hybrid samples composed of probability-based and supplemental sample components from online panels, we illustrate that our proposed method of composite weighting is superior to the traditional method of composite estimation in 2 distinct ways. Computationally, it is vastly less demanding and hence more accessible for practitioners. Inferentially, it produces more efficient estimates with higher levels of external validity when pooling data from multiple surveys. ConclusionsThe new realities of the digital age have brought about a number of resilient challenges for survey researchers, which in turn have exposed some of the inefficiencies associated with the traditional methods this community has relied upon for decades. The resilience of such challenges suggests that piecemeal approaches that may have limited applicability or restricted accessibility will prove to be inadequate and transient. It is from this perspective that our proposed method of composite weighting has aimed to introduce a durable and accessible solution for hybrid sample surveys.https://publichealth.jmir.org/2024/1/e48186 |
| spellingShingle | Mansour Fahimi Elizabeth C Hair Elizabeth K Do Jennifer M Kreslake Xiaolu Yan Elisa Chan Frances M Barlas Abigail Giles Larry Osborn Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative Methods JMIR Public Health and Surveillance |
| title | Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative Methods |
| title_full | Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative Methods |
| title_fullStr | Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative Methods |
| title_full_unstemmed | Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative Methods |
| title_short | Improving the Efficiency of Inferences From Hybrid Samples for Effective Health Surveillance Surveys: Comprehensive Review of Quantitative Methods |
| title_sort | improving the efficiency of inferences from hybrid samples for effective health surveillance surveys comprehensive review of quantitative methods |
| url | https://publichealth.jmir.org/2024/1/e48186 |
| work_keys_str_mv | AT mansourfahimi improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods AT elizabethchair improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods AT elizabethkdo improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods AT jennifermkreslake improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods AT xiaoluyan improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods AT elisachan improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods AT francesmbarlas improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods AT abigailgiles improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods AT larryosborn improvingtheefficiencyofinferencesfromhybridsamplesforeffectivehealthsurveillancesurveyscomprehensivereviewofquantitativemethods |