The effect of mode and context on survey results: Analysis of data from the Health Survey for England 2006 and the Boost Survey for London
<p>Abstract</p> <p>Background</p> <p>Health-related data at local level could be provided by supplementing national health surveys with local boosts. Self-completion surveys are less costly than interviews, enabling larger samples to be achieved for a given cost. Howeve...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2010-09-01
|
| Series: | BMC Medical Research Methodology |
| Online Access: | http://www.biomedcentral.com/1471-2288/10/84 |
| _version_ | 1818144718787182592 |
|---|---|
| author | Roth Marilyn A Erens Bob Pickering Kevin Hope Steven Tipping Sarah Mindell Jennifer S |
| author_facet | Roth Marilyn A Erens Bob Pickering Kevin Hope Steven Tipping Sarah Mindell Jennifer S |
| author_sort | Roth Marilyn A |
| collection | DOAJ |
| description | <p>Abstract</p> <p>Background</p> <p>Health-related data at local level could be provided by supplementing national health surveys with local boosts. Self-completion surveys are less costly than interviews, enabling larger samples to be achieved for a given cost. However, even when the same questions are asked with the same wording, responses to survey questions may vary by mode of data collection. These measurement differences need to be investigated further.</p> <p>Methods</p> <p>The Health Survey for England in London ('Core') and a London Boost survey ('Boost') used identical sampling strategies but different modes of data collection. Some data were collected by face-to-face interview in the Core and by self-completion in the Boost; other data were collected by self-completion questionnaire in both, but the context differed. Results were compared by mode of data collection using two approaches. The first examined differences in results that remained after adjusting the samples for differences in response. The second compared results after using propensity score matching to reduce any differences in sample composition.</p> <p>Results</p> <p>There were no significant differences between the two samples for prevalence of some variables including long-term illness, limiting long-term illness, current rates of smoking, whether participants drank alcohol, and how often they usually drank. However, there were a number of differences, some quite large, between some key measures including: general health, GHQ12 score, portions of fruit and vegetables consumed, levels of physical activity, and, to a lesser extent, smoking consumption, the number of alcohol units reported consumed on the heaviest day of drinking in the last week and perceived social support (among women only).</p> <p>Conclusion</p> <p>Survey mode and context can both affect the responses given. The effect is largest for complex question modules but was also seen for identical self-completion questions. Some data collected by interview and self-completion can be safely combined.</p> |
| first_indexed | 2024-12-11T11:52:01Z |
| format | Article |
| id | doaj.art-6155f1a8a41049f984ed130dc19f560c |
| institution | Directory Open Access Journal |
| issn | 1471-2288 |
| language | English |
| last_indexed | 2024-12-11T11:52:01Z |
| publishDate | 2010-09-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Research Methodology |
| spelling | doaj.art-6155f1a8a41049f984ed130dc19f560c2022-12-22T01:08:20ZengBMCBMC Medical Research Methodology1471-22882010-09-011018410.1186/1471-2288-10-84The effect of mode and context on survey results: Analysis of data from the Health Survey for England 2006 and the Boost Survey for LondonRoth Marilyn AErens BobPickering KevinHope StevenTipping SarahMindell Jennifer S<p>Abstract</p> <p>Background</p> <p>Health-related data at local level could be provided by supplementing national health surveys with local boosts. Self-completion surveys are less costly than interviews, enabling larger samples to be achieved for a given cost. However, even when the same questions are asked with the same wording, responses to survey questions may vary by mode of data collection. These measurement differences need to be investigated further.</p> <p>Methods</p> <p>The Health Survey for England in London ('Core') and a London Boost survey ('Boost') used identical sampling strategies but different modes of data collection. Some data were collected by face-to-face interview in the Core and by self-completion in the Boost; other data were collected by self-completion questionnaire in both, but the context differed. Results were compared by mode of data collection using two approaches. The first examined differences in results that remained after adjusting the samples for differences in response. The second compared results after using propensity score matching to reduce any differences in sample composition.</p> <p>Results</p> <p>There were no significant differences between the two samples for prevalence of some variables including long-term illness, limiting long-term illness, current rates of smoking, whether participants drank alcohol, and how often they usually drank. However, there were a number of differences, some quite large, between some key measures including: general health, GHQ12 score, portions of fruit and vegetables consumed, levels of physical activity, and, to a lesser extent, smoking consumption, the number of alcohol units reported consumed on the heaviest day of drinking in the last week and perceived social support (among women only).</p> <p>Conclusion</p> <p>Survey mode and context can both affect the responses given. The effect is largest for complex question modules but was also seen for identical self-completion questions. Some data collected by interview and self-completion can be safely combined.</p>http://www.biomedcentral.com/1471-2288/10/84 |
| spellingShingle | Roth Marilyn A Erens Bob Pickering Kevin Hope Steven Tipping Sarah Mindell Jennifer S The effect of mode and context on survey results: Analysis of data from the Health Survey for England 2006 and the Boost Survey for London BMC Medical Research Methodology |
| title | The effect of mode and context on survey results: Analysis of data from the Health Survey for England 2006 and the Boost Survey for London |
| title_full | The effect of mode and context on survey results: Analysis of data from the Health Survey for England 2006 and the Boost Survey for London |
| title_fullStr | The effect of mode and context on survey results: Analysis of data from the Health Survey for England 2006 and the Boost Survey for London |
| title_full_unstemmed | The effect of mode and context on survey results: Analysis of data from the Health Survey for England 2006 and the Boost Survey for London |
| title_short | The effect of mode and context on survey results: Analysis of data from the Health Survey for England 2006 and the Boost Survey for London |
| title_sort | effect of mode and context on survey results analysis of data from the health survey for england 2006 and the boost survey for london |
| url | http://www.biomedcentral.com/1471-2288/10/84 |
| work_keys_str_mv | AT rothmarilyna theeffectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT erensbob theeffectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT pickeringkevin theeffectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT hopesteven theeffectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT tippingsarah theeffectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT mindelljennifers theeffectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT rothmarilyna effectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT erensbob effectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT pickeringkevin effectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT hopesteven effectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT tippingsarah effectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon AT mindelljennifers effectofmodeandcontextonsurveyresultsanalysisofdatafromthehealthsurveyforengland2006andtheboostsurveyforlondon |