An evaluation of the weighting procedures for an online access panel survey

Opinion research is frequently carried out through the Internet and a further increase can be expected. The article focuses on the online access panel, in which respondents are previously recruited through non-probability methods. Despite substantial time- and cost-reduction, online access panel res...

Full description

Bibliographic Details
Main Authors: Geert Loosveldt, Nathalie Sonck
Format: Article
Language:English
Published: European Survey Research Association 2008-06-01
Series:Survey Research Methods
Subjects:
Online Access:https://ojs.ub.uni-konstanz.de/srm/article/view/82
_version_ 1798037215282987008
author Geert Loosveldt
Nathalie Sonck
author_facet Geert Loosveldt
Nathalie Sonck
author_sort Geert Loosveldt
collection DOAJ
description Opinion research is frequently carried out through the Internet and a further increase can be expected. The article focuses on the online access panel, in which respondents are previously recruited through non-probability methods. Despite substantial time- and cost-reduction, online access panel research mainly has to cope with limited Internet coverage and self-selection in the recruitment phase of new panel members. The article investigates whether frequently applied weighting procedures, based on poststratification variables and propensity scores, make online access panel data more representative of the general population. To address this issue, the answers to identical questions are compared between an online self-administered survey of previously recruited online access panel respondents and a face-to-face survey of randomly sampled respondents of the general population. Both respondent groups were surveyed at a similar moment in time (2006-2007) in the same geographical region (Flanders, Belgium). The findings reveal many significant differences, regarding sociodemographic characteristics as well as attitudes towards work, politics and immigrants. The results can be explained by both the specific characteristics of the respondent groups and mode effects. Weighting adjustment had only a minor impact on the results and did not eliminate the differences.
first_indexed 2024-04-11T21:23:33Z
format Article
id doaj.art-f09a758f2d58462b82e602ad172190f5
institution Directory Open Access Journal
issn 1864-3361
language English
last_indexed 2024-04-11T21:23:33Z
publishDate 2008-06-01
publisher European Survey Research Association
record_format Article
series Survey Research Methods
spelling doaj.art-f09a758f2d58462b82e602ad172190f52022-12-22T04:02:32ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612008-06-012210.18148/srm/2008.v2i2.821693An evaluation of the weighting procedures for an online access panel surveyGeert LoosveldtNathalie SonckOpinion research is frequently carried out through the Internet and a further increase can be expected. The article focuses on the online access panel, in which respondents are previously recruited through non-probability methods. Despite substantial time- and cost-reduction, online access panel research mainly has to cope with limited Internet coverage and self-selection in the recruitment phase of new panel members. The article investigates whether frequently applied weighting procedures, based on poststratification variables and propensity scores, make online access panel data more representative of the general population. To address this issue, the answers to identical questions are compared between an online self-administered survey of previously recruited online access panel respondents and a face-to-face survey of randomly sampled respondents of the general population. Both respondent groups were surveyed at a similar moment in time (2006-2007) in the same geographical region (Flanders, Belgium). The findings reveal many significant differences, regarding sociodemographic characteristics as well as attitudes towards work, politics and immigrants. The results can be explained by both the specific characteristics of the respondent groups and mode effects. Weighting adjustment had only a minor impact on the results and did not eliminate the differences.https://ojs.ub.uni-konstanz.de/srm/article/view/82online access panelrepresentative samplesweighting procedurespropensity score adjustment
spellingShingle Geert Loosveldt
Nathalie Sonck
An evaluation of the weighting procedures for an online access panel survey
Survey Research Methods
online access panel
representative samples
weighting procedures
propensity score adjustment
title An evaluation of the weighting procedures for an online access panel survey
title_full An evaluation of the weighting procedures for an online access panel survey
title_fullStr An evaluation of the weighting procedures for an online access panel survey
title_full_unstemmed An evaluation of the weighting procedures for an online access panel survey
title_short An evaluation of the weighting procedures for an online access panel survey
title_sort evaluation of the weighting procedures for an online access panel survey
topic online access panel
representative samples
weighting procedures
propensity score adjustment
url https://ojs.ub.uni-konstanz.de/srm/article/view/82
work_keys_str_mv AT geertloosveldt anevaluationoftheweightingproceduresforanonlineaccesspanelsurvey
AT nathaliesonck anevaluationoftheweightingproceduresforanonlineaccesspanelsurvey
AT geertloosveldt evaluationoftheweightingproceduresforanonlineaccesspanelsurvey
AT nathaliesonck evaluationoftheweightingproceduresforanonlineaccesspanelsurvey