Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3

In earlier rounds of the European Social Survey, non-response bias was studied by using population statistics and call record information (para data). In the third round, a new feature was introduced: two kinds of non-respondent surveys were set up using a short list of questions which were designed...

Full description

Bibliographic Details
Main Authors: Hideko Matsuo, Jaak Billiet, Geert Loosveldt, Frode Berglund, Øyven Kleven
Format: Article
Language:English
Published: European Survey Research Association 2010-12-01
Series:Survey Research Methods
Subjects:
Online Access:https://ojs.ub.uni-konstanz.de/srm/article/view/3774
_version_ 1811319931416870912
author Hideko Matsuo
Jaak Billiet
Geert Loosveldt
Frode Berglund
Øyven Kleven
author_facet Hideko Matsuo
Jaak Billiet
Geert Loosveldt
Frode Berglund
Øyven Kleven
author_sort Hideko Matsuo
collection DOAJ
description In earlier rounds of the European Social Survey, non-response bias was studied by using population statistics and call record information (para data). In the third round, a new feature was introduced: two kinds of non-respondent surveys were set up using a short list of questions which were designed to study non-response bias. In Belgium, a very short questionnaire was offered to all refusals at the doorstep (doorstep questions survey, DQS). In Norway and two other countries, somewhat longer versions of the basic questionnaire were offered to all main survey non-respondents and to samples of respondents (non-response survey, NRS). Logistic regression models were applied in order to estimate response propensities. This paper shows that propensity score weighting adjustment of non-response bias, on the basis of key socio-demographic and attitudinal variables, is effective for most demographic and non-demographic variables in both Belgium and Norway. Application of the weighting procedure balances the samples of cooperative respondents and non-respondents according to the key variables studied since systematic differences between cooperative respondents and non-respondents have disappeared.
first_indexed 2024-04-13T12:50:57Z
format Article
id doaj.art-2b3c0b11148d4a01a03bc995e2cee2f6
institution Directory Open Access Journal
issn 1864-3361
language English
last_indexed 2024-04-13T12:50:57Z
publishDate 2010-12-01
publisher European Survey Research Association
record_format Article
series Survey Research Methods
spelling doaj.art-2b3c0b11148d4a01a03bc995e2cee2f62022-12-22T02:46:12ZengEuropean Survey Research AssociationSurvey Research Methods1864-33612010-12-014310.18148/srm/2010.v4i3.37744491Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3Hideko MatsuoJaak BillietGeert LoosveldtFrode BerglundØyven KlevenIn earlier rounds of the European Social Survey, non-response bias was studied by using population statistics and call record information (para data). In the third round, a new feature was introduced: two kinds of non-respondent surveys were set up using a short list of questions which were designed to study non-response bias. In Belgium, a very short questionnaire was offered to all refusals at the doorstep (doorstep questions survey, DQS). In Norway and two other countries, somewhat longer versions of the basic questionnaire were offered to all main survey non-respondents and to samples of respondents (non-response survey, NRS). Logistic regression models were applied in order to estimate response propensities. This paper shows that propensity score weighting adjustment of non-response bias, on the basis of key socio-demographic and attitudinal variables, is effective for most demographic and non-demographic variables in both Belgium and Norway. Application of the weighting procedure balances the samples of cooperative respondents and non-respondents according to the key variables studied since systematic differences between cooperative respondents and non-respondents have disappeared.https://ojs.ub.uni-konstanz.de/srm/article/view/3774non-response surveynon-response biaspropensity score weightingdata quality
spellingShingle Hideko Matsuo
Jaak Billiet
Geert Loosveldt
Frode Berglund
Øyven Kleven
Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3
Survey Research Methods
non-response survey
non-response bias
propensity score weighting
data quality
title Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3
title_full Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3
title_fullStr Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3
title_full_unstemmed Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3
title_short Measurement and adjustment of non-response bias based on non-response surveys: the case of Belgium and Norway in the European Social Survey Round 3
title_sort measurement and adjustment of non response bias based on non response surveys the case of belgium and norway in the european social survey round 3
topic non-response survey
non-response bias
propensity score weighting
data quality
url https://ojs.ub.uni-konstanz.de/srm/article/view/3774
work_keys_str_mv AT hidekomatsuo measurementandadjustmentofnonresponsebiasbasedonnonresponsesurveysthecaseofbelgiumandnorwayintheeuropeansocialsurveyround3
AT jaakbilliet measurementandadjustmentofnonresponsebiasbasedonnonresponsesurveysthecaseofbelgiumandnorwayintheeuropeansocialsurveyround3
AT geertloosveldt measurementandadjustmentofnonresponsebiasbasedonnonresponsesurveysthecaseofbelgiumandnorwayintheeuropeansocialsurveyround3
AT frodeberglund measurementandadjustmentofnonresponsebiasbasedonnonresponsesurveysthecaseofbelgiumandnorwayintheeuropeansocialsurveyround3
AT øyvenkleven measurementandadjustmentofnonresponsebiasbasedonnonresponsesurveysthecaseofbelgiumandnorwayintheeuropeansocialsurveyround3