Can Interviewer Observations of the Interview Predict Future Response?

Interviewers made four observations related to future participation, respondent cooperation, enjoyment and whether the respondent found the questions difficult, for a large sample of face-to-face interviews at wave four of the UK Millennium Cohort Study (MCS). The focus of the paper is on predicting...

Full description

Bibliographic Details
Main Authors: Ian Plewis, Lisa Calderwood, Tarek Mostafe
Format: Article
Language:English
Published: GESIS - Leibniz-Institute for the Social Sciences, Mannheim 2017-01-01
Series:Methoden, Daten, Analysen
Subjects:
Online Access:https://mda.gesis.org/index.php/mda/article/view/2016.010/146
_version_ 1818535717276483584
author Ian Plewis
Lisa Calderwood
Tarek Mostafe
author_facet Ian Plewis
Lisa Calderwood
Tarek Mostafe
author_sort Ian Plewis
collection DOAJ
description Interviewers made four observations related to future participation, respondent cooperation, enjoyment and whether the respondent found the questions difficult, for a large sample of face-to-face interviews at wave four of the UK Millennium Cohort Study (MCS). The focus of the paper is on predicting response behavior in the subsequent wave of MCS, four years later. The two most predictive observations are whether the respondent is likely to participate in the next wave and whether they enjoyed the interview. Not only do these predict non-response at the next wave, they do so after controlling for other explanatory variables from earlier waves in a response propensity model. Consequently, these two interviewer observations improve discrimination between respondents and non-respondents at wave five as estimated by Gini coefficients generated by a Receiver Operating Characteristic curve analysis. The predicted probabilities of responding at wave five are also used to estimate R-indicators, particularly to address the question of whether, hypothetically, conversion of ‘frail’ respondents would lead to improved representativity and reduced bias in longitudinal estimates of interest. The evidence from the R-indicators and partial R-indicators suggests that successful conversions could achieve those aims although the cost of so doing might outweigh the benefits.
first_indexed 2024-12-11T18:28:38Z
format Article
id doaj.art-49aef8278a0a40a5b283ab8de5f4038a
institution Directory Open Access Journal
issn 1864-6956
2190-4936
language English
last_indexed 2024-12-11T18:28:38Z
publishDate 2017-01-01
publisher GESIS - Leibniz-Institute for the Social Sciences, Mannheim
record_format Article
series Methoden, Daten, Analysen
spelling doaj.art-49aef8278a0a40a5b283ab8de5f4038a2022-12-22T00:54:59ZengGESIS - Leibniz-Institute for the Social Sciences, MannheimMethoden, Daten, Analysen1864-69562190-49362017-01-01111294510.12758/mda.2016.010Can Interviewer Observations of the Interview Predict Future Response?Ian Plewis0Lisa Calderwood1Tarek Mostafe2University of ManchesterCentre for Longitudinal Studies, UCL Institute of EducationCentre for Longitudinal Studies, UCL Institute of EducationInterviewers made four observations related to future participation, respondent cooperation, enjoyment and whether the respondent found the questions difficult, for a large sample of face-to-face interviews at wave four of the UK Millennium Cohort Study (MCS). The focus of the paper is on predicting response behavior in the subsequent wave of MCS, four years later. The two most predictive observations are whether the respondent is likely to participate in the next wave and whether they enjoyed the interview. Not only do these predict non-response at the next wave, they do so after controlling for other explanatory variables from earlier waves in a response propensity model. Consequently, these two interviewer observations improve discrimination between respondents and non-respondents at wave five as estimated by Gini coefficients generated by a Receiver Operating Characteristic curve analysis. The predicted probabilities of responding at wave five are also used to estimate R-indicators, particularly to address the question of whether, hypothetically, conversion of ‘frail’ respondents would lead to improved representativity and reduced bias in longitudinal estimates of interest. The evidence from the R-indicators and partial R-indicators suggests that successful conversions could achieve those aims although the cost of so doing might outweigh the benefits.https://mda.gesis.org/index.php/mda/article/view/2016.010/146millenium cohort studynon-responserepresentativityresponse propensity modelsROC curve
spellingShingle Ian Plewis
Lisa Calderwood
Tarek Mostafe
Can Interviewer Observations of the Interview Predict Future Response?
Methoden, Daten, Analysen
millenium cohort study
non-response
representativity
response propensity models
ROC curve
title Can Interviewer Observations of the Interview Predict Future Response?
title_full Can Interviewer Observations of the Interview Predict Future Response?
title_fullStr Can Interviewer Observations of the Interview Predict Future Response?
title_full_unstemmed Can Interviewer Observations of the Interview Predict Future Response?
title_short Can Interviewer Observations of the Interview Predict Future Response?
title_sort can interviewer observations of the interview predict future response
topic millenium cohort study
non-response
representativity
response propensity models
ROC curve
url https://mda.gesis.org/index.php/mda/article/view/2016.010/146
work_keys_str_mv AT ianplewis caninterviewerobservationsoftheinterviewpredictfutureresponse
AT lisacalderwood caninterviewerobservationsoftheinterviewpredictfutureresponse
AT tarekmostafe caninterviewerobservationsoftheinterviewpredictfutureresponse