Evaluation of Survey Data Quality Based on Interviewers’ Assessments: An Example from Taiwan’s Election and Democratization Study
Researchers usually examine the quality of survey data by several conventional measures of reliability and validity. However, those measures are mainly designed to examine the quality of an individual measurement, rather than the quality of a data set as a whole. There is a relative lack of methods...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
ANPOR Korea
2019-02-01
|
| Series: | Asian Journal for Public Opinion Research |
| Subjects: | |
| Online Access: | http://kpubs.org/article/articleMain.kpubs?articleANo=ORJSBL_2019_v7n1_57 |
| _version_ | 1828544561404706816 |
|---|---|
| author | Chi-lin Tsai Tsung-Wei Liu Yi-ju Chen |
| author_facet | Chi-lin Tsai Tsung-Wei Liu Yi-ju Chen |
| author_sort | Chi-lin Tsai |
| collection | DOAJ |
| description | Researchers usually examine the quality of survey data by several conventional measures of reliability and validity. However, those measures are mainly designed to examine the quality of an individual measurement, rather than the quality of a data set as a whole. There is a relative lack of methods for evaluation of the overall data quality. This paper attempts to fill this gap. We propose using interviewers’ assessments as one of criteria for evaluating the overall data quality. Interviewers are the ones who literally conduct and thus directly observe interviews. Taiwan’s Election and Democratization Studies (TEDS) have required interviewers to assess how trustworthy the responses of each of their interviewees are, and to provide several descriptions about the process and environment of the interviews. We use this information to evaluate the data quality of TEDS surveys and compare it with the results from the conventional test-retest method. The findings are that the interviewer assessment is a fair indicator of the overall reliability of attitudinal questions but not a good indicator when factual questions are examined. Regarding the evaluation of data validity, more data is required to see whether or not interviewers’ assessment is informative in terms of data quality. |
| first_indexed | 2024-12-12T02:33:24Z |
| format | Article |
| id | doaj.art-dbca1c0d23e94cca9cec03554a917b06 |
| institution | Directory Open Access Journal |
| issn | 2288-6168 |
| language | English |
| last_indexed | 2024-12-12T02:33:24Z |
| publishDate | 2019-02-01 |
| publisher | ANPOR Korea |
| record_format | Article |
| series | Asian Journal for Public Opinion Research |
| spelling | doaj.art-dbca1c0d23e94cca9cec03554a917b062022-12-22T00:41:21ZengANPOR KoreaAsian Journal for Public Opinion Research2288-61682019-02-0171577410.15206/ajpor.2019.7.1.5722886168Evaluation of Survey Data Quality Based on Interviewers’ Assessments: An Example from Taiwan’s Election and Democratization StudyChi-lin TsaiTsung-Wei LiuYi-ju ChenResearchers usually examine the quality of survey data by several conventional measures of reliability and validity. However, those measures are mainly designed to examine the quality of an individual measurement, rather than the quality of a data set as a whole. There is a relative lack of methods for evaluation of the overall data quality. This paper attempts to fill this gap. We propose using interviewers’ assessments as one of criteria for evaluating the overall data quality. Interviewers are the ones who literally conduct and thus directly observe interviews. Taiwan’s Election and Democratization Studies (TEDS) have required interviewers to assess how trustworthy the responses of each of their interviewees are, and to provide several descriptions about the process and environment of the interviews. We use this information to evaluate the data quality of TEDS surveys and compare it with the results from the conventional test-retest method. The findings are that the interviewer assessment is a fair indicator of the overall reliability of attitudinal questions but not a good indicator when factual questions are examined. Regarding the evaluation of data validity, more data is required to see whether or not interviewers’ assessment is informative in terms of data quality.http://kpubs.org/article/articleMain.kpubs?articleANo=ORJSBL_2019_v7n1_57data qualityinterviewers’ assessmentreliabilityvalidityTaiwan’s Election and Democratization Study |
| spellingShingle | Chi-lin Tsai Tsung-Wei Liu Yi-ju Chen Evaluation of Survey Data Quality Based on Interviewers’ Assessments: An Example from Taiwan’s Election and Democratization Study Asian Journal for Public Opinion Research data quality interviewers’ assessment reliability validity Taiwan’s Election and Democratization Study |
| title | Evaluation of Survey Data Quality Based on Interviewers’ Assessments: An Example from Taiwan’s Election and Democratization Study |
| title_full | Evaluation of Survey Data Quality Based on Interviewers’ Assessments: An Example from Taiwan’s Election and Democratization Study |
| title_fullStr | Evaluation of Survey Data Quality Based on Interviewers’ Assessments: An Example from Taiwan’s Election and Democratization Study |
| title_full_unstemmed | Evaluation of Survey Data Quality Based on Interviewers’ Assessments: An Example from Taiwan’s Election and Democratization Study |
| title_short | Evaluation of Survey Data Quality Based on Interviewers’ Assessments: An Example from Taiwan’s Election and Democratization Study |
| title_sort | evaluation of survey data quality based on interviewers assessments an example from taiwan s election and democratization study |
| topic | data quality interviewers’ assessment reliability validity Taiwan’s Election and Democratization Study |
| url | http://kpubs.org/article/articleMain.kpubs?articleANo=ORJSBL_2019_v7n1_57 |
| work_keys_str_mv | AT chilintsai evaluationofsurveydataqualitybasedoninterviewersassessmentsanexamplefromtaiwanselectionanddemocratizationstudy AT tsungweiliu evaluationofsurveydataqualitybasedoninterviewersassessmentsanexamplefromtaiwanselectionanddemocratizationstudy AT yijuchen evaluationofsurveydataqualitybasedoninterviewersassessmentsanexamplefromtaiwanselectionanddemocratizationstudy |