The Impact of Method Bias on the Cross-Cultural Comparability in Face-to-Face Surveys Among Ethnic Minorities

This article investigates the impact of several sources of method bias on the cross-cultural comparison of attitudes towards gender roles and family ties among non-Western minority ethnic groups. In particular, it investigates how interviewer effects, the use of an interviewer with a shared ethnic b...

Full description

Bibliographic Details
Main Author: Joost W.S. Kappelhof
Format: Article
Language:English
Published: GESIS - Leibniz-Institute for the Social Sciences, Mannheim 2014-01-01
Series:Methoden, Daten, Analysen
Subjects:
Online Access:https://mda.gesis.org/index.php/mda/article/view/2014.004/31
_version_ 1818650919892418560
author Joost W.S. Kappelhof
author_facet Joost W.S. Kappelhof
author_sort Joost W.S. Kappelhof
collection DOAJ
description This article investigates the impact of several sources of method bias on the cross-cultural comparison of attitudes towards gender roles and family ties among non-Western minority ethnic groups. In particular, it investigates how interviewer effects, the use of an interviewer with a shared ethnic background, interview language, interviewer gender, gender matching, the presence of others during the interview and differences in socio-demographic sample composition of non-Western minority ethnic groups affect the cross-cultural comparison of attitudes towards gender roles and family ties between these groups. The data used in this study come from a large scale face-to face survey conducted among the four largest non-Western minority ethnic groups in The Netherlands for which Statistics Netherlands drew a random sample of named individuals from each of the four largest non-Western minority populations living in The Netherlands. Furthermore, methods are introduced to estimate the potential impact of method bias on cross cultural comparisons. The results show that measurement of both gender roles and family ties constructs are full scalar invariant across the different ethnic groups, but that observed differences in attitudes between ethnic groups especially towards gender roles are influenced by method bias. This in turn leads to biased comparisons between ethnic groups because of differences in the size of the various sources of method bias, the differential impact of the same method bias between ethnic groups and the combination thereof.
first_indexed 2024-12-17T01:57:52Z
format Article
id doaj.art-b6d53b78ae1646d3aca9778da51c97a9
institution Directory Open Access Journal
issn 1864-6956
2190-4936
language English
last_indexed 2024-12-17T01:57:52Z
publishDate 2014-01-01
publisher GESIS - Leibniz-Institute for the Social Sciences, Mannheim
record_format Article
series Methoden, Daten, Analysen
spelling doaj.art-b6d53b78ae1646d3aca9778da51c97a92022-12-21T22:07:55ZengGESIS - Leibniz-Institute for the Social Sciences, MannheimMethoden, Daten, Analysen1864-69562190-49362014-01-01817911810.12758/mda.2014.004The Impact of Method Bias on the Cross-Cultural Comparability in Face-to-Face Surveys Among Ethnic MinoritiesJoost W.S. Kappelhof0The Netherlands Institute for Social Research SCPThis article investigates the impact of several sources of method bias on the cross-cultural comparison of attitudes towards gender roles and family ties among non-Western minority ethnic groups. In particular, it investigates how interviewer effects, the use of an interviewer with a shared ethnic background, interview language, interviewer gender, gender matching, the presence of others during the interview and differences in socio-demographic sample composition of non-Western minority ethnic groups affect the cross-cultural comparison of attitudes towards gender roles and family ties between these groups. The data used in this study come from a large scale face-to face survey conducted among the four largest non-Western minority ethnic groups in The Netherlands for which Statistics Netherlands drew a random sample of named individuals from each of the four largest non-Western minority populations living in The Netherlands. Furthermore, methods are introduced to estimate the potential impact of method bias on cross cultural comparisons. The results show that measurement of both gender roles and family ties constructs are full scalar invariant across the different ethnic groups, but that observed differences in attitudes between ethnic groups especially towards gender roles are influenced by method bias. This in turn leads to biased comparisons between ethnic groups because of differences in the size of the various sources of method bias, the differential impact of the same method bias between ethnic groups and the combination thereof.https://mda.gesis.org/index.php/mda/article/view/2014.004/31methods biasnon-Western ethnic minoritiescross-cultural comparative survey researchincomparability samplesinterviewer effectsmulti group Mimicsocio-cultural integration
spellingShingle Joost W.S. Kappelhof
The Impact of Method Bias on the Cross-Cultural Comparability in Face-to-Face Surveys Among Ethnic Minorities
Methoden, Daten, Analysen
methods bias
non-Western ethnic minorities
cross-cultural comparative survey research
incomparability samples
interviewer effects
multi group Mimic
socio-cultural integration
title The Impact of Method Bias on the Cross-Cultural Comparability in Face-to-Face Surveys Among Ethnic Minorities
title_full The Impact of Method Bias on the Cross-Cultural Comparability in Face-to-Face Surveys Among Ethnic Minorities
title_fullStr The Impact of Method Bias on the Cross-Cultural Comparability in Face-to-Face Surveys Among Ethnic Minorities
title_full_unstemmed The Impact of Method Bias on the Cross-Cultural Comparability in Face-to-Face Surveys Among Ethnic Minorities
title_short The Impact of Method Bias on the Cross-Cultural Comparability in Face-to-Face Surveys Among Ethnic Minorities
title_sort impact of method bias on the cross cultural comparability in face to face surveys among ethnic minorities
topic methods bias
non-Western ethnic minorities
cross-cultural comparative survey research
incomparability samples
interviewer effects
multi group Mimic
socio-cultural integration
url https://mda.gesis.org/index.php/mda/article/view/2014.004/31
work_keys_str_mv AT joostwskappelhof theimpactofmethodbiasonthecrossculturalcomparabilityinfacetofacesurveysamongethnicminorities
AT joostwskappelhof impactofmethodbiasonthecrossculturalcomparabilityinfacetofacesurveysamongethnicminorities