Are Two Cheap, Noisy Measures Better Than One Expensive, Accurate Onе?

Executive Summary 1. Survey responses are always subject to measurement error. In general surveys (and especially longitudinal surveys), there are severe constraints on the time that can be spent eliciting a less noisy response for any target variable. In this paper we consider when it may be better...

Full description

Bibliographic Details
Main Authors: Browning, M, Crossley, T
Format: Working paper
Language:English
Published: Institute for Fiscal Studies 2009
_version_ 1826262920277786624
author Browning, M
Crossley, T
author_facet Browning, M
Crossley, T
author_sort Browning, M
collection OXFORD
description Executive Summary 1. Survey responses are always subject to measurement error. In general surveys (and especially longitudinal surveys), there are severe constraints on the time that can be spent eliciting a less noisy response for any target variable. In this paper we consider when it may be better to consider multiple noisy measures of the target measure rather than improving the reliability of a single measure. 2. The Kotlarski result states that if the measurement errors in two measures of the same target variable are mutually independent and independent of the true value then we can recover the entire distribution of the quantity of interest, up to location. 3. We consider designing surveys to deliver measurement error with desirable properties. This shifts the emphasis from reliability (the signal to noise ratio for any given measure) to the joint properties of the multiple measures. 4. To illustrate our ideas, we consider a concrete example: the measurement of consumption inequality. A small simulation study suggests that the approach we propose has promise. The next step in this research agenda is experiments in survey data collection.
first_indexed 2024-03-06T19:43:27Z
format Working paper
id oxford-uuid:2173d179-04c8-4e78-ad7b-607d2db33d9e
institution University of Oxford
language English
last_indexed 2024-03-06T19:43:27Z
publishDate 2009
publisher Institute for Fiscal Studies
record_format dspace
spelling oxford-uuid:2173d179-04c8-4e78-ad7b-607d2db33d9e2022-03-26T11:33:33ZAre Two Cheap, Noisy Measures Better Than One Expensive, Accurate Onе?Working paperhttp://purl.org/coar/resource_type/c_8042uuid:2173d179-04c8-4e78-ad7b-607d2db33d9eEnglishDepartment of Economics - ePrintsInstitute for Fiscal Studies 2009Browning, MCrossley, TExecutive Summary 1. Survey responses are always subject to measurement error. In general surveys (and especially longitudinal surveys), there are severe constraints on the time that can be spent eliciting a less noisy response for any target variable. In this paper we consider when it may be better to consider multiple noisy measures of the target measure rather than improving the reliability of a single measure. 2. The Kotlarski result states that if the measurement errors in two measures of the same target variable are mutually independent and independent of the true value then we can recover the entire distribution of the quantity of interest, up to location. 3. We consider designing surveys to deliver measurement error with desirable properties. This shifts the emphasis from reliability (the signal to noise ratio for any given measure) to the joint properties of the multiple measures. 4. To illustrate our ideas, we consider a concrete example: the measurement of consumption inequality. A small simulation study suggests that the approach we propose has promise. The next step in this research agenda is experiments in survey data collection.
spellingShingle Browning, M
Crossley, T
Are Two Cheap, Noisy Measures Better Than One Expensive, Accurate Onе?
title Are Two Cheap, Noisy Measures Better Than One Expensive, Accurate Onе?
title_full Are Two Cheap, Noisy Measures Better Than One Expensive, Accurate Onе?
title_fullStr Are Two Cheap, Noisy Measures Better Than One Expensive, Accurate Onе?
title_full_unstemmed Are Two Cheap, Noisy Measures Better Than One Expensive, Accurate Onе?
title_short Are Two Cheap, Noisy Measures Better Than One Expensive, Accurate Onе?
title_sort are two cheap noisy measures better than one expensive accurate onе
work_keys_str_mv AT browningm aretwocheapnoisymeasuresbetterthanoneexpensiveaccurateone
AT crossleyt aretwocheapnoisymeasuresbetterthanoneexpensiveaccurateone