Choosing among regularized estimators in empirical economics: the risk of machine learning

Many settings in empirical economics involve estimation of a large number of parameters. In such settings, methods that combine regularized estimation and data-driven choices of regularization parameters are useful. We provide guidance to applied researchers on the choice between regularized estimat...

Full description

Bibliographic Details
Main Authors: Abadie, Alberto, Kasy, Maximilian
Other Authors: Massachusetts Institute of Technology. Department of Economics
Format: Article
Language:English
Published: MIT Press - Journals 2020
Online Access:https://hdl.handle.net/1721.1/124406
_version_ 1826196910362329088
author Abadie, Alberto
Kasy, Maximilian
author2 Massachusetts Institute of Technology. Department of Economics
author_facet Massachusetts Institute of Technology. Department of Economics
Abadie, Alberto
Kasy, Maximilian
author_sort Abadie, Alberto
collection MIT
description Many settings in empirical economics involve estimation of a large number of parameters. In such settings, methods that combine regularized estimation and data-driven choices of regularization parameters are useful. We provide guidance to applied researchers on the choice between regularized estimators and data-driven selection of regularization parameters. We characterize the risk and relative performance of regularized estimators as a function of the data-generating process and show that data-driven choices of regularization parameters yield estimators with risk uniformly close to the risk attained under the optimal (unfeasible) choice of regularization parameters. We illustrate using examples from empirical economics.©2019
first_indexed 2024-09-23T10:39:34Z
format Article
id mit-1721.1/124406
institution Massachusetts Institute of Technology
language English
last_indexed 2024-09-23T10:39:34Z
publishDate 2020
publisher MIT Press - Journals
record_format dspace
spelling mit-1721.1/1244062022-09-30T22:06:58Z Choosing among regularized estimators in empirical economics: the risk of machine learning Abadie, Alberto Kasy, Maximilian Massachusetts Institute of Technology. Department of Economics Many settings in empirical economics involve estimation of a large number of parameters. In such settings, methods that combine regularized estimation and data-driven choices of regularization parameters are useful. We provide guidance to applied researchers on the choice between regularized estimators and data-driven selection of regularization parameters. We characterize the risk and relative performance of regularized estimators as a function of the data-generating process and show that data-driven choices of regularization parameters yield estimators with risk uniformly close to the risk attained under the optimal (unfeasible) choice of regularization parameters. We illustrate using examples from empirical economics.©2019 2020-03-30T14:23:11Z 2020-03-30T14:23:11Z 2019-12 2017-12 2019-10-22T14:45:25Z Article http://purl.org/eprint/type/JournalArticle 1530-9142 0034-6535 https://hdl.handle.net/1721.1/124406 Abadie, Alberto and Maximilian Kasy, "Choosing among regularized estimators in empirical economics: the risk of machine learning." Review of economics and statistics 101, 5 (December 2019): p. 743-62 doi 10.1162/rest_a_00812 ©2019 Authors en 10.1162/REST_A_00812 Review of economics and statistics Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use. application/pdf MIT Press - Journals MIT Press
spellingShingle Abadie, Alberto
Kasy, Maximilian
Choosing among regularized estimators in empirical economics: the risk of machine learning
title Choosing among regularized estimators in empirical economics: the risk of machine learning
title_full Choosing among regularized estimators in empirical economics: the risk of machine learning
title_fullStr Choosing among regularized estimators in empirical economics: the risk of machine learning
title_full_unstemmed Choosing among regularized estimators in empirical economics: the risk of machine learning
title_short Choosing among regularized estimators in empirical economics: the risk of machine learning
title_sort choosing among regularized estimators in empirical economics the risk of machine learning
url https://hdl.handle.net/1721.1/124406
work_keys_str_mv AT abadiealberto choosingamongregularizedestimatorsinempiricaleconomicstheriskofmachinelearning
AT kasymaximilian choosingamongregularizedestimatorsinempiricaleconomicstheriskofmachinelearning