Learning by trial and error

A person learns by trial and error if he occasionally tries out new strategies, rejecting choices that are “erroneous” in the sense that they do not lead to higher payoffs. In a game, however, strategies can become erroneous due to a change of behavior by someone else. Such passive errors may also t...

Full description

Bibliographic Details
Main Author: Young, H
Format: Working paper
Language:English
Published: 2008
Subjects:
_version_ 1797096865192214528
author Young, H
author_facet Young, H
author_sort Young, H
collection OXFORD
description A person learns by trial and error if he occasionally tries out new strategies, rejecting choices that are “erroneous” in the sense that they do not lead to higher payoffs. In a game, however, strategies can become erroneous due to a change of behavior by someone else. Such passive errors may also trigger a search for new and better strategies, but the nature of the search is different than when a player is actively engaged in experimentation. This paper introduces a simple version of this idea, called interactive trial and error learning, which has the property that it implements Nash equilibrium behavior in any game with generic payoffs and at least one pure Nash equilibrium. Unlike regret testing (Foster and Young, 2006), the method requires no statistical estimation. Unlike a learning procedure proposed by Hart and Mas-Colell (2006), it requires no knowledge of the other players' actions: learning proceeds purely by responding to one's own payoff history. The approach shows that there exist simple and intuitive rules for discovering equilibria in decentralized settings where players have no knowledge of the system in which they are embedded.
first_indexed 2024-03-07T04:47:37Z
format Working paper
id oxford-uuid:d3dcdf65-7cf4-4388-8c31-f5617ea9cc53
institution University of Oxford
language English
last_indexed 2024-03-07T04:47:37Z
publishDate 2008
record_format dspace
spelling oxford-uuid:d3dcdf65-7cf4-4388-8c31-f5617ea9cc532022-03-27T08:14:12ZLearning by trial and errorWorking paperhttp://purl.org/coar/resource_type/c_8042uuid:d3dcdf65-7cf4-4388-8c31-f5617ea9cc53EconomicsEconometricsMicroeconomicsJEL: C72JEL: D83EnglishOxford University Research Archive - Valet2008Young, HA person learns by trial and error if he occasionally tries out new strategies, rejecting choices that are “erroneous” in the sense that they do not lead to higher payoffs. In a game, however, strategies can become erroneous due to a change of behavior by someone else. Such passive errors may also trigger a search for new and better strategies, but the nature of the search is different than when a player is actively engaged in experimentation. This paper introduces a simple version of this idea, called interactive trial and error learning, which has the property that it implements Nash equilibrium behavior in any game with generic payoffs and at least one pure Nash equilibrium. Unlike regret testing (Foster and Young, 2006), the method requires no statistical estimation. Unlike a learning procedure proposed by Hart and Mas-Colell (2006), it requires no knowledge of the other players' actions: learning proceeds purely by responding to one's own payoff history. The approach shows that there exist simple and intuitive rules for discovering equilibria in decentralized settings where players have no knowledge of the system in which they are embedded.
spellingShingle Economics
Econometrics
Microeconomics
JEL: C72
JEL: D83
Young, H
Learning by trial and error
title Learning by trial and error
title_full Learning by trial and error
title_fullStr Learning by trial and error
title_full_unstemmed Learning by trial and error
title_short Learning by trial and error
title_sort learning by trial and error
topic Economics
Econometrics
Microeconomics
JEL: C72
JEL: D83
work_keys_str_mv AT youngh learningbytrialanderror