Expected policy gradients for reinforcement learning

Expected policy gradients for reinforcement learning

We propose expected policy gradients (EPG), which unify stochastic policy gradients (SPG) and deterministic policy gradients (DPG) for reinforcement learning. Inspired by expected sarsa, EPG integrates (or sums) across actions when estimating the gradient, instead of relying only on the action in th...

Полное описание

Библиографические подробности
Главные авторы:	Ciosek, K, Whiteson, S
Формат:	Journal article
Язык:	English
Опубликовано:	Journal of Machine Learning Research 2020

Схожие документы

Expected policy gradients
по: Ciosek, K, и др.
Опубликовано: (2018)

Fourier policy gradients
по: Fellows, M, и др.
Опубликовано: (2018)

OFFER: Off-environment reinforcement learning
по: Ciosek, K, и др.
Опубликовано: (2017)

Robust reinforcement learning with Bayesian optimisation and quadrature
по: Paul, S, и др.
Опубликовано: (2020)

Alternating optimisation and quadrature for robust control
по: Paul, S, и др.
Опубликовано: (2018)

A Policy Gradient Algorithm for Learning to Learn in Multiagent Reinforcement Learning
по: Kim, Dong-Ki, и др.
Опубликовано: (2022)

Deep reinforcement learning with robust deep deterministic policy gradient
по: Teckchai Tiong, и др.
Опубликовано: (2020)

Fingerprint policy optimisation for robust reinforcement learning
по: Paul, S, и др.
Опубликовано: (2019)

Counterfactual multi−agent policy gradients
по: Foerster, J, и др.
Опубликовано: (2018)

Fast efficient hyperparameter tuning for policy gradient methods
по: Paul, S, и др.
Опубликовано: (2019)

Mean−variance policy iteration for risk−averse reinforcement learning
по: Zhang, S, и др.
Опубликовано: (2021)

Exploration in Gradient-Based Reinforcement Learning
по: Meuleau, Nicolas, и др.
Опубликовано: (2004)

Loaded DiCE: Trading off bias and variance in any-order score function gradient estimators for reinforcement learning
по: Farquhar, G, и др.
Опубликовано: (2019)

Inverse reinforcement learning from failure
по: Shiarlis, K, и др.
Опубликовано: (2016)

Distributed Bayesian learning with stochastic natural gradient expectation propagation and the posterior server
по: Hasenclver, L, и др.
Опубликовано: (2017)

FACMAC: Factored multi−agent centralised policy gradients
по: Peng, B, и др.
Опубликовано: (2022)

Multileave gradient descent for fast online learning to rank
по: Whiteson, S, и др.
Опубликовано: (2016)

Deep residual reinforcement learning
по: Zhang, S, и др.
Опубликовано: (2020)

Learning retrospective knowledge with reverse reinforcement learning
по: Zhang, S, и др.
Опубликовано: (2020)

Bayesian action decoder for deep multi-agent reinforcement learning
по: Whiteson, S
Опубликовано: (2019)

Reinforcement Learning by Policy Search
по: Peshkin, Leonid
Опубликовано: (2004)

Learning to communicate with Deep multi-agent reinforcement learning
по: Foerster, J, и др.
Опубликовано: (2016)

Deep variational reinforcement learning for POMDPs
по: Igl, M, и др.
Опубликовано: (2018)

GradientDICE: rethinking generalized offline estimation of stationary values
по: Zhang, S, и др.
Опубликовано: (2020)

VIREL: A variational inference framework for reinforcement learning
по: Fellows, M, и др.
Опубликовано: (2019)

Stabilization Policy, Expected Output and Employment.
по: Bond, S
Опубликовано: (1988)

On Expectations, Government Policy and the Rate of Investment.
по: Nickell, S
Опубликовано: (1974)

Learning and expectations in macroeconomics /
по: Evans, George W., 1949-, и др.
Опубликовано: (2001)

Exploration in approximate hyper-state space for meta reinforcement learning
по: Zintgraf, L, и др.
Опубликовано: (2021)

Transient non−stationarity and generalisation in deep reinforcement learning
по: Igl, M, и др.
Опубликовано: (2021)

Verifiable reinforcement learning via policy extraction
по: Solar Lezama, Armando, и др.
Опубликовано: (2021)

Verified probabilistic policies for deep reinforcement learning
по: Bacci, E, и др.
Опубликовано: (2022)

Off-policy reinforcement learning with Gaussian processes
по: Chowdhary, Girish, и др.
Опубликовано: (2015)

Nonparametric Bayesian Policy Priors for Reinforcement Learning
по: Doshi-Velez, Finale P., и др.
Опубликовано: (2011)

Multi-agent common knowledge reinforcement learning
по: de Witt, C, и др.
Опубликовано: (2019)

Policy gradient methods for linear quadratic problems
по: Yang, H
Опубликовано: (2022)

TreeQN and ATreeC: differentiable tree planning for deep reinforcement learning
по: Farquhar, G, и др.
Опубликовано: (2018)

Inflation-Target Expectations and Optimal Monetary Policy.
по: Kapadia, S
Опубликовано: (2005)

Inflation-target expectations and optimal monetary policy
по: Kapadia, S
Опубликовано: (2005)

Reinforcement learning enhanced quantum-inspired algorithm for combinatorial optimization
по: Beloborodov, D, и др.
Опубликовано: (2020)