Scaling Up Q-Learning via Exploiting State–Action Equivalence

Scaling Up Q-Learning via Exploiting State–Action Equivalence

Recent success stories in reinforcement learning have demonstrated that leveraging structural properties of the underlying environment is key in devising viable methods capable of solving complex tasks. We study off-policy learning in discounted reinforcement learning, where some equivalence relatio...

Full description

Bibliographic Details
Main Authors:	Yunlian Lyu, Aymeric Côme, Yijie Zhang, Mohammad Sadegh Talebi
Format:	Article
Language:	English
Published:	MDPI AG 2023-03-01
Series:	Entropy
Subjects:	reinforcement learning Markov decision process Q-learning equivalence structure
Online Access:	https://www.mdpi.com/1099-4300/25/4/584

Similar Items

UAV Autonomous Target Search Based on Deep Reinforcement Learning in Complex Disaster Scene
by: Chunxue Wu, et al.
Published: (2019-01-01)

Making virtual learning environment more intelligent: application of Markov decision process
by: Dalia Baziukaitė
Published: (2004-12-01)

Multi-Agent Reinforcement Learning with Optimal Equivalent Action of Neighborhood
by: Haixing Wang, et al.
Published: (2022-03-01)

EFFICIENT SPECTRUM UTILIZATION IN COGNITIVE RADIO THROUGH REINFORCEMENT LEARNING
by: Dhananjay Kumar, et al.
Published: (2013-09-01)

Double Speedy Q-Learning Based on Successive Over Relaxation
by: ZHOU Qin, LUO Fei, DING Wei-chao, GU Chun-hua, ZHENG Shuai
Published: (2022-03-01)

Recent Advances in Deep Reinforcement Learning Applications for Solving Partially Observable Markov Decision Processes (POMDP) Problems Part 2—Applications in Transportation, Industries, Communications and Networking and More Topics
by: Xuanchen Xiang, et al.
Published: (2021-10-01)

Recent Advances in Deep Reinforcement Learning Applications for Solving Partially Observable Markov Decision Processes (POMDP) Problems: Part 1—Fundamentals and Applications in Games, Robotics and Natural Language Processing
by: Xuanchen Xiang, et al.
Published: (2021-07-01)

Smart E-Learning Framework for Personalized Adaptive Learning and Sequential Path Recommendations Using Reinforcement Learning
by: Samina Amin, et al.
Published: (2023-01-01)

Reinforcement Learning Models and Algorithms for Diabetes Management
by: Kok-Lim Alvin Yau, et al.
Published: (2023-01-01)

Improved Q-Learning Algorithm Based on Approximate State Matching in Agricultural Plant Protection Environment
by: Fengjie Sun, et al.
Published: (2021-06-01)

A Countermeasure Against Random Pulse Jamming in Time Domain Based on Reinforcement Learning
by: Quan Zhou, et al.
Published: (2020-01-01)

Double Deep Q-Learning and Faster R-CNN-Based Autonomous Vehicle Navigation and Obstacle Avoidance in Dynamic Environment
by: Razin Bin Issa, et al.
Published: (2021-02-01)

Deep Q-Network Approach for Train Timetable Rescheduling Based on Alternative Graph
by: Kyung-Min Kim, et al.
Published: (2023-08-01)

CARL: A Synergistic Framework for Causal Reinforcement Learning
by: Arquimides Mendez-Molina, et al.
Published: (2023-01-01)

Exploiting Distributional Temporal Difference Learning to Deal with Tail Risk
by: Peter Bossaerts, et al.
Published: (2020-10-01)

Adaptive Routing in Wireless Mesh Networks Using Hybrid Reinforcement Learning Algorithm
by: Smita Mahajan, et al.
Published: (2022-01-01)

Optimizing Packet Forwarding Performance in Multiband Relay Networks via Customized Reinforcement Learning
by: Bushra Mughal, et al.
Published: (2022-01-01)

Reinforcement Learning Rebirth, Techniques, Challenges, and Resolutions
by: Wasswa Shafik, et al.
Published: (2020-09-01)

Optimal Design of Wireless Charging Electric Bus System Based on Reinforcement Learning
by: Hyukjoon Lee, et al.
Published: (2019-03-01)

A Systematic Study on Reinforcement Learning Based Applications
by: Keerthana Sivamayil, et al.
Published: (2023-02-01)

Assessing the Use of Reinforcement Learning for Integrated Voltage/Frequency Control in AC Microgrids
by: Abdollah Younesi, et al.
Published: (2020-03-01)

Reinforcement Learning in Education: A Literature Review
by: Bisni Fahad Mon, et al.
Published: (2023-09-01)

How are reinforcement learning and deep learning algorithms used for big data based decision making in financial industries–A review and research agenda
by: Vinay Singh, et al.
Published: (2022-11-01)

A Reinforcement Learning Method of Solving Markov Decision Processes: An Adaptive Exploration Model Based on Temporal Difference Error
by: Xianjia Wang, et al.
Published: (2023-10-01)

Off‐policy correction algorithm for double Q network based on deep reinforcement learning
by: Qingbo Zhang, et al.
Published: (2023-12-01)

Dynamic Spectrum Access with Deep Q-learning in Densely Occupied and Partially Observable Environments
by: S. Tomovic, et al.
Published: (2021-07-01)

Survey of Reinforcement Learning Based Recommender Systems
by: YU Li, DU Qi-han, YUE Bo-yan, XIANG Jun-yao, XU Guan-yu, LENG You-fang
Published: (2021-10-01)

Bat Q-learning Algorithm
by: Bilal Hashem Abed-alguni
Published: (2017-04-01)

Constrained Deep Q-Learning Gradually Approaching Ordinary Q-Learning
by: Shota Ohnishi, et al.
Published: (2019-12-01)

OPTIMUM SHORT PATH FINDER FOR ROBOT USING Q-LEARNING
by: Mohannad Abid Shehab Ahmed
Published: (2012-06-01)

Parallel Implementation of Reinforcement Learning Q-Learning Technique for FPGA
by: Lucileide M. D. Da Silva, et al.
Published: (2019-01-01)

Learning and Assessing Optimal Dynamic Treatment Regimes Through Cooperative Imitation Learning
by: Syed Ihtesham Hussain Shah, et al.
Published: (2022-01-01)

Large-Scale Wildfire Mitigation Through Deep Reinforcement Learning
by: Abdulelah Altamimi, et al.
Published: (2022-07-01)

Deep Reinforcement Learning Approach for HAPS User Scheduling in Massive MIMO Communications
by: Sara Sharifi, et al.
Published: (2024-01-01)

Optimization of Graded Arrays of Resonators for Energy Harvesting in Sensors as a Markov Decision Process Solved via Reinforcement Learning
by: Luca Rosafalco, et al.
Published: (2022-11-01)

An Optimal Active Defensive Security Framework for the Container-Based Cloud with Deep Reinforcement Learning
by: Yuanbo Li, et al.
Published: (2023-03-01)

The Essential Dynamics Algorithm: Essential Results
by: Martin, Martin C.
Published: (2004)

ADAS-RL: Safety learning approach for stable autonomous driving
by: Dongsu Lee, et al.
Published: (2022-09-01)

Local Energy Trading Behavior Modeling With Deep Reinforcement Learning
by: Tao Chen, et al.
Published: (2018-01-01)

Timeslot Scheduling with Reinforcement Learning Using a Double Deep Q-Network
by: Jihye Ryu, et al.
Published: (2023-02-01)