Maneuver Decision-Making for Autonomous Air Combat Based on FRE-PPO

Maneuver Decision-Making for Autonomous Air Combat Based on FRE-PPO

Maneuver decision-making is the core of autonomous air combat, and reinforcement learning is a potential and ideal approach for addressing decision-making problems. However, when reinforcement learning is used for maneuver decision-making for autonomous air combat, it often suffers from awful traini...

Full description

Bibliographic Details
Main Authors:	Hongpeng Zhang, Yujie Wei, Huan Zhou, Changqiang Huang
Format:	Article
Language:	English
Published:	MDPI AG 2022-10-01
Series:	Applied Sciences
Subjects:	autonomous air combat maneuver decision-making reinforcement learning final reward estimation proximal policy optimization
Online Access:	https://www.mdpi.com/2076-3417/12/20/10230

Similar Items

Autonomous maneuver decision-making method based on reinforcement learning and Monte Carlo tree search
by: Hongpeng Zhang, et al.
Published: (2022-10-01)

Research on Intelligent Maneuvering Decision-Making in Close Air Combat Based on Deep Q Network
by: Zhang Tingyu, Sun Mingwei, Wang Yongshuai, Chen Zengqiang
Published: (2023-06-01)

Autonomous Maneuver Decision-Making Through Curriculum Learning and Reinforcement Learning With Sparse Rewards
by: Yujie Wei, et al.
Published: (2023-01-01)

Maneuver Decision-Making through Automatic Curriculum Reinforcement Learning without Handcrafted Reward Functions
by: Yujie Wei, et al.
Published: (2023-08-01)

Autonomous Maneuver Decision of Air Combat Based on Simulated Operation Command and FRV-DDPG Algorithm
by: Yongfeng Li, et al.
Published: (2022-10-01)

UCAV Air Combat Maneuver Decisions Based on a Proximal Policy Optimization Algorithm with Situation Reward Shaping
by: Kaibiao Yang, et al.
Published: (2022-08-01)

Autonomous Maneuver Decision Making of Dual-UAV Cooperative Air Combat Based on Deep Reinforcement Learning
by: Jinwen Hu, et al.
Published: (2022-02-01)

Maneuver Decision-Making of Deep Learning for UCAV Thorough Azimuth Angles
by: Hongpeng Zhang, et al.
Published: (2020-01-01)

A UAV Maneuver Decision-Making Algorithm for Autonomous Airdrop Based on Deep Reinforcement Learning
by: Ke Li, et al.
Published: (2021-03-01)

Autonomous Air Combat Maneuvering Decision Method of UCAV Based on LSHADE-TSO-MPC under Enemy Trajectory Prediction
by: Mulai Tan, et al.
Published: (2022-10-01)

Maneuver Decision of Cooperative Air Combat within Visual Range Based on MATD3
by: Zhang Dong, Tang Junlin, Xiong Wei, Ren Zhi, Yang Shuheng
Published: (2023-06-01)

Autonomous Maneuver Decision-Making of UCAV with Incomplete Information in Human-Computer Gaming
by: Shouyi Li, et al.
Published: (2023-02-01)

Autonomous maneuver decision-making for a UCAV in short-range aerial combat based on an MS-DDQN algorithm
by: Yong-feng Li, et al.
Published: (2022-09-01)

Hierarchical multi‐agent reinforcement learning for multi‐aircraft close‐range air combat
by: Wei‐ren Kong, et al.
Published: (2023-09-01)

Continuous Decision-making Method for Autonomous Air Combat
by: SHAN Shengzhe, et al.
Published: (2022-10-01)

Cooperative maneuver decision making for multi-UAV air combat based on incomplete information dynamic game
by: Zhi Ren, et al.
Published: (2023-09-01)

Maneuver Strategy Generation of UCAV for within Visual Range Air Combat Based on Multi-Agent Reinforcement Learning and Target Position Prediction
by: Weiren Kong, et al.
Published: (2020-07-01)

Air Combat Maneuver Decision Based on Reinforcement Genetic Algorithm
Published: (2020-12-01)

High-Fidelity Decision-Making and Simulation for Cooperative Autonomous Air Combat Considering the Effect of Flight Controller
by: Zhihao Wang, et al.
Published: (2022-01-01)

Multi-aircraft cooperative air combat maneuvering decision based on Cook-Seiford group decision algorithm
by: ZHOU Siyu, SHI Yu, YANG Wenqi, WANG Zijian, GAO Li, GAO Yanli
Published: (2023-08-01)

Research on Deep Q-Network Hybridization with Extended Kalman Filter in Maneuvering Decision of Unmanned Combat Aerial Vehicles
by: Juntao Ruan, et al.
Published: (2024-01-01)

A Decision Method for Autonomous Maneuver in Close Range Air Combat Based on Matrix Game Theory
by: Wang Fangjie, Huang Peng, Zhang Zijun, Sun Chong
Published: (2023-12-01)

Identification of 4-DoF maneuvering mathematical models for a combatant in intact and damaged conditions
by: Myungjun Jeon, et al.
Published: (2022-01-01)

Air Combat Maneuver Strategy Algorithm Based on Two-Layer Game Decision-Making and Distributed Double Game Trees MCTS under Uncertain Information
by: Qiuni Li, et al.
Published: (2022-08-01)

Application of Deep Reinforcement Learning in Maneuver Planning of Beyond-Visual-Range Air Combat
by: Dongyuan Hu, et al.
Published: (2021-01-01)

Situational continuity-based air combat autonomous maneuvering decision-making
by: Jian-dong Zhang, et al.
Published: (2023-11-01)

Coordinated Control Design for Ethical Maneuvering of Autonomous Vehicles
by: Balázs Németh
Published: (2023-05-01)

UAV Air Game Maneuver Decision-Making Using Dueling Double Deep Q Network with Expert Experience Storage Mechanism
by: Jiahui Zhang, et al.
Published: (2023-06-01)

Combining Event-Based Maneuver Selection and MPC Based Trajectory Generation in Autonomous Driving
by: Ni Dang, et al.
Published: (2022-05-01)

An Empirical Study of DDPG and PPO-Based Reinforcement Learning Algorithms for Autonomous Driving
by: Sanjna Siboo, et al.
Published: (2023-01-01)

An Adaptive Control Framework for the Autonomous Aerobatic Maneuvers of Fixed-Wing Unmanned Aerial Vehicle
by: Su Cao, et al.
Published: (2022-10-01)

Evasive Maneuver Strategy for UCAV in Beyond-Visual-Range Air Combat Based on Hierarchical Multi-Objective Evolutionary Algorithm
by: Zhen Yang, et al.
Published: (2020-01-01)

Efficacy evaluation of adaptive collision avoidance systems for autonomous maritime surface ships based on target ships’ maneuvering behaviors
by: H. S. Hwang, et al.
Published: (2024-01-01)

Maneuver-Based Objectification of User Comfort Affecting Aspects of Driving Style of Autonomous Vehicle Concepts
by: Ferdinand Schockenhoff, et al.
Published: (2020-06-01)

Estimating Critical Latency Affecting Ship’s Collision in Re-Mote Maneuvering of Autonomous Ships
by: Jeong-Bin Yim, et al.
Published: (2021-11-01)

Decision-Making Strategies for Close-Range Air Combat Based on Reinforcement Learning with Variable-Scale Actions
by: Lixin Wang, et al.
Published: (2023-04-01)

Confrontation and Obstacle-Avoidance of Unmanned Vehicles Based on Progressive Reinforcement Learning
by: Chengdong Ma, et al.
Published: (2023-01-01)

Autonomous Vehicle Emergency Obstacle Avoidance Maneuver Framework at Highway Speeds
by: Evan Lowe, et al.
Published: (2023-11-01)

Optimal Maneuvering for Autonomous Vehicle Self-Localization
by: John L. McGuire, et al.
Published: (2022-08-01)

UAV Autonomous Aerial Combat Maneuver Strategy Generation with Observation Error Based on State-Adversarial Deep Deterministic Policy Gradient and Inverse Reinforcement Learning
by: Weiren Kong, et al.
Published: (2020-07-01)