Architecture design and key technologies analysis of wargaming AI for sea-air cross-domain coordination

The breakthrough and progress of intelligent gaming technology with deep reinforcement learning as the core in the field of games provide a method reference for the research of agents in sea-air wargames. The architecture design of the agent is the primary core key problem that needs to be solved, a...

Full description

Bibliographic Details
Main Author: SU Jiongming, LUO Junren, CHEN Shaofei, XIANG Fengtao
Format: Article
Language:zho
Published: Editorial Office of Command Control and Simulation 2024-04-01
Series:Zhihui kongzhi yu fangzhen
Subjects:
Online Access:https://www.zhkzyfz.cn/fileup/1673-3819/PDF/1711964807320-1620836864.pdf
_version_ 1827298362274086912
author SU Jiongming, LUO Junren, CHEN Shaofei, XIANG Fengtao
author_facet SU Jiongming, LUO Junren, CHEN Shaofei, XIANG Fengtao
author_sort SU Jiongming, LUO Junren, CHEN Shaofei, XIANG Fengtao
collection DOAJ
description The breakthrough and progress of intelligent gaming technology with deep reinforcement learning as the core in the field of games provide a method reference for the research of agents in sea-air wargames. The architecture design of the agent is the primary core key problem that needs to be solved, and a good architecture can reduce the complexity and difficulty of training and accelerate the convergence of policies. A stochastic game model of sea-air cross-domain cooperative decision-making has been proposed, and its corresponding equilibrium solution concepts have been analyzed. Based on the analysis of typical agent frameworks, aiming at the decision-making gaming process of sea-air wargames, and then an agent bi-level architecture based on multi-Agent hierarchical reinforcement learning is proposed, which can effectively solve the problems of collaboration and dimensional disaster. The key technologies are analyzed from four aspects: force coordination, agent network design, adversary modeling and training mechanism. Hoping to provide architectural guidance for the subsequent design and implementation of sea-air wargaming agents.
first_indexed 2024-04-24T15:13:39Z
format Article
id doaj.art-37eb8ca36bf14564857c59bf06f0c95d
institution Directory Open Access Journal
issn 1673-3819
language zho
last_indexed 2024-04-24T15:13:39Z
publishDate 2024-04-01
publisher Editorial Office of Command Control and Simulation
record_format Article
series Zhihui kongzhi yu fangzhen
spelling doaj.art-37eb8ca36bf14564857c59bf06f0c95d2024-04-02T09:51:41ZzhoEditorial Office of Command Control and SimulationZhihui kongzhi yu fangzhen1673-38192024-04-01462354310.3969/j.issn.1673-3819.2024.02.006Architecture design and key technologies analysis of wargaming AI for sea-air cross-domain coordinationSU Jiongming, LUO Junren, CHEN Shaofei, XIANG Fengtao0College of Intelligence Science and Technology, National University of Defense Technology, Changsha 410073, ChinaThe breakthrough and progress of intelligent gaming technology with deep reinforcement learning as the core in the field of games provide a method reference for the research of agents in sea-air wargames. The architecture design of the agent is the primary core key problem that needs to be solved, and a good architecture can reduce the complexity and difficulty of training and accelerate the convergence of policies. A stochastic game model of sea-air cross-domain cooperative decision-making has been proposed, and its corresponding equilibrium solution concepts have been analyzed. Based on the analysis of typical agent frameworks, aiming at the decision-making gaming process of sea-air wargames, and then an agent bi-level architecture based on multi-Agent hierarchical reinforcement learning is proposed, which can effectively solve the problems of collaboration and dimensional disaster. The key technologies are analyzed from four aspects: force coordination, agent network design, adversary modeling and training mechanism. Hoping to provide architectural guidance for the subsequent design and implementation of sea-air wargaming agents.https://www.zhkzyfz.cn/fileup/1673-3819/PDF/1711964807320-1620836864.pdfsea-air wargame|cross-domain cooperation|wargaming|multi-agent|intelligent gaming|model architecture|hierarchical reinforcement learning
spellingShingle SU Jiongming, LUO Junren, CHEN Shaofei, XIANG Fengtao
Architecture design and key technologies analysis of wargaming AI for sea-air cross-domain coordination
Zhihui kongzhi yu fangzhen
sea-air wargame|cross-domain cooperation|wargaming|multi-agent|intelligent gaming|model architecture|hierarchical reinforcement learning
title Architecture design and key technologies analysis of wargaming AI for sea-air cross-domain coordination
title_full Architecture design and key technologies analysis of wargaming AI for sea-air cross-domain coordination
title_fullStr Architecture design and key technologies analysis of wargaming AI for sea-air cross-domain coordination
title_full_unstemmed Architecture design and key technologies analysis of wargaming AI for sea-air cross-domain coordination
title_short Architecture design and key technologies analysis of wargaming AI for sea-air cross-domain coordination
title_sort architecture design and key technologies analysis of wargaming ai for sea air cross domain coordination
topic sea-air wargame|cross-domain cooperation|wargaming|multi-agent|intelligent gaming|model architecture|hierarchical reinforcement learning
url https://www.zhkzyfz.cn/fileup/1673-3819/PDF/1711964807320-1620836864.pdf
work_keys_str_mv AT sujiongmingluojunrenchenshaofeixiangfengtao architecturedesignandkeytechnologiesanalysisofwargamingaiforseaaircrossdomaincoordination