Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review

Reinforcement Learning is one of the many machine learning paradigms. With no labelled data, it is concerned with balancing the exploration and exploitation of an environment with one or more agents present in it. Recently, many breakthroughs have been made in the creation of these agents for video...

Full description

Bibliographic Details
Main Authors: Pedro Almeida, Vitor Carvalho, Alberto Simões
Format: Article
Language:English
Published: MDPI AG 2023-06-01
Series:Algorithms
Subjects:
Online Access:https://www.mdpi.com/1999-4893/16/7/323
_version_ 1797590607007318016
author Pedro Almeida
Vitor Carvalho
Alberto Simões
author_facet Pedro Almeida
Vitor Carvalho
Alberto Simões
author_sort Pedro Almeida
collection DOAJ
description Reinforcement Learning is one of the many machine learning paradigms. With no labelled data, it is concerned with balancing the exploration and exploitation of an environment with one or more agents present in it. Recently, many breakthroughs have been made in the creation of these agents for video game machine learning development, especially in first-person shooters with platforms such as ViZDoom, DeepMind Lab, and Unity’s ML-Agents. In this paper, we review the state-of-the-art of creation of Reinforcement Learning agents for use in multiplayer deathmatch first-person shooters. We selected various platforms, frameworks, and training architectures from various papers and examined each of them, analysing their uses. We compared each platform and training architecture, and then concluded whether machine learning agents can now face off against humans and whether they make for better gameplay than traditional Artificial Intelligence. In the end, we thought about future research and what researchers should keep in mind when exploring and testing this area.
first_indexed 2024-03-11T01:22:52Z
format Article
id doaj.art-cb3bec51a5344a1cb9abcd5762961b20
institution Directory Open Access Journal
issn 1999-4893
language English
last_indexed 2024-03-11T01:22:52Z
publishDate 2023-06-01
publisher MDPI AG
record_format Article
series Algorithms
spelling doaj.art-cb3bec51a5344a1cb9abcd5762961b202023-11-18T17:59:01ZengMDPI AGAlgorithms1999-48932023-06-0116732310.3390/a16070323Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic ReviewPedro Almeida0Vitor Carvalho1Alberto Simões22AI, School of Technology, Polytechnic Institute of Cávado and Ave, 4750 Barcelos, Portugal2AI, School of Technology, Polytechnic Institute of Cávado and Ave, 4750 Barcelos, Portugal2AI, School of Technology, Polytechnic Institute of Cávado and Ave, 4750 Barcelos, PortugalReinforcement Learning is one of the many machine learning paradigms. With no labelled data, it is concerned with balancing the exploration and exploitation of an environment with one or more agents present in it. Recently, many breakthroughs have been made in the creation of these agents for video game machine learning development, especially in first-person shooters with platforms such as ViZDoom, DeepMind Lab, and Unity’s ML-Agents. In this paper, we review the state-of-the-art of creation of Reinforcement Learning agents for use in multiplayer deathmatch first-person shooters. We selected various platforms, frameworks, and training architectures from various papers and examined each of them, analysing their uses. We compared each platform and training architecture, and then concluded whether machine learning agents can now face off against humans and whether they make for better gameplay than traditional Artificial Intelligence. In the end, we thought about future research and what researchers should keep in mind when exploring and testing this area.https://www.mdpi.com/1999-4893/16/7/323reinforcement learningdeep learningfirst-person shooterbotartificial intelligence
spellingShingle Pedro Almeida
Vitor Carvalho
Alberto Simões
Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review
Algorithms
reinforcement learning
deep learning
first-person shooter
bot
artificial intelligence
title Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review
title_full Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review
title_fullStr Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review
title_full_unstemmed Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review
title_short Reinforcement Learning Applied to AI Bots in First-Person Shooters: A Systematic Review
title_sort reinforcement learning applied to ai bots in first person shooters a systematic review
topic reinforcement learning
deep learning
first-person shooter
bot
artificial intelligence
url https://www.mdpi.com/1999-4893/16/7/323
work_keys_str_mv AT pedroalmeida reinforcementlearningappliedtoaibotsinfirstpersonshootersasystematicreview
AT vitorcarvalho reinforcementlearningappliedtoaibotsinfirstpersonshootersasystematicreview
AT albertosimoes reinforcementlearningappliedtoaibotsinfirstpersonshootersasystematicreview