Nature-Inspired cognitive evolution to play Ms. Pac-Man

Recent developments in nature-inspired computation have heightened the need for research into the three main areas of scientific, engineering and industrial applications. Some approaches have reported that it is able to solve dynamic problems and very useful for improving the performance of various...

Full description

Bibliographic Details
Main Authors: Tse, Guan Tan, Jason Teo, Patricia Anthony
Format: Article
Language:English
Published: 2011
Subjects:
Online Access:https://eprints.ums.edu.my/id/eprint/20595/1/Nature%20Inspired%20cognitive%20evolution%20to%20play.pdf
_version_ 1825713541613617152
author Tse, Guan Tan
Jason Teo
Patricia Anthony
author_facet Tse, Guan Tan
Jason Teo
Patricia Anthony
author_sort Tse, Guan Tan
collection UMS
description Recent developments in nature-inspired computation have heightened the need for research into the three main areas of scientific, engineering and industrial applications. Some approaches have reported that it is able to solve dynamic problems and very useful for improving the performance of various complex systems. So far however, there has been little discussion about the effectiveness of the application of these models to computer and video games in particular. The focus of this research is to explore the hybridization of nature-inspired computation methods for optimization of neural network-based cognition in video games, in this case the combination of a neural network with an evolutionary algorithm. In essence, a neural network is an attempt to mimic the extremely complex human brain system, which is building an artificial brain that is able to self-learn intelligently. On the other hand, an evolutionary algorithm is to simulate the biological evolutionary processes that evolve potential solutions in order to solve the problems or tasks by applying the genetic operators such as crossover, mutation and selection into the solutions. This paper investigates the abilities of Evolution Strategies (ES) to evolve feed-forward artificial neural network’s internal parameters (i.e. weight and bias values) for automatically generating Ms. Pac-man controllers. The main objective of this game is to clear a maze of dots while avoiding the ghosts and to achieve the highest possible score. The experimental results show that an ES-based system can be successfully applied to automatically generate artificial intelligence for a complex, dynamic and highly stochastic video game environment.
first_indexed 2024-03-06T02:58:11Z
format Article
id ums.eprints-20595
institution Universiti Malaysia Sabah
language English
last_indexed 2024-03-06T02:58:11Z
publishDate 2011
record_format dspace
spelling ums.eprints-205952018-07-27T05:29:38Z https://eprints.ums.edu.my/id/eprint/20595/ Nature-Inspired cognitive evolution to play Ms. Pac-Man Tse, Guan Tan Jason Teo Patricia Anthony QA Mathematics Recent developments in nature-inspired computation have heightened the need for research into the three main areas of scientific, engineering and industrial applications. Some approaches have reported that it is able to solve dynamic problems and very useful for improving the performance of various complex systems. So far however, there has been little discussion about the effectiveness of the application of these models to computer and video games in particular. The focus of this research is to explore the hybridization of nature-inspired computation methods for optimization of neural network-based cognition in video games, in this case the combination of a neural network with an evolutionary algorithm. In essence, a neural network is an attempt to mimic the extremely complex human brain system, which is building an artificial brain that is able to self-learn intelligently. On the other hand, an evolutionary algorithm is to simulate the biological evolutionary processes that evolve potential solutions in order to solve the problems or tasks by applying the genetic operators such as crossover, mutation and selection into the solutions. This paper investigates the abilities of Evolution Strategies (ES) to evolve feed-forward artificial neural network’s internal parameters (i.e. weight and bias values) for automatically generating Ms. Pac-man controllers. The main objective of this game is to clear a maze of dots while avoiding the ghosts and to achieve the highest possible score. The experimental results show that an ES-based system can be successfully applied to automatically generate artificial intelligence for a complex, dynamic and highly stochastic video game environment. 2011 Article PeerReviewed text en https://eprints.ums.edu.my/id/eprint/20595/1/Nature%20Inspired%20cognitive%20evolution%20to%20play.pdf Tse, Guan Tan and Jason Teo and Patricia Anthony (2011) Nature-Inspired cognitive evolution to play Ms. Pac-Man. International Journal of Modern Physics: Conference Series, 9. pp. 456-463. https://doi.org/10.1142/S2010194512005545
spellingShingle QA Mathematics
Tse, Guan Tan
Jason Teo
Patricia Anthony
Nature-Inspired cognitive evolution to play Ms. Pac-Man
title Nature-Inspired cognitive evolution to play Ms. Pac-Man
title_full Nature-Inspired cognitive evolution to play Ms. Pac-Man
title_fullStr Nature-Inspired cognitive evolution to play Ms. Pac-Man
title_full_unstemmed Nature-Inspired cognitive evolution to play Ms. Pac-Man
title_short Nature-Inspired cognitive evolution to play Ms. Pac-Man
title_sort nature inspired cognitive evolution to play ms pac man
topic QA Mathematics
url https://eprints.ums.edu.my/id/eprint/20595/1/Nature%20Inspired%20cognitive%20evolution%20to%20play.pdf
work_keys_str_mv AT tseguantan natureinspiredcognitiveevolutiontoplaymspacman
AT jasonteo natureinspiredcognitiveevolutiontoplaymspacman
AT patriciaanthony natureinspiredcognitiveevolutiontoplaymspacman