NEURAL NETWORK-BASED METHODS FOR FINDING THE SHORTEST PATH and establishing associative connections between objects
Nowadays, solving optimizations problems is one of the tasks for intelligent computer systems. Currently, there is a problem of insufficient efficiency of optimizations tasks solving methods (for example, high computing time and/or accuracy). The object of the research is the process of finding the...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
National Aerospace University «Kharkiv Aviation Institute»
2023-05-01
|
| Series: | Радіоелектронні і комп'ютерні системи |
| Subjects: | |
| Online Access: | http://nti.khai.edu/ojs/index.php/reks/article/view/2027 |
| _version_ | 1797780842673602560 |
|---|---|
| author | Eugene Fedorov Olga Nechyporenko Maryna Chychuzhko Vladyslav Chychuzhko Ruslan Leshchenko |
| author_facet | Eugene Fedorov Olga Nechyporenko Maryna Chychuzhko Vladyslav Chychuzhko Ruslan Leshchenko |
| author_sort | Eugene Fedorov |
| collection | DOAJ |
| description | Nowadays, solving optimizations problems is one of the tasks for intelligent computer systems. Currently, there is a problem of insufficient efficiency of optimizations tasks solving methods (for example, high computing time and/or accuracy). The object of the research is the process of finding the shortest path and establishing associative connections between objects. The subject of the research is the methods of finding the shortest path and establishing associative connections between objects based on neural networks with associative memory and neural network reinforcement training. The objective of this work is to improve the efficiency of finding the shortest path and establishing associative connections between objects through neural networks with associative memory and neural network reinforcement training. To achieve this goal, a neuro-associative method and a neural network reinforcement training method was developed. The advantages of the proposed methods include the following. First, the proposed bi-directional recurrent correlative associative memory, which uses hetero-associative and auto-associative memory and an exponential weighting function, allows for increasing the associative memory capacity while preserving learning accuracy. Second, the Deep Q-Network (DQN) reinforcement learning method with dynamic parameters uses the ε-greedy approach, which in the initial iterations is close to random search, and in the final iterations is close to directed search, which is ensured by using dynamic parameters and allows increasing the learning speed while preserving learning accuracy. Conducted numerical research allowed us to estimate both methods (for the first method, the root mean square error was 0.02, and for the second method it was 0.05). The proposed methods allow expanding the field of application of neural networks with associative memory and neural network reinforcement learning, which is confirmed by their adaptation for the tasks of finding the shortest path and establishing associative connections between objects and contribute to the effectiveness of intelligent computer systems of general and special purpose. Prospects for further research are to investigate the proposed methods for a wide class of artificial intelligence problems. |
| first_indexed | 2024-03-12T23:49:31Z |
| format | Article |
| id | doaj.art-9ac98f6c6b564ef189bba5de63f16a09 |
| institution | Directory Open Access Journal |
| issn | 1814-4225 2663-2012 |
| language | English |
| last_indexed | 2024-03-12T23:49:31Z |
| publishDate | 2023-05-01 |
| publisher | National Aerospace University «Kharkiv Aviation Institute» |
| record_format | Article |
| series | Радіоелектронні і комп'ютерні системи |
| spelling | doaj.art-9ac98f6c6b564ef189bba5de63f16a092023-07-13T21:23:18ZengNational Aerospace University «Kharkiv Aviation Institute»Радіоелектронні і комп'ютерні системи1814-42252663-20122023-05-0102546410.32620/reks.2023.2.051933NEURAL NETWORK-BASED METHODS FOR FINDING THE SHORTEST PATH and establishing associative connections between objectsEugene Fedorov0Olga Nechyporenko1Maryna Chychuzhko2Vladyslav Chychuzhko3Ruslan Leshchenko4Cherkasy State Technological University, CherkasyCherkasy State Technological University, CherkasyCherkasy State Technological University, CherkasyCherkasy State Technological University, CherkasyCherkasy State Technological University, CherkasyNowadays, solving optimizations problems is one of the tasks for intelligent computer systems. Currently, there is a problem of insufficient efficiency of optimizations tasks solving methods (for example, high computing time and/or accuracy). The object of the research is the process of finding the shortest path and establishing associative connections between objects. The subject of the research is the methods of finding the shortest path and establishing associative connections between objects based on neural networks with associative memory and neural network reinforcement training. The objective of this work is to improve the efficiency of finding the shortest path and establishing associative connections between objects through neural networks with associative memory and neural network reinforcement training. To achieve this goal, a neuro-associative method and a neural network reinforcement training method was developed. The advantages of the proposed methods include the following. First, the proposed bi-directional recurrent correlative associative memory, which uses hetero-associative and auto-associative memory and an exponential weighting function, allows for increasing the associative memory capacity while preserving learning accuracy. Second, the Deep Q-Network (DQN) reinforcement learning method with dynamic parameters uses the ε-greedy approach, which in the initial iterations is close to random search, and in the final iterations is close to directed search, which is ensured by using dynamic parameters and allows increasing the learning speed while preserving learning accuracy. Conducted numerical research allowed us to estimate both methods (for the first method, the root mean square error was 0.02, and for the second method it was 0.05). The proposed methods allow expanding the field of application of neural networks with associative memory and neural network reinforcement learning, which is confirmed by their adaptation for the tasks of finding the shortest path and establishing associative connections between objects and contribute to the effectiveness of intelligent computer systems of general and special purpose. Prospects for further research are to investigate the proposed methods for a wide class of artificial intelligence problems.http://nti.khai.edu/ojs/index.php/reks/article/view/2027reinforcement learningneural networkassociative memoryestablishing associative connections between objectsfinding the shortest path |
| spellingShingle | Eugene Fedorov Olga Nechyporenko Maryna Chychuzhko Vladyslav Chychuzhko Ruslan Leshchenko NEURAL NETWORK-BASED METHODS FOR FINDING THE SHORTEST PATH and establishing associative connections between objects Радіоелектронні і комп'ютерні системи reinforcement learning neural network associative memory establishing associative connections between objects finding the shortest path |
| title | NEURAL NETWORK-BASED METHODS FOR FINDING THE SHORTEST PATH and establishing associative connections between objects |
| title_full | NEURAL NETWORK-BASED METHODS FOR FINDING THE SHORTEST PATH and establishing associative connections between objects |
| title_fullStr | NEURAL NETWORK-BASED METHODS FOR FINDING THE SHORTEST PATH and establishing associative connections between objects |
| title_full_unstemmed | NEURAL NETWORK-BASED METHODS FOR FINDING THE SHORTEST PATH and establishing associative connections between objects |
| title_short | NEURAL NETWORK-BASED METHODS FOR FINDING THE SHORTEST PATH and establishing associative connections between objects |
| title_sort | neural network based methods for finding the shortest path and establishing associative connections between objects |
| topic | reinforcement learning neural network associative memory establishing associative connections between objects finding the shortest path |
| url | http://nti.khai.edu/ojs/index.php/reks/article/view/2027 |
| work_keys_str_mv | AT eugenefedorov neuralnetworkbasedmethodsforfindingtheshortestpathandestablishingassociativeconnectionsbetweenobjects AT olganechyporenko neuralnetworkbasedmethodsforfindingtheshortestpathandestablishingassociativeconnectionsbetweenobjects AT marynachychuzhko neuralnetworkbasedmethodsforfindingtheshortestpathandestablishingassociativeconnectionsbetweenobjects AT vladyslavchychuzhko neuralnetworkbasedmethodsforfindingtheshortestpathandestablishingassociativeconnectionsbetweenobjects AT ruslanleshchenko neuralnetworkbasedmethodsforfindingtheshortestpathandestablishingassociativeconnectionsbetweenobjects |