Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks
Perhaps one of the best-known machine learning models is the artificial neural network, where a number of parameters must be adjusted to learn a wide range of practical problems from areas such as physics, chemistry, medicine, etc. Such problems can be reduced to pattern recognition problems and the...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-07-01
|
| Series: | AI |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2673-2688/4/3/27 |
| _version_ | 1797581627207974912 |
|---|---|
| author | Ioannis G. Tsoulos Alexandros Tzallas |
| author_facet | Ioannis G. Tsoulos Alexandros Tzallas |
| author_sort | Ioannis G. Tsoulos |
| collection | DOAJ |
| description | Perhaps one of the best-known machine learning models is the artificial neural network, where a number of parameters must be adjusted to learn a wide range of practical problems from areas such as physics, chemistry, medicine, etc. Such problems can be reduced to pattern recognition problems and then modeled from artificial neural networks, whether these problems are classification problems or regression problems. To achieve the goal of neural networks, they must be trained by appropriately adjusting their parameters using some global optimization methods. In this work, the application of a recent global minimization technique is suggested for the adjustment of neural network parameters. In this technique, an approximation of the objective function to be minimized is created using artificial neural networks and then sampling is performed from the approximation function and not the original one. Therefore, in the present work, learning of the parameters of artificial neural networks is performed using other neural networks. The new training method was tested on a series of well-known problems, a comparative study was conducted against other neural network parameter tuning techniques, and the results were more than promising. From what was seen after performing the experiments and comparing the proposed technique with others that have been used for classification datasets as well as regression datasets, there was a significant difference in the performance of the proposed technique, starting with 30% for classification datasets and reaching 50% for regression problems. However, the proposed technique, because it presupposes the use of global optimization techniques involving artificial neural networks, may require significantly higher execution time than other techniques. |
| first_indexed | 2024-03-10T23:07:08Z |
| format | Article |
| id | doaj.art-254d80321daa423284009a467964bc88 |
| institution | Directory Open Access Journal |
| issn | 2673-2688 |
| language | English |
| last_indexed | 2024-03-10T23:07:08Z |
| publishDate | 2023-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | AI |
| spelling | doaj.art-254d80321daa423284009a467964bc882023-11-19T09:12:22ZengMDPI AGAI2673-26882023-07-014349150810.3390/ai4030027Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural NetworksIoannis G. Tsoulos0Alexandros Tzallas1Department of Informatics and Telecommunications, University of Ioannina, 451 10 Ioannina, GreeceDepartment of Informatics and Telecommunications, University of Ioannina, 451 10 Ioannina, GreecePerhaps one of the best-known machine learning models is the artificial neural network, where a number of parameters must be adjusted to learn a wide range of practical problems from areas such as physics, chemistry, medicine, etc. Such problems can be reduced to pattern recognition problems and then modeled from artificial neural networks, whether these problems are classification problems or regression problems. To achieve the goal of neural networks, they must be trained by appropriately adjusting their parameters using some global optimization methods. In this work, the application of a recent global minimization technique is suggested for the adjustment of neural network parameters. In this technique, an approximation of the objective function to be minimized is created using artificial neural networks and then sampling is performed from the approximation function and not the original one. Therefore, in the present work, learning of the parameters of artificial neural networks is performed using other neural networks. The new training method was tested on a series of well-known problems, a comparative study was conducted against other neural network parameter tuning techniques, and the results were more than promising. From what was seen after performing the experiments and comparing the proposed technique with others that have been used for classification datasets as well as regression datasets, there was a significant difference in the performance of the proposed technique, starting with 30% for classification datasets and reaching 50% for regression problems. However, the proposed technique, because it presupposes the use of global optimization techniques involving artificial neural networks, may require significantly higher execution time than other techniques.https://www.mdpi.com/2673-2688/4/3/27global optimizationneural networksstochastic methods |
| spellingShingle | Ioannis G. Tsoulos Alexandros Tzallas Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks AI global optimization neural networks stochastic methods |
| title | Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks |
| title_full | Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks |
| title_fullStr | Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks |
| title_full_unstemmed | Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks |
| title_short | Training Artificial Neural Networks Using a Global Optimization Method That Utilizes Neural Networks |
| title_sort | training artificial neural networks using a global optimization method that utilizes neural networks |
| topic | global optimization neural networks stochastic methods |
| url | https://www.mdpi.com/2673-2688/4/3/27 |
| work_keys_str_mv | AT ioannisgtsoulos trainingartificialneuralnetworksusingaglobaloptimizationmethodthatutilizesneuralnetworks AT alexandrostzallas trainingartificialneuralnetworksusingaglobaloptimizationmethodthatutilizesneuralnetworks |