Method of automatic search for the structure and parameters of neural networks for solving information processing problems
Neural networks are actively used in solving various applied problems of data analysis, processing and generation. When using them, one of the difficult stages is the selection of the structure and parameters of neural networks (the number and types of layers of neurons, activation functions, optimi...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Saratov State University
2023-03-01
|
| Series: | Известия Саратовского университета. Новая серия. Серия Математика. Механика. Информатика |
| Subjects: | |
| Online Access: | https://mmi.sgu.ru/sites/mmi.sgu.ru/files/text-pdf/2023/02/113-125-obukhov.pdf |
| _version_ | 1811160706373910528 |
|---|---|
| author | Obukhov, Artem D. |
| author_facet | Obukhov, Artem D. |
| author_sort | Obukhov, Artem D. |
| collection | DOAJ |
| description | Neural networks are actively used in solving various applied problems of data analysis, processing and generation. When using them, one of the difficult stages is the selection of the structure and parameters of neural networks (the number and types of layers of neurons, activation functions, optimizers, and so on) that provide the greatest accuracy and, therefore, the success of solving the problem. Currently, this issue is being solved by analytical selection of the neural network architecture by a researcher or software developer. Existing automatic tools (AutoKeras, AutoGAN, AutoSklearn, DEvol and others) are not universal and functional enough. Therefore, within the framework of this work, a method of automatic search for the structure and parameters of neural networks of various types (multilayer dense, convolutional, generative-adversarial, autoencoders, and others) is considered for solving a wide class of problems. The formalization of the method and its main stages are presented. The approbation of the method is considered, which proves its effectiveness in relation to the analytical solution in the selection of the architecture of the neural network. A comparison of the method with existing analogues is carried out, its advantage is revealed in terms of the accuracy of the formed neural networks and the time to find a solution. The research results can be used to solve a large class of data processing problems for which it is required to automate the selection of the structure and parameters of a neural network. |
| first_indexed | 2024-04-10T06:01:58Z |
| format | Article |
| id | doaj.art-af7968d42a074f1391a4baf20ed3b0fb |
| institution | Directory Open Access Journal |
| issn | 1816-9791 2541-9005 |
| language | English |
| last_indexed | 2024-04-10T06:01:58Z |
| publishDate | 2023-03-01 |
| publisher | Saratov State University |
| record_format | Article |
| series | Известия Саратовского университета. Новая серия. Серия Математика. Механика. Информатика |
| spelling | doaj.art-af7968d42a074f1391a4baf20ed3b0fb2023-03-03T07:41:31ZengSaratov State UniversityИзвестия Саратовского университета. Новая серия. Серия Математика. Механика. Информатика1816-97912541-90052023-03-0123111312510.18500/1816-9791-2023-23-1-113-125Method of automatic search for the structure and parameters of neural networks for solving information processing problemsObukhov, Artem D.0Tambov State Technical University, 106 Sovetskaya St., Tambov 392000, RussiaNeural networks are actively used in solving various applied problems of data analysis, processing and generation. When using them, one of the difficult stages is the selection of the structure and parameters of neural networks (the number and types of layers of neurons, activation functions, optimizers, and so on) that provide the greatest accuracy and, therefore, the success of solving the problem. Currently, this issue is being solved by analytical selection of the neural network architecture by a researcher or software developer. Existing automatic tools (AutoKeras, AutoGAN, AutoSklearn, DEvol and others) are not universal and functional enough. Therefore, within the framework of this work, a method of automatic search for the structure and parameters of neural networks of various types (multilayer dense, convolutional, generative-adversarial, autoencoders, and others) is considered for solving a wide class of problems. The formalization of the method and its main stages are presented. The approbation of the method is considered, which proves its effectiveness in relation to the analytical solution in the selection of the architecture of the neural network. A comparison of the method with existing analogues is carried out, its advantage is revealed in terms of the accuracy of the formed neural networks and the time to find a solution. The research results can be used to solve a large class of data processing problems for which it is required to automate the selection of the structure and parameters of a neural network.https://mmi.sgu.ru/sites/mmi.sgu.ru/files/text-pdf/2023/02/113-125-obukhov.pdfneural networksmachine learningoptimization of the neural network structuredata analysis and processingconvolutional neural networksautoencodersgenerative-adversarial networks |
| spellingShingle | Obukhov, Artem D. Method of automatic search for the structure and parameters of neural networks for solving information processing problems Известия Саратовского университета. Новая серия. Серия Математика. Механика. Информатика neural networks machine learning optimization of the neural network structure data analysis and processing convolutional neural networks autoencoders generative-adversarial networks |
| title | Method of automatic search for the structure and parameters of neural networks for solving information processing problems |
| title_full | Method of automatic search for the structure and parameters of neural networks for solving information processing problems |
| title_fullStr | Method of automatic search for the structure and parameters of neural networks for solving information processing problems |
| title_full_unstemmed | Method of automatic search for the structure and parameters of neural networks for solving information processing problems |
| title_short | Method of automatic search for the structure and parameters of neural networks for solving information processing problems |
| title_sort | method of automatic search for the structure and parameters of neural networks for solving information processing problems |
| topic | neural networks machine learning optimization of the neural network structure data analysis and processing convolutional neural networks autoencoders generative-adversarial networks |
| url | https://mmi.sgu.ru/sites/mmi.sgu.ru/files/text-pdf/2023/02/113-125-obukhov.pdf |
| work_keys_str_mv | AT obukhovartemd methodofautomaticsearchforthestructureandparametersofneuralnetworksforsolvinginformationprocessingproblems |