Lipschitz global optimization and machine learning: helping each other to solve complex problems
In this paper we consider global optimization problems and methods for solving them. The numerical solution of this class of problems is computationally challenging. The most complex problems are multicriteria problems in which the objective functions are multiextremal and non-differentiable, and, m...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2024-01-01
|
| Series: | ITM Web of Conferences |
| Online Access: | https://www.itm-conferences.org/articles/itmconf/pdf/2024/02/itmconf_hmmocs2023_01019.pdf |
| _version_ | 1797333962354327552 |
|---|---|
| author | Usova Marina Barkalov Konstantin |
| author_facet | Usova Marina Barkalov Konstantin |
| author_sort | Usova Marina |
| collection | DOAJ |
| description | In this paper we consider global optimization problems and methods for solving them. The numerical solution of this class of problems is computationally challenging. The most complex problems are multicriteria problems in which the objective functions are multiextremal and non-differentiable, and, moreover, given in the form of a “black box”, i.e. calculating the objective function at a point is a time-consuming operation. Particularly, we consider an approach to acceleration of the global search using machine learning methods. At the same time, the problem of tuning the hyperparameters of the machine learning methods themselves is very important. The quality of machine learning methods is substantially affected by their hyperparameters, while the evaluation of the quality metrics is a time-consuming operation. We also consider an approach to hyperparameter tuning based on the Lipschitz global optimization. These approaches are implemented in the iOpt open-source framework of intelligent optimization methods. |
| first_indexed | 2024-03-08T08:13:47Z |
| format | Article |
| id | doaj.art-b76d5deaf2834f5ea6178e2bb521dd53 |
| institution | Directory Open Access Journal |
| issn | 2271-2097 |
| language | English |
| last_indexed | 2024-03-08T08:13:47Z |
| publishDate | 2024-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | ITM Web of Conferences |
| spelling | doaj.art-b76d5deaf2834f5ea6178e2bb521dd532024-02-02T08:04:05ZengEDP SciencesITM Web of Conferences2271-20972024-01-01590101910.1051/itmconf/20245901019itmconf_hmmocs2023_01019Lipschitz global optimization and machine learning: helping each other to solve complex problemsUsova Marina0Barkalov Konstantin1Lobachevsky State University of Nizhny NovgorodLobachevsky State University of Nizhny NovgorodIn this paper we consider global optimization problems and methods for solving them. The numerical solution of this class of problems is computationally challenging. The most complex problems are multicriteria problems in which the objective functions are multiextremal and non-differentiable, and, moreover, given in the form of a “black box”, i.e. calculating the objective function at a point is a time-consuming operation. Particularly, we consider an approach to acceleration of the global search using machine learning methods. At the same time, the problem of tuning the hyperparameters of the machine learning methods themselves is very important. The quality of machine learning methods is substantially affected by their hyperparameters, while the evaluation of the quality metrics is a time-consuming operation. We also consider an approach to hyperparameter tuning based on the Lipschitz global optimization. These approaches are implemented in the iOpt open-source framework of intelligent optimization methods.https://www.itm-conferences.org/articles/itmconf/pdf/2024/02/itmconf_hmmocs2023_01019.pdf |
| spellingShingle | Usova Marina Barkalov Konstantin Lipschitz global optimization and machine learning: helping each other to solve complex problems ITM Web of Conferences |
| title | Lipschitz global optimization and machine learning: helping each other to solve complex problems |
| title_full | Lipschitz global optimization and machine learning: helping each other to solve complex problems |
| title_fullStr | Lipschitz global optimization and machine learning: helping each other to solve complex problems |
| title_full_unstemmed | Lipschitz global optimization and machine learning: helping each other to solve complex problems |
| title_short | Lipschitz global optimization and machine learning: helping each other to solve complex problems |
| title_sort | lipschitz global optimization and machine learning helping each other to solve complex problems |
| url | https://www.itm-conferences.org/articles/itmconf/pdf/2024/02/itmconf_hmmocs2023_01019.pdf |
| work_keys_str_mv | AT usovamarina lipschitzglobaloptimizationandmachinelearninghelpingeachothertosolvecomplexproblems AT barkalovkonstantin lipschitzglobaloptimizationandmachinelearninghelpingeachothertosolvecomplexproblems |