Explicitly Constrained Black-Box Optimization With Disconnected Feasible Domains Using Deep Generative Models
We tackle explicitly constrained black-box continuous optimization problems in which the feasible domain forms a union of disconnected feasible subdomains. The decoder-based constraint-handling technique is a promising approach when the feasible domain is disconnected. However, the design of a reaso...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2022-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9940284/ |
| _version_ | 1828130342430572544 |
|---|---|
| author | Naoki Sakamoto Rei Sato Kazuto Fukuchi Jun Sakuma Youhei Akimoto |
| author_facet | Naoki Sakamoto Rei Sato Kazuto Fukuchi Jun Sakuma Youhei Akimoto |
| author_sort | Naoki Sakamoto |
| collection | DOAJ |
| description | We tackle explicitly constrained black-box continuous optimization problems in which the feasible domain forms a union of disconnected feasible subdomains. The decoder-based constraint-handling technique is a promising approach when the feasible domain is disconnected. However, the design of a reasonable decoder requires deep prior knowledge of the optimization problem to be solved and, hence, human effort. In this study, we investigated the usefulness of a deep neural network as a decoder and developed a training scheme for a deep neural network without prior information, such as a training dataset consisting of feasible and infeasible solutions required by existing decoder approaches. To stabilize the training of the deep generative model as the decoder, we propose decomposing the decoder into sub-models, introducing skip connections to each sub-model, and training the sub-models sequentially with separate loss functions. Numerical experiments using a test problem and a topology optimization problem show that the proposed method can find feasible domains with better objective function values and higher probability than both conventional decoder-based constraint-handling methods and non-decoder-based constraint-handling methods. |
| first_indexed | 2024-04-11T16:32:47Z |
| format | Article |
| id | doaj.art-9597e700c6dd4340b5990525bce630af |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-11T16:32:47Z |
| publishDate | 2022-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-9597e700c6dd4340b5990525bce630af2022-12-22T04:13:59ZengIEEEIEEE Access2169-35362022-01-011011750111751410.1109/ACCESS.2022.32199799940284Explicitly Constrained Black-Box Optimization With Disconnected Feasible Domains Using Deep Generative ModelsNaoki Sakamoto0Rei Sato1Kazuto Fukuchi2https://orcid.org/0000-0003-3895-219XJun Sakuma3https://orcid.org/0000-0001-5015-3812Youhei Akimoto4https://orcid.org/0000-0003-2760-8123Department of Computer Science, University of Tsukuba, Tsukuba, Ibaraki, JapanDepartment of Computer Science, University of Tsukuba, Tsukuba, Ibaraki, JapanFaculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, Ibaraki, JapanFaculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, Ibaraki, JapanFaculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, Ibaraki, JapanWe tackle explicitly constrained black-box continuous optimization problems in which the feasible domain forms a union of disconnected feasible subdomains. The decoder-based constraint-handling technique is a promising approach when the feasible domain is disconnected. However, the design of a reasonable decoder requires deep prior knowledge of the optimization problem to be solved and, hence, human effort. In this study, we investigated the usefulness of a deep neural network as a decoder and developed a training scheme for a deep neural network without prior information, such as a training dataset consisting of feasible and infeasible solutions required by existing decoder approaches. To stabilize the training of the deep generative model as the decoder, we propose decomposing the decoder into sub-models, introducing skip connections to each sub-model, and training the sub-models sequentially with separate loss functions. Numerical experiments using a test problem and a topology optimization problem show that the proposed method can find feasible domains with better objective function values and higher probability than both conventional decoder-based constraint-handling methods and non-decoder-based constraint-handling methods.https://ieeexplore.ieee.org/document/9940284/Black-box optimizationconstraint handlingdeep learningdisconnected feasible domainevolutionary computationexplicit constraint |
| spellingShingle | Naoki Sakamoto Rei Sato Kazuto Fukuchi Jun Sakuma Youhei Akimoto Explicitly Constrained Black-Box Optimization With Disconnected Feasible Domains Using Deep Generative Models IEEE Access Black-box optimization constraint handling deep learning disconnected feasible domain evolutionary computation explicit constraint |
| title | Explicitly Constrained Black-Box Optimization With Disconnected Feasible Domains Using Deep Generative Models |
| title_full | Explicitly Constrained Black-Box Optimization With Disconnected Feasible Domains Using Deep Generative Models |
| title_fullStr | Explicitly Constrained Black-Box Optimization With Disconnected Feasible Domains Using Deep Generative Models |
| title_full_unstemmed | Explicitly Constrained Black-Box Optimization With Disconnected Feasible Domains Using Deep Generative Models |
| title_short | Explicitly Constrained Black-Box Optimization With Disconnected Feasible Domains Using Deep Generative Models |
| title_sort | explicitly constrained black box optimization with disconnected feasible domains using deep generative models |
| topic | Black-box optimization constraint handling deep learning disconnected feasible domain evolutionary computation explicit constraint |
| url | https://ieeexplore.ieee.org/document/9940284/ |
| work_keys_str_mv | AT naokisakamoto explicitlyconstrainedblackboxoptimizationwithdisconnectedfeasibledomainsusingdeepgenerativemodels AT reisato explicitlyconstrainedblackboxoptimizationwithdisconnectedfeasibledomainsusingdeepgenerativemodels AT kazutofukuchi explicitlyconstrainedblackboxoptimizationwithdisconnectedfeasibledomainsusingdeepgenerativemodels AT junsakuma explicitlyconstrainedblackboxoptimizationwithdisconnectedfeasibledomainsusingdeepgenerativemodels AT youheiakimoto explicitlyconstrainedblackboxoptimizationwithdisconnectedfeasibledomainsusingdeepgenerativemodels |