Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning
The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for di...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2013
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/98662 http://hdl.handle.net/10220/17110 |
| _version_ | 1811685535194808320 |
|---|---|
| author | Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot |
| author2 | School of Electrical and Electronic Engineering |
| author_facet | School of Electrical and Electronic Engineering Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot |
| author_sort | Kheng, Cheng Wai |
| collection | NTU |
| description | The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for different types of problems and some previous studies have attempted to combine both learning schemes as a means to develop a single optimisation framework capable of solving more classes of problems. However, most of the past approaches are often implemented heuristically and have not investigated the effect of different learning scheme on noisy design optimisation. In this article, we introduce a simple probabilistic approach to address this issue. In particular, we investigate a centroid-based approach that combines the two learning schemes within an MA framework (centroid-based MS; CBMA) through the effective allocation of resources (in terms of local search cost) that are based on information obtained during the optimisation process itself. A scheme that applies the right learning scheme (Lamarckian or Baldwinian) at the right time (during search) would lead to higher search performance. We conducted an empirical study to test this hypothesis using two different types of benchmark problems. The first problem set consists of simple benchmark problems whereby the problem landscape is static and gradient information can be obtained accurately. These problems are known to favour Lamarckian learning while Baldwinian learning is known to exhibit slower convergence. The second problem set consists of noisy versions of the first problem set whereby the problem landscape is dynamic as a result of the random noise perturbation injected into the design vector. These problems are known to favour learning processes that re-sample search points such as Baldwinian learning. Our experiments show that CBMA manages to adaptively allocate resources productively according to problem in most of the cases. |
| first_indexed | 2024-10-01T04:46:04Z |
| format | Journal Article |
| id | ntu-10356/98662 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T04:46:04Z |
| publishDate | 2013 |
| record_format | dspace |
| spelling | ntu-10356/986622020-03-07T13:57:30Z Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot School of Electrical and Electronic Engineering DRNTU::Engineering::Electrical and electronic engineering::Electronic systems The application of specific learning schemes in memetic algorithms (MAs) can have significant impact on their performances. One main issue revolves around two different learning schemes, specifically, Lamarckian and Baldwinian. It has been shown that the two learning schemes are better suited for different types of problems and some previous studies have attempted to combine both learning schemes as a means to develop a single optimisation framework capable of solving more classes of problems. However, most of the past approaches are often implemented heuristically and have not investigated the effect of different learning scheme on noisy design optimisation. In this article, we introduce a simple probabilistic approach to address this issue. In particular, we investigate a centroid-based approach that combines the two learning schemes within an MA framework (centroid-based MS; CBMA) through the effective allocation of resources (in terms of local search cost) that are based on information obtained during the optimisation process itself. A scheme that applies the right learning scheme (Lamarckian or Baldwinian) at the right time (during search) would lead to higher search performance. We conducted an empirical study to test this hypothesis using two different types of benchmark problems. The first problem set consists of simple benchmark problems whereby the problem landscape is static and gradient information can be obtained accurately. These problems are known to favour Lamarckian learning while Baldwinian learning is known to exhibit slower convergence. The second problem set consists of noisy versions of the first problem set whereby the problem landscape is dynamic as a result of the random noise perturbation injected into the design vector. These problems are known to favour learning processes that re-sample search points such as Baldwinian learning. Our experiments show that CBMA manages to adaptively allocate resources productively according to problem in most of the cases. 2013-10-31T03:01:54Z 2019-12-06T19:58:13Z 2013-10-31T03:01:54Z 2019-12-06T19:58:13Z 2012 2012 Journal Article Kheng, C. W., Chong, S. Y., & Lim, M.-H. (2012). Centroid-based memetic algorithm – adaptive Lamarckian and Baldwinian learning. International journal of systems science, 43(7), 1193-1216. 0020–7721 https://hdl.handle.net/10356/98662 http://hdl.handle.net/10220/17110 10.1080/00207721.2011.617526 en International journal of systems science |
| spellingShingle | DRNTU::Engineering::Electrical and electronic engineering::Electronic systems Kheng, Cheng Wai Chong, Siang Yew Lim, Meng-Hiot Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
| title | Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
| title_full | Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
| title_fullStr | Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
| title_full_unstemmed | Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
| title_short | Centroid-based memetic algorithm : adaptive Lamarckian and Baldwinian learning |
| title_sort | centroid based memetic algorithm adaptive lamarckian and baldwinian learning |
| topic | DRNTU::Engineering::Electrical and electronic engineering::Electronic systems |
| url | https://hdl.handle.net/10356/98662 http://hdl.handle.net/10220/17110 |
| work_keys_str_mv | AT khengchengwai centroidbasedmemeticalgorithmadaptivelamarckianandbaldwinianlearning AT chongsiangyew centroidbasedmemeticalgorithmadaptivelamarckianandbaldwinianlearning AT limmenghiot centroidbasedmemeticalgorithmadaptivelamarckianandbaldwinianlearning |