Efficient and Robust Parameter Tuning for Heuristic Algorithms
The main advantage of heuristic or metaheuristic algorithms compared to exact optimization methods is their ability in handling large-scale instances within a reasonable time, albeit at the expense of losing a guarantee for achieving the optimal solution. Therefore, metaheuristic techniques are appr...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Iran University of Science & Technology
2013-06-01
|
Series: | International Journal of Industrial Engineering and Production Research |
Subjects: | |
Online Access: | http://ijiepr.iust.ac.ir/browse.php?a_code=A-10-74-1&slc_lang=en&sid=1 |
_version_ | 1819104927318802432 |
---|---|
author | Hossein Akbaripour Ellips Masehian |
author_facet | Hossein Akbaripour Ellips Masehian |
author_sort | Hossein Akbaripour |
collection | DOAJ |
description | The main advantage of heuristic or metaheuristic algorithms compared to exact optimization methods is their ability in handling large-scale instances within a reasonable time, albeit at the expense of losing a guarantee for achieving the optimal solution. Therefore, metaheuristic techniques are appropriate choices for solving NP-hard problems to near optimality. Since the parameters of heuristic and metaheuristic algorithms have a great influence on their effectiveness and efficiency, parameter tuning and calibration has gained importance. In this paper a new approach for robust parameter tuning of heuristics and metaheuristics is proposed, which is based on a combination of Design of Experiments (DOE), Signal to Noise (S/N) ratio, Shannon entropy, and VIKOR methods, which not only considers the solution quality or the number of fitness function evaluations, but also aims to minimize the running time. In order to evaluate the performance of the suggested approach, a computational analysis has been performed on the Simulated Annealing (SA) and Genetic Algorithms (GA) methods, which have been successfully applied in solving respectively the n-queens and the Uncapacitated Single Allocation Hub Location combinatorial problems. Extensive experimental results showed that by using the presented approach the average number of iterations and the average running time of the SA were respectively improved 12 and 10.2 times compared to the un-tuned SA. Also, the quality of certain solutions was improved in the tuned GA, while the average running time was 2.5 times faster compared to the un-tuned GA. |
first_indexed | 2024-12-22T02:14:08Z |
format | Article |
id | doaj.art-ee0e7ef1826d476ebef3ce811dddd61e |
institution | Directory Open Access Journal |
issn | 2008-4889 2345-363X |
language | English |
last_indexed | 2024-12-22T02:14:08Z |
publishDate | 2013-06-01 |
publisher | Iran University of Science & Technology |
record_format | Article |
series | International Journal of Industrial Engineering and Production Research |
spelling | doaj.art-ee0e7ef1826d476ebef3ce811dddd61e2022-12-21T18:42:20ZengIran University of Science & TechnologyInternational Journal of Industrial Engineering and Production Research2008-48892345-363X2013-06-01242143150Efficient and Robust Parameter Tuning for Heuristic AlgorithmsHossein Akbaripour0Ellips Masehian1 Industrial Engineering Department, Tarbiat Modares University, Tehran, Iran Industrial Engineering Department, Tarbiat Modares University, Tehran, Iran The main advantage of heuristic or metaheuristic algorithms compared to exact optimization methods is their ability in handling large-scale instances within a reasonable time, albeit at the expense of losing a guarantee for achieving the optimal solution. Therefore, metaheuristic techniques are appropriate choices for solving NP-hard problems to near optimality. Since the parameters of heuristic and metaheuristic algorithms have a great influence on their effectiveness and efficiency, parameter tuning and calibration has gained importance. In this paper a new approach for robust parameter tuning of heuristics and metaheuristics is proposed, which is based on a combination of Design of Experiments (DOE), Signal to Noise (S/N) ratio, Shannon entropy, and VIKOR methods, which not only considers the solution quality or the number of fitness function evaluations, but also aims to minimize the running time. In order to evaluate the performance of the suggested approach, a computational analysis has been performed on the Simulated Annealing (SA) and Genetic Algorithms (GA) methods, which have been successfully applied in solving respectively the n-queens and the Uncapacitated Single Allocation Hub Location combinatorial problems. Extensive experimental results showed that by using the presented approach the average number of iterations and the average running time of the SA were respectively improved 12 and 10.2 times compared to the un-tuned SA. Also, the quality of certain solutions was improved in the tuned GA, while the average running time was 2.5 times faster compared to the un-tuned GA.http://ijiepr.iust.ac.ir/browse.php?a_code=A-10-74-1&slc_lang=en&sid=1Parameter Tuning Design of Experiments Signal to Noise (S/N) ratio Shannon Entropy VIKOR Simulated Annealing Genetic Algorithms |
spellingShingle | Hossein Akbaripour Ellips Masehian Efficient and Robust Parameter Tuning for Heuristic Algorithms International Journal of Industrial Engineering and Production Research Parameter Tuning Design of Experiments Signal to Noise (S/N) ratio Shannon Entropy VIKOR Simulated Annealing Genetic Algorithms |
title | Efficient and Robust Parameter Tuning for Heuristic Algorithms |
title_full | Efficient and Robust Parameter Tuning for Heuristic Algorithms |
title_fullStr | Efficient and Robust Parameter Tuning for Heuristic Algorithms |
title_full_unstemmed | Efficient and Robust Parameter Tuning for Heuristic Algorithms |
title_short | Efficient and Robust Parameter Tuning for Heuristic Algorithms |
title_sort | efficient and robust parameter tuning for heuristic algorithms |
topic | Parameter Tuning Design of Experiments Signal to Noise (S/N) ratio Shannon Entropy VIKOR Simulated Annealing Genetic Algorithms |
url | http://ijiepr.iust.ac.ir/browse.php?a_code=A-10-74-1&slc_lang=en&sid=1 |
work_keys_str_mv | AT hosseinakbaripour efficientandrobustparametertuningforheuristicalgorithms AT ellipsmasehian efficientandrobustparametertuningforheuristicalgorithms |