Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization
The immense popularity of convolutional neural network (CNN) models has sparked a growing interest in optimizing their hyperparameters. Discovering the ideal values for hyperparameters to achieve optimal CNN training is a complex and time-consuming task, often requiring repetitive numerical experime...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2024-03-01
|
| Series: | Heliyon |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2405844024026173 |
| _version_ | 1797259893492678656 |
|---|---|
| author | Mikolaj Wojciuk Zaneta Swiderska-Chadaj Krzysztof Siwek Arkadiusz Gertych |
| author_facet | Mikolaj Wojciuk Zaneta Swiderska-Chadaj Krzysztof Siwek Arkadiusz Gertych |
| author_sort | Mikolaj Wojciuk |
| collection | DOAJ |
| description | The immense popularity of convolutional neural network (CNN) models has sparked a growing interest in optimizing their hyperparameters. Discovering the ideal values for hyperparameters to achieve optimal CNN training is a complex and time-consuming task, often requiring repetitive numerical experiments. As a result, significant attention is currently being devoted to developing methods aimed at tailoring hyperparameters for specific CNN models and classification tasks. While existing optimization methods often yield favorable image classification results, they do not provide guidance on which hyperparameters are worth optimizing, the appropriate value ranges for those hyperparameters, or whether it is reasonable to use a subset of training data for the optimization process. This work is focused on the optimization of hyperparameters during transfer learning, with the goal of investigating how different optimization methods and hyperparameter selections impact the performance of fine-tuned models. In our experiments, we assessed the importance of various hyperparameters and identified the ranges within which optimal CNN training can be achieved. Additionally, we compared four hyperparameter optimization methods—grid search, random search, Bayesian optimization, and the Asynchronous Successive Halving Algorithm (ASHA). We also explored the feasibility of fine-tuning hyperparameters using a subset of the training data. By optimizing the hyperparameters, we observed an improvement in CNN classification accuracy of up to 6%. Furthermore, we found that achieving a balance in class distribution within the subset of data used for parameter optimization is crucial in establishing the optimal set of hyperparameters for CNN training. The results we obtained demonstrate that hyperparameter optimization is highly dependent on the specific task and dataset at hand. |
| first_indexed | 2024-03-07T16:54:13Z |
| format | Article |
| id | doaj.art-d6b4bd76b4734df5a17a65a9dca2d718 |
| institution | Directory Open Access Journal |
| issn | 2405-8440 |
| language | English |
| last_indexed | 2024-04-24T23:16:40Z |
| publishDate | 2024-03-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Heliyon |
| spelling | doaj.art-d6b4bd76b4734df5a17a65a9dca2d7182024-03-17T07:55:48ZengElsevierHeliyon2405-84402024-03-01105e26586Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimizationMikolaj Wojciuk0Zaneta Swiderska-Chadaj1Krzysztof Siwek2Arkadiusz Gertych3Faculty of Electrical Engineering, Warsaw University of Technology, Warsaw, PolandFaculty of Electrical Engineering, Warsaw University of Technology, Warsaw, Poland; Corresponding author.Faculty of Electrical Engineering, Warsaw University of Technology, Warsaw, PolandDepartment of Surgery, Department of Pathology and Laboratory Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA; Faculty of Biomedical Engineering, Silesian University of Technology, Zabrze, PolandThe immense popularity of convolutional neural network (CNN) models has sparked a growing interest in optimizing their hyperparameters. Discovering the ideal values for hyperparameters to achieve optimal CNN training is a complex and time-consuming task, often requiring repetitive numerical experiments. As a result, significant attention is currently being devoted to developing methods aimed at tailoring hyperparameters for specific CNN models and classification tasks. While existing optimization methods often yield favorable image classification results, they do not provide guidance on which hyperparameters are worth optimizing, the appropriate value ranges for those hyperparameters, or whether it is reasonable to use a subset of training data for the optimization process. This work is focused on the optimization of hyperparameters during transfer learning, with the goal of investigating how different optimization methods and hyperparameter selections impact the performance of fine-tuned models. In our experiments, we assessed the importance of various hyperparameters and identified the ranges within which optimal CNN training can be achieved. Additionally, we compared four hyperparameter optimization methods—grid search, random search, Bayesian optimization, and the Asynchronous Successive Halving Algorithm (ASHA). We also explored the feasibility of fine-tuning hyperparameters using a subset of the training data. By optimizing the hyperparameters, we observed an improvement in CNN classification accuracy of up to 6%. Furthermore, we found that achieving a balance in class distribution within the subset of data used for parameter optimization is crucial in establishing the optimal set of hyperparameters for CNN training. The results we obtained demonstrate that hyperparameter optimization is highly dependent on the specific task and dataset at hand.http://www.sciencedirect.com/science/article/pii/S2405844024026173OptimizationHyperparametersFine-tuningDeep learning |
| spellingShingle | Mikolaj Wojciuk Zaneta Swiderska-Chadaj Krzysztof Siwek Arkadiusz Gertych Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization Heliyon Optimization Hyperparameters Fine-tuning Deep learning |
| title | Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization |
| title_full | Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization |
| title_fullStr | Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization |
| title_full_unstemmed | Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization |
| title_short | Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization |
| title_sort | improving classification accuracy of fine tuned cnn models impact of hyperparameter optimization |
| topic | Optimization Hyperparameters Fine-tuning Deep learning |
| url | http://www.sciencedirect.com/science/article/pii/S2405844024026173 |
| work_keys_str_mv | AT mikolajwojciuk improvingclassificationaccuracyoffinetunedcnnmodelsimpactofhyperparameteroptimization AT zanetaswiderskachadaj improvingclassificationaccuracyoffinetunedcnnmodelsimpactofhyperparameteroptimization AT krzysztofsiwek improvingclassificationaccuracyoffinetunedcnnmodelsimpactofhyperparameteroptimization AT arkadiuszgertych improvingclassificationaccuracyoffinetunedcnnmodelsimpactofhyperparameteroptimization |