An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction
Learning an Artificial Neural Network (ANN) is an optimization task since it is desirable to find optimal weight sets of an ANN in the training process. Different equations are used to guide the network for providing an accurate result with less training and testing error. Most of the training al...
| Main Author: | |
|---|---|
| Format: | Thesis |
| Language: | English English |
| Published: |
2014
|
| Subjects: | |
| Online Access: | http://eprints.uthm.edu.my/1214/1/24p%20HABIB%20SHAH.pdf http://eprints.uthm.edu.my/1214/2/HABIB%20SHAH%20WATERMARK.pdf |
| _version_ | 1796868421588090880 |
|---|---|
| author | Shah, Habib |
| author_facet | Shah, Habib |
| author_sort | Shah, Habib |
| collection | UTHM |
| description | Learning an Artificial Neural Network (ANN) is an optimization task since it is
desirable to find optimal weight sets of an ANN in the training process. Different
equations are used to guide the network for providing an accurate result with less
training and testing error. Most of the training algorithms focus on weight values,
activation functions, and network structures for providing optimal outputs.
Backpropagation (BP) learning algorithm is the well-known learning technique that
trained ANN. However, some difficulties arise where the BP cannot get achievements
without trapping in local minima and converge very slow in the solution space.
Therefore, to overcome the trapping difficulties, slow convergence and difficulties in
finding optimal weight values, three improved Artificial Bee Colony (ABC) algorithms
built on the social insect behavior are proposed in this research for training ANN,
namely the widely used Multilayer Perceptron (MLP). Here, three improved learning
approaches inspired by artificial honey bee's behavior are used to train MLP. They are:
Global Guided Artificial Bee Colony (GGABC), Improved Gbest Guided Artificial Bee
Colony (IGGABC) and Artificial Smart Bee Colony (ASBC) algorithm. These improved
algorithms were used to increase the exploration, exploitation and keep them balance for
getting optimal results for a given task. Furthermore, here these algorithms used to train
the MLP on two tasks; the seismic event's prediction and Boolean function
classification. The simulation results of the MLP trained with improved algorithms were
compared with that when trained with the standard BP, ABC, Global ABC and Particle
Swarm Optimization algorithm. From the experimental analysis, the proposed improved
algorithms get better the classification efficacy for time series prediction and Boolean
function classification. Moreover, these improved algorithm's success to get high
accuracy and optimize the best network's weight values for training the MLP. |
| first_indexed | 2024-03-05T21:39:31Z |
| format | Thesis |
| id | uthm.eprints-1214 |
| institution | Universiti Tun Hussein Onn Malaysia |
| language | English English |
| last_indexed | 2024-03-05T21:39:31Z |
| publishDate | 2014 |
| record_format | dspace |
| spelling | uthm.eprints-12142021-09-30T06:28:44Z http://eprints.uthm.edu.my/1214/ An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction Shah, Habib QA76 Computer software QA71-90 Instruments and machines Learning an Artificial Neural Network (ANN) is an optimization task since it is desirable to find optimal weight sets of an ANN in the training process. Different equations are used to guide the network for providing an accurate result with less training and testing error. Most of the training algorithms focus on weight values, activation functions, and network structures for providing optimal outputs. Backpropagation (BP) learning algorithm is the well-known learning technique that trained ANN. However, some difficulties arise where the BP cannot get achievements without trapping in local minima and converge very slow in the solution space. Therefore, to overcome the trapping difficulties, slow convergence and difficulties in finding optimal weight values, three improved Artificial Bee Colony (ABC) algorithms built on the social insect behavior are proposed in this research for training ANN, namely the widely used Multilayer Perceptron (MLP). Here, three improved learning approaches inspired by artificial honey bee's behavior are used to train MLP. They are: Global Guided Artificial Bee Colony (GGABC), Improved Gbest Guided Artificial Bee Colony (IGGABC) and Artificial Smart Bee Colony (ASBC) algorithm. These improved algorithms were used to increase the exploration, exploitation and keep them balance for getting optimal results for a given task. Furthermore, here these algorithms used to train the MLP on two tasks; the seismic event's prediction and Boolean function classification. The simulation results of the MLP trained with improved algorithms were compared with that when trained with the standard BP, ABC, Global ABC and Particle Swarm Optimization algorithm. From the experimental analysis, the proposed improved algorithms get better the classification efficacy for time series prediction and Boolean function classification. Moreover, these improved algorithm's success to get high accuracy and optimize the best network's weight values for training the MLP. 2014-03 Thesis NonPeerReviewed text en http://eprints.uthm.edu.my/1214/1/24p%20HABIB%20SHAH.pdf text en http://eprints.uthm.edu.my/1214/2/HABIB%20SHAH%20WATERMARK.pdf Shah, Habib (2014) An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction. Doctoral thesis, Universiti Tun Hussein Onn Malaysia. |
| spellingShingle | QA76 Computer software QA71-90 Instruments and machines Shah, Habib An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction |
| title | An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction |
| title_full | An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction |
| title_fullStr | An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction |
| title_full_unstemmed | An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction |
| title_short | An improved artificial bee colony algorithm for training multilayer perceptron in time series prediction |
| title_sort | improved artificial bee colony algorithm for training multilayer perceptron in time series prediction |
| topic | QA76 Computer software QA71-90 Instruments and machines |
| url | http://eprints.uthm.edu.my/1214/1/24p%20HABIB%20SHAH.pdf http://eprints.uthm.edu.my/1214/2/HABIB%20SHAH%20WATERMARK.pdf |
| work_keys_str_mv | AT shahhabib animprovedartificialbeecolonyalgorithmfortrainingmultilayerperceptronintimeseriesprediction AT shahhabib improvedartificialbeecolonyalgorithmfortrainingmultilayerperceptronintimeseriesprediction |