Data-driven time series prediction based on multiplicative neuron model artificial neuron network
This paper develops a hybrid approach combining the neural network and the nonlinear filtering to model and predict terrain profiles for both air and ground vehicles. To simplify the neural network structures and reduce the number of synaptic weights and biases, the multiplicative neuron model (MNM)...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/160260 |
| _version_ | 1826128668159639552 |
|---|---|
| author | Pan, Wenping Zhang, Limao Shen, Chunlin |
| author2 | School of Civil and Environmental Engineering |
| author_facet | School of Civil and Environmental Engineering Pan, Wenping Zhang, Limao Shen, Chunlin |
| author_sort | Pan, Wenping |
| collection | NTU |
| description | This paper develops a hybrid approach combining the neural network and the nonlinear filtering to model and predict terrain profiles for both air and ground vehicles. To simplify the neural network structures and reduce the number of synaptic weights and biases, the multiplicative neuron model (MNM) is utilized to describe the relationship between the unknown elevation ahead and the last few height values on the terrain profile. This paper adopts the gradient descent algorithm (GDA) to train the MNM terrain model and stores the MNM parameters into a nonlinear state-space model. The state vector in the state-space model (i.e., parameters of MNM) evolve agilely once absorbing new observations and measurement of elevation values by the Bootstrap Particle Filter (BPF) algorithm. Data-driven predictions on terrain profiles can be achieved through the updated MNM model. This study utilizes two types of terrain profiles to verify the effectiveness of the proposed MNM–BPF approach. Experimental results on two public datasets indicate that the proposed approach not only overcomes the limitations of conventional terrain models that cannot dynamically tune model parameters according to the newly input information, but also provides a simple but effective single-layered network for modeling terrain profiles. The well-trained MNM–BPF model can achieve the lowest root mean square errors (RMSE) (i.e., 17.3211 on the NS profile, 19.0366 on the EW profile) and average error (AE) (i.e., 1.5852 on the NS profile, 0.14885 on the EW profile) in the low-resolution dataset. The lowest RMSE (i.e., 0.16549 on the left profile, 0.29926 on the right profile) and mean absolute error (MAE) (i.e., 0.13467 on the left profile, 0.23933 on the right profile) results are obtained in the high-resolution dataset. Overall, the developed model is superior to the state-of-the-art models in at least four of the six performance metrics and reduces RMSE by 40.8%, 17.2%, 13.1%, and 6.8% on average on the four testing terrain profiles, respectively. The developed approach can be used as a decision tool for the accurate prediction of terrain profiles with different resolutions. |
| first_indexed | 2024-10-01T07:28:43Z |
| format | Journal Article |
| id | ntu-10356/160260 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T07:28:43Z |
| publishDate | 2022 |
| record_format | dspace |
| spelling | ntu-10356/1602602022-07-18T07:17:00Z Data-driven time series prediction based on multiplicative neuron model artificial neuron network Pan, Wenping Zhang, Limao Shen, Chunlin School of Civil and Environmental Engineering Engineering::Civil engineering Multiplicative Neuron Model Bootstrap Particle Filter This paper develops a hybrid approach combining the neural network and the nonlinear filtering to model and predict terrain profiles for both air and ground vehicles. To simplify the neural network structures and reduce the number of synaptic weights and biases, the multiplicative neuron model (MNM) is utilized to describe the relationship between the unknown elevation ahead and the last few height values on the terrain profile. This paper adopts the gradient descent algorithm (GDA) to train the MNM terrain model and stores the MNM parameters into a nonlinear state-space model. The state vector in the state-space model (i.e., parameters of MNM) evolve agilely once absorbing new observations and measurement of elevation values by the Bootstrap Particle Filter (BPF) algorithm. Data-driven predictions on terrain profiles can be achieved through the updated MNM model. This study utilizes two types of terrain profiles to verify the effectiveness of the proposed MNM–BPF approach. Experimental results on two public datasets indicate that the proposed approach not only overcomes the limitations of conventional terrain models that cannot dynamically tune model parameters according to the newly input information, but also provides a simple but effective single-layered network for modeling terrain profiles. The well-trained MNM–BPF model can achieve the lowest root mean square errors (RMSE) (i.e., 17.3211 on the NS profile, 19.0366 on the EW profile) and average error (AE) (i.e., 1.5852 on the NS profile, 0.14885 on the EW profile) in the low-resolution dataset. The lowest RMSE (i.e., 0.16549 on the left profile, 0.29926 on the right profile) and mean absolute error (MAE) (i.e., 0.13467 on the left profile, 0.23933 on the right profile) results are obtained in the high-resolution dataset. Overall, the developed model is superior to the state-of-the-art models in at least four of the six performance metrics and reduces RMSE by 40.8%, 17.2%, 13.1%, and 6.8% on average on the four testing terrain profiles, respectively. The developed approach can be used as a decision tool for the accurate prediction of terrain profiles with different resolutions. The authors would like to acknowledge support from the State Scholarship Fund (No. 201906835048) granted by the China Scholarship Council and the Fundamental Research Funds for the Central Universities, China (No. NS2015071). 2022-07-18T07:17:00Z 2022-07-18T07:17:00Z 2021 Journal Article Pan, W., Zhang, L. & Shen, C. (2021). Data-driven time series prediction based on multiplicative neuron model artificial neuron network. Applied Soft Computing, 104, 107179-. https://dx.doi.org/10.1016/j.asoc.2021.107179 1568-4946 https://hdl.handle.net/10356/160260 10.1016/j.asoc.2021.107179 2-s2.0-85101356743 104 107179 en Applied Soft Computing © 2021 Elsevier B.V. All rights reserved. |
| spellingShingle | Engineering::Civil engineering Multiplicative Neuron Model Bootstrap Particle Filter Pan, Wenping Zhang, Limao Shen, Chunlin Data-driven time series prediction based on multiplicative neuron model artificial neuron network |
| title | Data-driven time series prediction based on multiplicative neuron model artificial neuron network |
| title_full | Data-driven time series prediction based on multiplicative neuron model artificial neuron network |
| title_fullStr | Data-driven time series prediction based on multiplicative neuron model artificial neuron network |
| title_full_unstemmed | Data-driven time series prediction based on multiplicative neuron model artificial neuron network |
| title_short | Data-driven time series prediction based on multiplicative neuron model artificial neuron network |
| title_sort | data driven time series prediction based on multiplicative neuron model artificial neuron network |
| topic | Engineering::Civil engineering Multiplicative Neuron Model Bootstrap Particle Filter |
| url | https://hdl.handle.net/10356/160260 |
| work_keys_str_mv | AT panwenping datadriventimeseriespredictionbasedonmultiplicativeneuronmodelartificialneuronnetwork AT zhanglimao datadriventimeseriespredictionbasedonmultiplicativeneuronmodelartificialneuronnetwork AT shenchunlin datadriventimeseriespredictionbasedonmultiplicativeneuronmodelartificialneuronnetwork |