Temporal convolutional networks for transient simulation of high-speed channels
While the recurrent neural network (RNN) architecture has been the go-to model in transient modeling, recently the temporal convolutional network (TCN) has been garnering more attention as it has a longer memory than recurrent architectures with the same capacity. In this paper, we propose the use o...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-07-01
|
| Series: | Alexandria Engineering Journal |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S1110016823004192 |
| _version_ | 1827916527024734208 |
|---|---|
| author | Chan Hong Goay Nur Syazreen Ahmad Patrick Goh |
| author_facet | Chan Hong Goay Nur Syazreen Ahmad Patrick Goh |
| author_sort | Chan Hong Goay |
| collection | DOAJ |
| description | While the recurrent neural network (RNN) architecture has been the go-to model in transient modeling, recently the temporal convolutional network (TCN) has been garnering more attention as it has a longer memory than recurrent architectures with the same capacity. In this paper, we propose the use of the TCN for transient simulation of high-speed channels. The adaptive successive halving algorithm (ASH-HPO) is used to perform automated hyperparameter optimization for the TCN. It has two components, progressive sampling and successive halving. It iteratively expand the size of training dataset and eliminates a certain percentage of bad performing models. The progressive sampling component is modified to preserve the original sequencing of time series data to prevent information leakage. Also, the successive halving component is modified so that each eliminated model must be validated using at least two different validation datasets before it is being removed. The robustness of the proposed method is demonstrated using four high-speed channel examples, and the TCN is compared against existing convolutional neural network long short-term memory (CNN-LSTM) and dilated causal convolution (DCC) models. The TCN outperforms the other models consistently in all four tasks in terms of training speed, amount of training data to converge, and accuracy. |
| first_indexed | 2024-03-13T03:15:23Z |
| format | Article |
| id | doaj.art-c7f4e799369143deb3efdbce3baf43f6 |
| institution | Directory Open Access Journal |
| issn | 1110-0168 |
| language | English |
| last_indexed | 2024-03-13T03:15:23Z |
| publishDate | 2023-07-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Alexandria Engineering Journal |
| spelling | doaj.art-c7f4e799369143deb3efdbce3baf43f62023-06-26T04:13:34ZengElsevierAlexandria Engineering Journal1110-01682023-07-0174643663Temporal convolutional networks for transient simulation of high-speed channelsChan Hong Goay0Nur Syazreen Ahmad1Patrick Goh2School of Electrical and Electronic Engineering, Universiti Sains Malaysia, Nibong Tebal, Penang 14300, MalaysiaSchool of Electrical and Electronic Engineering, Universiti Sains Malaysia, Nibong Tebal, Penang 14300, MalaysiaCorresponding author.; School of Electrical and Electronic Engineering, Universiti Sains Malaysia, Nibong Tebal, Penang 14300, MalaysiaWhile the recurrent neural network (RNN) architecture has been the go-to model in transient modeling, recently the temporal convolutional network (TCN) has been garnering more attention as it has a longer memory than recurrent architectures with the same capacity. In this paper, we propose the use of the TCN for transient simulation of high-speed channels. The adaptive successive halving algorithm (ASH-HPO) is used to perform automated hyperparameter optimization for the TCN. It has two components, progressive sampling and successive halving. It iteratively expand the size of training dataset and eliminates a certain percentage of bad performing models. The progressive sampling component is modified to preserve the original sequencing of time series data to prevent information leakage. Also, the successive halving component is modified so that each eliminated model must be validated using at least two different validation datasets before it is being removed. The robustness of the proposed method is demonstrated using four high-speed channel examples, and the TCN is compared against existing convolutional neural network long short-term memory (CNN-LSTM) and dilated causal convolution (DCC) models. The TCN outperforms the other models consistently in all four tasks in terms of training speed, amount of training data to converge, and accuracy.http://www.sciencedirect.com/science/article/pii/S1110016823004192Temporal convolutional network (TCN)Automated hyperparameter optimizationTransient simulationHigh-speed channel |
| spellingShingle | Chan Hong Goay Nur Syazreen Ahmad Patrick Goh Temporal convolutional networks for transient simulation of high-speed channels Alexandria Engineering Journal Temporal convolutional network (TCN) Automated hyperparameter optimization Transient simulation High-speed channel |
| title | Temporal convolutional networks for transient simulation of high-speed channels |
| title_full | Temporal convolutional networks for transient simulation of high-speed channels |
| title_fullStr | Temporal convolutional networks for transient simulation of high-speed channels |
| title_full_unstemmed | Temporal convolutional networks for transient simulation of high-speed channels |
| title_short | Temporal convolutional networks for transient simulation of high-speed channels |
| title_sort | temporal convolutional networks for transient simulation of high speed channels |
| topic | Temporal convolutional network (TCN) Automated hyperparameter optimization Transient simulation High-speed channel |
| url | http://www.sciencedirect.com/science/article/pii/S1110016823004192 |
| work_keys_str_mv | AT chanhonggoay temporalconvolutionalnetworksfortransientsimulationofhighspeedchannels AT nursyazreenahmad temporalconvolutionalnetworksfortransientsimulationofhighspeedchannels AT patrickgoh temporalconvolutionalnetworksfortransientsimulationofhighspeedchannels |