Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading

Deep learning has been a recent breakthrough that has enabled predictions and modelling to be very accurate. These predictions and modelling tools were once used to help us understand our data and serve as a tool to make a judgement. However, the vast improvements in these deep learning structures...

Olles dieđut

Bibliográfalaš dieđut
Váldodahkki: Tan, James Chee Min
Eará dahkkit: Quek Hiok Chai
Materiálatiipa: Final Year Project (FYP)
Giella:English
Almmustuhtton: Nanyang Technological University 2021
Fáttát:
Liŋkkat:https://hdl.handle.net/10356/148790
_version_ 1826110989371703296
author Tan, James Chee Min
author2 Quek Hiok Chai
author_facet Quek Hiok Chai
Tan, James Chee Min
author_sort Tan, James Chee Min
collection NTU
description Deep learning has been a recent breakthrough that has enabled predictions and modelling to be very accurate. These predictions and modelling tools were once used to help us understand our data and serve as a tool to make a judgement. However, the vast improvements in these deep learning structures have enabled them to perform decision-making independently. Many decisions made by such deep learning models have been tested to be much better at performing their task than when we used these models merely as a tool. The problem with deep structures is that they lack the interpretability of conventional modelling techniques such as a traditional fuzzy inference system. This paper proposes a fuzzy-embedded deep structure, the fuzzy-embedded recurrent neural network (FE-RNN). FE-RNN uses a one-pass DIC clustering method to form fuzzy membership values to feed into the recurrent neural network. The structure utilises pseudo-outer product rule generation to interpret the embedded recurrent neural network. Finally, the model's crisp output can be obtained through centre-of-gravity defuzzification. As both the deep structure and the fuzzy structure share a common input and output linguistic, we are able to associate the inference process of the RNN with fuzzy rules. The fuzzy IF-THEN rules help us interpret the inference process of the FE-RNN. The performance of FE-RNN is evaluated and compared against the vanilla RNN and other fuzzy neural network structures through benchmark experiments in the Mackey-Glass dataset, Nakanishi datasets and price forecasting for various indices such as the S&P500 & DJI. They produce good results in benchmark experiments but suffer in the Nakanishi dataset, where the training data is sparse. The learning process and inference process is then visualised to associate the rule nodes with the deep recurrent nodes in the RNN. Lastly, its prediction is used in a GA-fMACDH trading system that has found to outperform the buy and hold strategy in most of the ETFs experimented with in the backtesting period.
first_indexed 2024-10-01T02:43:16Z
format Final Year Project (FYP)
id ntu-10356/148790
institution Nanyang Technological University
language English
last_indexed 2024-10-01T02:43:16Z
publishDate 2021
publisher Nanyang Technological University
record_format dspace
spelling ntu-10356/1487902021-05-17T23:53:35Z Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading Tan, James Chee Min Quek Hiok Chai School of Computer Science and Engineering ASHCQUEK@ntu.edu.sg Engineering::Computer science and engineering Deep learning has been a recent breakthrough that has enabled predictions and modelling to be very accurate. These predictions and modelling tools were once used to help us understand our data and serve as a tool to make a judgement. However, the vast improvements in these deep learning structures have enabled them to perform decision-making independently. Many decisions made by such deep learning models have been tested to be much better at performing their task than when we used these models merely as a tool. The problem with deep structures is that they lack the interpretability of conventional modelling techniques such as a traditional fuzzy inference system. This paper proposes a fuzzy-embedded deep structure, the fuzzy-embedded recurrent neural network (FE-RNN). FE-RNN uses a one-pass DIC clustering method to form fuzzy membership values to feed into the recurrent neural network. The structure utilises pseudo-outer product rule generation to interpret the embedded recurrent neural network. Finally, the model's crisp output can be obtained through centre-of-gravity defuzzification. As both the deep structure and the fuzzy structure share a common input and output linguistic, we are able to associate the inference process of the RNN with fuzzy rules. The fuzzy IF-THEN rules help us interpret the inference process of the FE-RNN. The performance of FE-RNN is evaluated and compared against the vanilla RNN and other fuzzy neural network structures through benchmark experiments in the Mackey-Glass dataset, Nakanishi datasets and price forecasting for various indices such as the S&P500 & DJI. They produce good results in benchmark experiments but suffer in the Nakanishi dataset, where the training data is sparse. The learning process and inference process is then visualised to associate the rule nodes with the deep recurrent nodes in the RNN. Lastly, its prediction is used in a GA-fMACDH trading system that has found to outperform the buy and hold strategy in most of the ETFs experimented with in the backtesting period. Bachelor of Engineering (Computer Engineering) 2021-05-17T12:55:49Z 2021-05-17T12:55:49Z 2021 Final Year Project (FYP) Tan, J. C. M. (2021). Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/148790 https://hdl.handle.net/10356/148790 en application/pdf Nanyang Technological University
spellingShingle Engineering::Computer science and engineering
Tan, James Chee Min
Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading
title Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading
title_full Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading
title_fullStr Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading
title_full_unstemmed Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading
title_short Increasing interpretability using a fuzzy-embedded recurrent neural network (FE-RNN) with its application in stock ETF trading
title_sort increasing interpretability using a fuzzy embedded recurrent neural network fe rnn with its application in stock etf trading
topic Engineering::Computer science and engineering
url https://hdl.handle.net/10356/148790
work_keys_str_mv AT tanjamescheemin increasinginterpretabilityusingafuzzyembeddedrecurrentneuralnetworkfernnwithitsapplicationinstocketftrading