Multi-level deep Q-networks for Bitcoin trading strategies
Abstract The Bitcoin market has experienced unprecedented growth, attracting financial traders seeking to capitalize on its potential. As the most widely recognized digital currency, Bitcoin holds a crucial position in the global financial landscape, shaping the overall cryptocurrency ecosystem and...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-01-01
|
| Series: | Scientific Reports |
| Online Access: | https://doi.org/10.1038/s41598-024-51408-w |
| _version_ | 1797355869989502976 |
|---|---|
| author | Sattarov Otabek Jaeyoung Choi |
| author_facet | Sattarov Otabek Jaeyoung Choi |
| author_sort | Sattarov Otabek |
| collection | DOAJ |
| description | Abstract The Bitcoin market has experienced unprecedented growth, attracting financial traders seeking to capitalize on its potential. As the most widely recognized digital currency, Bitcoin holds a crucial position in the global financial landscape, shaping the overall cryptocurrency ecosystem and driving innovation in financial technology. Despite the use of technical analysis and machine learning, devising successful Bitcoin trading strategies remains a challenge. Recently, deep reinforcement learning algorithms have shown promise in tackling complex problems, including profitable trading strategy development. However, existing studies have not adequately addressed the simultaneous consideration of three critical factors: gaining high profits, lowering the level of risk, and maintaining a high number of active trades. In this study, we propose a multi-level deep Q-network (M-DQN) that leverages historical Bitcoin price data and Twitter sentiment analysis. In addition, an innovative preprocessing pipeline is introduced to extract valuable insights from the data, which are then input into the M-DQN model. A novel reward function is further developed to encourage the M-DQN model to focus on these three factors, thereby filling the gap left by previous studies. By integrating the proposed preprocessing technique with the novel reward function and DQN, we aim to optimize trading decisions in the Bitcoin market. In the experiments, this integration led to a noteworthy 29.93% increase in investment value from the initial amount and a Sharpe Ratio in excess of 2.7 in measuring risk-adjusted return. This performance significantly surpasses that of the state-of-the-art studies aiming to develop an efficient Bitcoin trading strategy. Therefore, the proposed method makes a valuable contribution to the field of Bitcoin trading and financial technology. |
| first_indexed | 2024-03-08T14:17:22Z |
| format | Article |
| id | doaj.art-993d33b69c3c4acb94f604d945469765 |
| institution | Directory Open Access Journal |
| issn | 2045-2322 |
| language | English |
| last_indexed | 2024-03-08T14:17:22Z |
| publishDate | 2024-01-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj.art-993d33b69c3c4acb94f604d9454697652024-01-14T12:20:22ZengNature PortfolioScientific Reports2045-23222024-01-0114112010.1038/s41598-024-51408-wMulti-level deep Q-networks for Bitcoin trading strategiesSattarov Otabek0Jaeyoung Choi1School of Computing, Gachon UniversitySchool of Computing, Gachon UniversityAbstract The Bitcoin market has experienced unprecedented growth, attracting financial traders seeking to capitalize on its potential. As the most widely recognized digital currency, Bitcoin holds a crucial position in the global financial landscape, shaping the overall cryptocurrency ecosystem and driving innovation in financial technology. Despite the use of technical analysis and machine learning, devising successful Bitcoin trading strategies remains a challenge. Recently, deep reinforcement learning algorithms have shown promise in tackling complex problems, including profitable trading strategy development. However, existing studies have not adequately addressed the simultaneous consideration of three critical factors: gaining high profits, lowering the level of risk, and maintaining a high number of active trades. In this study, we propose a multi-level deep Q-network (M-DQN) that leverages historical Bitcoin price data and Twitter sentiment analysis. In addition, an innovative preprocessing pipeline is introduced to extract valuable insights from the data, which are then input into the M-DQN model. A novel reward function is further developed to encourage the M-DQN model to focus on these three factors, thereby filling the gap left by previous studies. By integrating the proposed preprocessing technique with the novel reward function and DQN, we aim to optimize trading decisions in the Bitcoin market. In the experiments, this integration led to a noteworthy 29.93% increase in investment value from the initial amount and a Sharpe Ratio in excess of 2.7 in measuring risk-adjusted return. This performance significantly surpasses that of the state-of-the-art studies aiming to develop an efficient Bitcoin trading strategy. Therefore, the proposed method makes a valuable contribution to the field of Bitcoin trading and financial technology.https://doi.org/10.1038/s41598-024-51408-w |
| spellingShingle | Sattarov Otabek Jaeyoung Choi Multi-level deep Q-networks for Bitcoin trading strategies Scientific Reports |
| title | Multi-level deep Q-networks for Bitcoin trading strategies |
| title_full | Multi-level deep Q-networks for Bitcoin trading strategies |
| title_fullStr | Multi-level deep Q-networks for Bitcoin trading strategies |
| title_full_unstemmed | Multi-level deep Q-networks for Bitcoin trading strategies |
| title_short | Multi-level deep Q-networks for Bitcoin trading strategies |
| title_sort | multi level deep q networks for bitcoin trading strategies |
| url | https://doi.org/10.1038/s41598-024-51408-w |
| work_keys_str_mv | AT sattarovotabek multileveldeepqnetworksforbitcointradingstrategies AT jaeyoungchoi multileveldeepqnetworksforbitcointradingstrategies |