Investigating correlation between cryptocurrency prices and Twitter sentiment using XLNet

Stock market prediction has been one of the most widely researched and lucrative topics over the past few decades. Researchers and computer scientists have used many different artificial intelligence techniques in order to predict the volatile ebbs and flows of the stock market. One such techniqu...

Full description

Bibliographic Details
Main Author: Lee, Nicholas Qin Shan
Other Authors: Althea Liang
Format: Final Year Project (FYP)
Language:English
Published: Nanyang Technological University 2021
Subjects:
Online Access:https://hdl.handle.net/10356/153210
Description
Summary:Stock market prediction has been one of the most widely researched and lucrative topics over the past few decades. Researchers and computer scientists have used many different artificial intelligence techniques in order to predict the volatile ebbs and flows of the stock market. One such technique used is sentiment analysis, where the correlation between how individuals are feeling, or their sentiment, and the prices of stocks is analyzed. With the recent boom in the cryptocurrency market, many of the same ideas are being transferred to analyze the growing market, sentiment analysis being one of them. This project aims to study the correlation between sentiment of individuals and potential investors on the popular social media website Twitter, and the effect it has on 3 cryptocurrencies: Bitcoin (BTC), Ethereum (ETH) and Litecoin (LTC). Tweets over the years 2018 to 2020 were scraped from Twitter and cleaned, and sentiment analysis was performed on them to determine the correlation. Lastly, a model was trained in XLNet in order to capture this relationship, so that it could be combined with other models in order to capture richer relationships with the financial data. The results show that by itself, there is a decently high correlation between Twitter sentiment and the prices of cryptocurrencies. Also, the model was able to closely capture the relationship between the sentiment and the currencies, making it suitable for use in further, more in-depth studies.