Big Data: Deep Learning for financial sentiment analysis

Abstract Deep Learning and Big Data analytics are two focal points of data science. Deep Learning models have achieved remarkable results in speech recognition and computer vision in recent years. Big Data is important for organizations that need to collect a huge amount of data like a social networ...

Full description

Bibliographic Details
Main Authors: Sahar Sohangir, Dingding Wang, Anna Pomeranets, Taghi M. Khoshgoftaar
Format: Article
Language:English
Published: SpringerOpen 2018-01-01
Series:Journal of Big Data
Subjects:
Online Access:http://link.springer.com/article/10.1186/s40537-017-0111-6
_version_ 1819143222265380864
author Sahar Sohangir
Dingding Wang
Anna Pomeranets
Taghi M. Khoshgoftaar
author_facet Sahar Sohangir
Dingding Wang
Anna Pomeranets
Taghi M. Khoshgoftaar
author_sort Sahar Sohangir
collection DOAJ
description Abstract Deep Learning and Big Data analytics are two focal points of data science. Deep Learning models have achieved remarkable results in speech recognition and computer vision in recent years. Big Data is important for organizations that need to collect a huge amount of data like a social network and one of the greatest assets to use Deep Learning is analyzing a massive amount of data (Big Data). This advantage makes Deep Learning as a valuable tool for Big Data. Deep Learning can be used to extract incredible information that buried in a Big Data. The modern stock market is an example of these social networks. They are a popular place to increase wealth and generate income, but the fundamental problem of when to buy or sell shares, or which stocks to buy has not been solved. It is very common among investors to have professional financial advisors, but what is the best resource to support the decisions these people make? Investment banks such as Goldman Sachs, Lehman Brothers, and Salomon Brothers dominated the world of financial advice for more than a decade. However, via the popularity of the Internet and financial social networks such as StockTwits and SeekingAlpha, investors around the world have new opportunity to gather and share their experiences. Individual experts can predict the movement of the stock market in financial social networks with the reasonable accuracy, but what is the sentiment of a mass group of these expert authors towards various stocks? In this paper, we seek to determine if Deep Learning models can be adapted to improve the performance of sentiment analysis for StockTwits. We applied several neural network models such as long short-term memory, doc2vec, and convolutional neural networks, to stock market opinions posted in StockTwits. Our results show that Deep Learning model can be used effectively for financial sentiment analysis and a convolutional neural network is the best model to predict sentiment of authors in StockTwits dataset.
first_indexed 2024-12-22T12:22:48Z
format Article
id doaj.art-4e9ab30289d746ca875ad9a4bba5cacd
institution Directory Open Access Journal
issn 2196-1115
language English
last_indexed 2024-12-22T12:22:48Z
publishDate 2018-01-01
publisher SpringerOpen
record_format Article
series Journal of Big Data
spelling doaj.art-4e9ab30289d746ca875ad9a4bba5cacd2022-12-21T18:25:55ZengSpringerOpenJournal of Big Data2196-11152018-01-015112510.1186/s40537-017-0111-6Big Data: Deep Learning for financial sentiment analysisSahar Sohangir0Dingding Wang1Anna Pomeranets2Taghi M. Khoshgoftaar3Department of Computer & Electrical Engineering and Computer Science, Florida Atlantic UniversityDepartment of Computer & Electrical Engineering and Computer Science, Florida Atlantic UniversityCollege of Business, Florida Atlantic UniversityDepartment of Computer & Electrical Engineering and Computer Science, Florida Atlantic UniversityAbstract Deep Learning and Big Data analytics are two focal points of data science. Deep Learning models have achieved remarkable results in speech recognition and computer vision in recent years. Big Data is important for organizations that need to collect a huge amount of data like a social network and one of the greatest assets to use Deep Learning is analyzing a massive amount of data (Big Data). This advantage makes Deep Learning as a valuable tool for Big Data. Deep Learning can be used to extract incredible information that buried in a Big Data. The modern stock market is an example of these social networks. They are a popular place to increase wealth and generate income, but the fundamental problem of when to buy or sell shares, or which stocks to buy has not been solved. It is very common among investors to have professional financial advisors, but what is the best resource to support the decisions these people make? Investment banks such as Goldman Sachs, Lehman Brothers, and Salomon Brothers dominated the world of financial advice for more than a decade. However, via the popularity of the Internet and financial social networks such as StockTwits and SeekingAlpha, investors around the world have new opportunity to gather and share their experiences. Individual experts can predict the movement of the stock market in financial social networks with the reasonable accuracy, but what is the sentiment of a mass group of these expert authors towards various stocks? In this paper, we seek to determine if Deep Learning models can be adapted to improve the performance of sentiment analysis for StockTwits. We applied several neural network models such as long short-term memory, doc2vec, and convolutional neural networks, to stock market opinions posted in StockTwits. Our results show that Deep Learning model can be used effectively for financial sentiment analysis and a convolutional neural network is the best model to predict sentiment of authors in StockTwits dataset.http://link.springer.com/article/10.1186/s40537-017-0111-6Deep LearningBig DataSentiment analysisInformation retrieval
spellingShingle Sahar Sohangir
Dingding Wang
Anna Pomeranets
Taghi M. Khoshgoftaar
Big Data: Deep Learning for financial sentiment analysis
Journal of Big Data
Deep Learning
Big Data
Sentiment analysis
Information retrieval
title Big Data: Deep Learning for financial sentiment analysis
title_full Big Data: Deep Learning for financial sentiment analysis
title_fullStr Big Data: Deep Learning for financial sentiment analysis
title_full_unstemmed Big Data: Deep Learning for financial sentiment analysis
title_short Big Data: Deep Learning for financial sentiment analysis
title_sort big data deep learning for financial sentiment analysis
topic Deep Learning
Big Data
Sentiment analysis
Information retrieval
url http://link.springer.com/article/10.1186/s40537-017-0111-6
work_keys_str_mv AT saharsohangir bigdatadeeplearningforfinancialsentimentanalysis
AT dingdingwang bigdatadeeplearningforfinancialsentimentanalysis
AT annapomeranets bigdatadeeplearningforfinancialsentimentanalysis
AT taghimkhoshgoftaar bigdatadeeplearningforfinancialsentimentanalysis