Stock price predictability and the business cycle via machine learning
The negative effects of data shifts on machine learning (ML) model performance have been extensively characterized in numerous applications of ML (e.g. natural language processing). However, few studies are exploring the data-shifting effects of the business cycle, particularly in the context of sto...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Final Year Project (FYP) |
| Language: | English |
| Published: |
Nanyang Technological University
2023
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/165925 |
| _version_ | 1811676301021413376 |
|---|---|
| author | Wang, Li Rong |
| author2 | Fan Xiuyi |
| author_facet | Fan Xiuyi Wang, Li Rong |
| author_sort | Wang, Li Rong |
| collection | NTU |
| description | The negative effects of data shifts on machine learning (ML) model performance have been extensively characterized in numerous applications of ML (e.g. natural language processing). However, few studies are exploring the data-shifting effects of the business cycle, particularly in the context of stock price forecasting. Hence, this research studies how the business cycle affects stock price forecasting and explores possible mitigating measures. Using the S&P 500 index, we begin by documenting a stylized fact that most prediction models perform worse during the US recessions, which is public information dated by the National Bureau of Economic Research (NBER). We further investigated those models that did not generate worse predictions during recessions. They were observed to occur during the sub-periods of the oil crisis in the late 70s when the interest rate reached a historical peak. Interestingly in these sub-periods, we discover that the test volatility of realized stock returns has little difference between the recession and non-recession days. That implies the better prediction performance observed in the 70s is not the merit of the ML methods. Instead, it is perhaps the effective monetary policy that stabilized the stock market during those sub-periods. Additionally, we show that the inclusion of recession data in the training set and the incorporation of the risk-free rate and VIX index as input variables did not significantly improve recession performance. To manage the negative implications of recession volatility, we proposed an auto-encoder-inspired model architecture capable of generating confidence scores consistent with true model performance. Comparing the confidence model's recession predictions with and without confidence-based decision-making, we demonstrated that prediction errors during recessions could be lowered with a carefully selected confidence threshold. Besides this measure, we also recommend ML practitioners evaluate their models on both recession and expansion data. Future work could explore other methods of showcasing the negative impacts of a recession and other methods of relieving its effects. |
| first_indexed | 2024-10-01T02:19:17Z |
| format | Final Year Project (FYP) |
| id | ntu-10356/165925 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T02:19:17Z |
| publishDate | 2023 |
| publisher | Nanyang Technological University |
| record_format | dspace |
| spelling | ntu-10356/1659252023-04-21T15:36:57Z Stock price predictability and the business cycle via machine learning Wang, Li Rong Fan Xiuyi School of Computer Science and Engineering Hsuan Fu xyfan@ntu.edu.sg Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence The negative effects of data shifts on machine learning (ML) model performance have been extensively characterized in numerous applications of ML (e.g. natural language processing). However, few studies are exploring the data-shifting effects of the business cycle, particularly in the context of stock price forecasting. Hence, this research studies how the business cycle affects stock price forecasting and explores possible mitigating measures. Using the S&P 500 index, we begin by documenting a stylized fact that most prediction models perform worse during the US recessions, which is public information dated by the National Bureau of Economic Research (NBER). We further investigated those models that did not generate worse predictions during recessions. They were observed to occur during the sub-periods of the oil crisis in the late 70s when the interest rate reached a historical peak. Interestingly in these sub-periods, we discover that the test volatility of realized stock returns has little difference between the recession and non-recession days. That implies the better prediction performance observed in the 70s is not the merit of the ML methods. Instead, it is perhaps the effective monetary policy that stabilized the stock market during those sub-periods. Additionally, we show that the inclusion of recession data in the training set and the incorporation of the risk-free rate and VIX index as input variables did not significantly improve recession performance. To manage the negative implications of recession volatility, we proposed an auto-encoder-inspired model architecture capable of generating confidence scores consistent with true model performance. Comparing the confidence model's recession predictions with and without confidence-based decision-making, we demonstrated that prediction errors during recessions could be lowered with a carefully selected confidence threshold. Besides this measure, we also recommend ML practitioners evaluate their models on both recession and expansion data. Future work could explore other methods of showcasing the negative impacts of a recession and other methods of relieving its effects. Bachelor of Science in Data Science and Artificial Intelligence 2023-04-17T01:21:23Z 2023-04-17T01:21:23Z 2023 Final Year Project (FYP) Wang, L. R. (2023). Stock price predictability and the business cycle via machine learning. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/165925 https://hdl.handle.net/10356/165925 en SCSE22-0521 application/pdf Nanyang Technological University |
| spellingShingle | Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Wang, Li Rong Stock price predictability and the business cycle via machine learning |
| title | Stock price predictability and the business cycle via machine learning |
| title_full | Stock price predictability and the business cycle via machine learning |
| title_fullStr | Stock price predictability and the business cycle via machine learning |
| title_full_unstemmed | Stock price predictability and the business cycle via machine learning |
| title_short | Stock price predictability and the business cycle via machine learning |
| title_sort | stock price predictability and the business cycle via machine learning |
| topic | Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence |
| url | https://hdl.handle.net/10356/165925 |
| work_keys_str_mv | AT wanglirong stockpricepredictabilityandthebusinesscycleviamachinelearning |