Design and development of intelligent knowledge discovery system for stock exchange database
The stock market is a complex, nonstationary, chaotic and non-linear dynamical system. Most of the existing methods suffer from drawbacks like long training times required, often hard to understand results, and inaccurate predictions. This study focuses on data mining approach for stock market predi...
| Main Authors: | , , , , , |
|---|---|
| Format: | Monograph |
| Language: | English |
| Published: |
Faculty of Computer Science and Information System
2005
|
| Subjects: | |
| Online Access: | http://eprints.utm.my/4361/1/74080.pdf |
| _version_ | 1796853719059398656 |
|---|---|
| author | Md. Sap, Mohd. Noor Selamat, Harihodin Shamsuddin, Siti Mariyam Khokhar, Rashid Hafeez Che Mat @ Mohd. Shukor, Zamzarina Awan, Abdul Majid |
| author_facet | Md. Sap, Mohd. Noor Selamat, Harihodin Shamsuddin, Siti Mariyam Khokhar, Rashid Hafeez Che Mat @ Mohd. Shukor, Zamzarina Awan, Abdul Majid |
| author_sort | Md. Sap, Mohd. Noor |
| collection | ePrints |
| description | The stock market is a complex, nonstationary, chaotic and non-linear dynamical system. Most of the existing methods suffer from drawbacks like long training times required, often hard to understand results, and inaccurate predictions. This study focuses on data mining approach for stock market prediction. The aim is to discover unknown patterns, new rules and hidden knowledge from large databases of stock index that are potentially useful and ultimately understandable for making crucial decisions related to stock market. The prototype knowledge discovery system developed in this research can produce accurate and effective information in order to facilitate economic activities. The developed prototype consists of mainly two parts: i) based on Fuzzy decision tree (FDT); and ii) based on support vector regression (SVR). In predictive FDT, aim is to combine the symbolic decision trees with approximate reasoning offered by fuzzy representation. In fuzzy reasoning method, the weights are assigned to each proposition in the antecedent part and the Certainty Factor (CF) is computed for the consequent part of each Fuzzy Production Rule (FPR). Then for stock market prediction significant weighted fuzzy production rules (WFPRs) are extracted. The predictive FDTs are tested using three data sets including Kuala Lumpur Stock Exchange (KLSE), New York Stock Exchange (NYSE) and London Stock Exchange (LSE). The results of predictive FDT method are favorably compared with those of other random walk models like Autoregression Moving Average (ARMA) and Autoregression Integrated Moving Average (ARIMA). The SVR prediction system is based on support vector machine (SVM) approach. Weighted kernel based clustering method with neighborhood constraints is incorporated in this system for getting improved prediction results. The SVM based method gives better results than backpropagation neural networks. SVM offers the advantages including: i) there is a smaller number of free parameters; ii) SVM forecasts better as it offers better generalization; iii) training SVM is faster. In essence, both the subsystems (FDT and SVR based) developed in this project are complementary to each other. As the fuzzy decision tree based system gives easily interpretable results, we mainly use it to classify past and present data records. Whereas we use the stronger aspect of the SVR based approach for prediction of future trend of the stock market, and get improved results. |
| first_indexed | 2024-03-05T18:03:44Z |
| format | Monograph |
| id | utm.eprints-4361 |
| institution | Universiti Teknologi Malaysia - ePrints |
| language | English |
| last_indexed | 2024-03-05T18:03:44Z |
| publishDate | 2005 |
| publisher | Faculty of Computer Science and Information System |
| record_format | dspace |
| spelling | utm.eprints-43612017-08-07T03:18:30Z http://eprints.utm.my/4361/ Design and development of intelligent knowledge discovery system for stock exchange database Md. Sap, Mohd. Noor Selamat, Harihodin Shamsuddin, Siti Mariyam Khokhar, Rashid Hafeez Che Mat @ Mohd. Shukor, Zamzarina Awan, Abdul Majid ZA4050 Electronic information resources The stock market is a complex, nonstationary, chaotic and non-linear dynamical system. Most of the existing methods suffer from drawbacks like long training times required, often hard to understand results, and inaccurate predictions. This study focuses on data mining approach for stock market prediction. The aim is to discover unknown patterns, new rules and hidden knowledge from large databases of stock index that are potentially useful and ultimately understandable for making crucial decisions related to stock market. The prototype knowledge discovery system developed in this research can produce accurate and effective information in order to facilitate economic activities. The developed prototype consists of mainly two parts: i) based on Fuzzy decision tree (FDT); and ii) based on support vector regression (SVR). In predictive FDT, aim is to combine the symbolic decision trees with approximate reasoning offered by fuzzy representation. In fuzzy reasoning method, the weights are assigned to each proposition in the antecedent part and the Certainty Factor (CF) is computed for the consequent part of each Fuzzy Production Rule (FPR). Then for stock market prediction significant weighted fuzzy production rules (WFPRs) are extracted. The predictive FDTs are tested using three data sets including Kuala Lumpur Stock Exchange (KLSE), New York Stock Exchange (NYSE) and London Stock Exchange (LSE). The results of predictive FDT method are favorably compared with those of other random walk models like Autoregression Moving Average (ARMA) and Autoregression Integrated Moving Average (ARIMA). The SVR prediction system is based on support vector machine (SVM) approach. Weighted kernel based clustering method with neighborhood constraints is incorporated in this system for getting improved prediction results. The SVM based method gives better results than backpropagation neural networks. SVM offers the advantages including: i) there is a smaller number of free parameters; ii) SVM forecasts better as it offers better generalization; iii) training SVM is faster. In essence, both the subsystems (FDT and SVR based) developed in this project are complementary to each other. As the fuzzy decision tree based system gives easily interpretable results, we mainly use it to classify past and present data records. Whereas we use the stronger aspect of the SVR based approach for prediction of future trend of the stock market, and get improved results. Faculty of Computer Science and Information System 2005 Monograph NonPeerReviewed application/pdf en http://eprints.utm.my/4361/1/74080.pdf Md. Sap, Mohd. Noor and Selamat, Harihodin and Shamsuddin, Siti Mariyam and Khokhar, Rashid Hafeez and Che Mat @ Mohd. Shukor, Zamzarina and Awan, Abdul Majid (2005) Design and development of intelligent knowledge discovery system for stock exchange database. Project Report. Faculty of Computer Science and Information System, Skudai Johor. (Unpublished) |
| spellingShingle | ZA4050 Electronic information resources Md. Sap, Mohd. Noor Selamat, Harihodin Shamsuddin, Siti Mariyam Khokhar, Rashid Hafeez Che Mat @ Mohd. Shukor, Zamzarina Awan, Abdul Majid Design and development of intelligent knowledge discovery system for stock exchange database |
| title | Design and development of intelligent knowledge discovery system for stock exchange database |
| title_full | Design and development of intelligent knowledge discovery system for stock exchange database |
| title_fullStr | Design and development of intelligent knowledge discovery system for stock exchange database |
| title_full_unstemmed | Design and development of intelligent knowledge discovery system for stock exchange database |
| title_short | Design and development of intelligent knowledge discovery system for stock exchange database |
| title_sort | design and development of intelligent knowledge discovery system for stock exchange database |
| topic | ZA4050 Electronic information resources |
| url | http://eprints.utm.my/4361/1/74080.pdf |
| work_keys_str_mv | AT mdsapmohdnoor designanddevelopmentofintelligentknowledgediscoverysystemforstockexchangedatabase AT selamatharihodin designanddevelopmentofintelligentknowledgediscoverysystemforstockexchangedatabase AT shamsuddinsitimariyam designanddevelopmentofintelligentknowledgediscoverysystemforstockexchangedatabase AT khokharrashidhafeez designanddevelopmentofintelligentknowledgediscoverysystemforstockexchangedatabase AT chematmohdshukorzamzarina designanddevelopmentofintelligentknowledgediscoverysystemforstockexchangedatabase AT awanabdulmajid designanddevelopmentofintelligentknowledgediscoverysystemforstockexchangedatabase |