A novelty detection machine and its application to bank failure prediction
Novelty detection has been well-studied for many years and has found a wide range of applications, but correctly identifying the outliers is still a hard problem because of the diverse variation and the small quantity of such outliers. We address the problem using several distinct characteristics of...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Journal Article |
| Language: | English |
| Published: |
2013
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10356/106802 http://hdl.handle.net/10220/17778 |
| _version_ | 1811686397128474624 |
|---|---|
| author | Li, Shukai Tung, Whye Loon Ng, Wee Keong |
| author2 | School of Computer Engineering |
| author_facet | School of Computer Engineering Li, Shukai Tung, Whye Loon Ng, Wee Keong |
| author_sort | Li, Shukai |
| collection | NTU |
| description | Novelty detection has been well-studied for many years and has found a wide range of applications, but correctly identifying the outliers is still a hard problem because of the diverse variation and the small quantity of such outliers. We address the problem using several distinct characteristics of the outliers and the normal patterns. First, normal patterns are usually grouped together, forming clusters in the high density regions of the data space. Second, outliers are characteristically very different from the normal patterns, and hence tend to be located far away from the normal patterns in the data space. Third, the number of outliers is generally very small in a given dataset. Based on these observations, we can envisage that the appropriate decision boundary segregating the outliers and the normal patterns usually lies in some low density regions of the data space. This is referred to as cluster assumption. The resultant optimization problem to learn the decision function can be solved using the mixed integer programming approach. Following that, we present a cutting plane algorithm together with a multiple kernel learning technique to solve the convex relaxation of the optimization problem. Specifically, we make use of the scarcity of the outliers to find a violating solution to the cutting plane algorithm. Experimental results with several benchmark datasets show that our proposed novelty detection method outperforms existing hyperplane and density estimation-based novelty detection techniques. We subsequently apply our method to the prediction of banking failures to identify potential bank failures or high risk banks through the traits of financial distress. |
| first_indexed | 2024-10-01T04:59:46Z |
| format | Journal Article |
| id | ntu-10356/106802 |
| institution | Nanyang Technological University |
| language | English |
| last_indexed | 2024-10-01T04:59:46Z |
| publishDate | 2013 |
| record_format | dspace |
| spelling | ntu-10356/1068022020-05-28T07:18:21Z A novelty detection machine and its application to bank failure prediction Li, Shukai Tung, Whye Loon Ng, Wee Keong School of Computer Engineering DRNTU::Engineering::Computer science and engineering Novelty detection has been well-studied for many years and has found a wide range of applications, but correctly identifying the outliers is still a hard problem because of the diverse variation and the small quantity of such outliers. We address the problem using several distinct characteristics of the outliers and the normal patterns. First, normal patterns are usually grouped together, forming clusters in the high density regions of the data space. Second, outliers are characteristically very different from the normal patterns, and hence tend to be located far away from the normal patterns in the data space. Third, the number of outliers is generally very small in a given dataset. Based on these observations, we can envisage that the appropriate decision boundary segregating the outliers and the normal patterns usually lies in some low density regions of the data space. This is referred to as cluster assumption. The resultant optimization problem to learn the decision function can be solved using the mixed integer programming approach. Following that, we present a cutting plane algorithm together with a multiple kernel learning technique to solve the convex relaxation of the optimization problem. Specifically, we make use of the scarcity of the outliers to find a violating solution to the cutting plane algorithm. Experimental results with several benchmark datasets show that our proposed novelty detection method outperforms existing hyperplane and density estimation-based novelty detection techniques. We subsequently apply our method to the prediction of banking failures to identify potential bank failures or high risk banks through the traits of financial distress. 2013-11-19T04:47:31Z 2019-12-06T22:18:40Z 2013-11-19T04:47:31Z 2019-12-06T22:18:40Z 2013 2013 Journal Article Li, S., Tung, W. L., & Ng, W. K. (2013). A novelty detection machine and its application to bank failure prediction. Neurocomputing, in press. 0925-2312 https://hdl.handle.net/10356/106802 http://hdl.handle.net/10220/17778 10.1016/j.neucom.2013.02.043 en Neurocomputing |
| spellingShingle | DRNTU::Engineering::Computer science and engineering Li, Shukai Tung, Whye Loon Ng, Wee Keong A novelty detection machine and its application to bank failure prediction |
| title | A novelty detection machine and its application to bank failure prediction |
| title_full | A novelty detection machine and its application to bank failure prediction |
| title_fullStr | A novelty detection machine and its application to bank failure prediction |
| title_full_unstemmed | A novelty detection machine and its application to bank failure prediction |
| title_short | A novelty detection machine and its application to bank failure prediction |
| title_sort | novelty detection machine and its application to bank failure prediction |
| topic | DRNTU::Engineering::Computer science and engineering |
| url | https://hdl.handle.net/10356/106802 http://hdl.handle.net/10220/17778 |
| work_keys_str_mv | AT lishukai anoveltydetectionmachineanditsapplicationtobankfailureprediction AT tungwhyeloon anoveltydetectionmachineanditsapplicationtobankfailureprediction AT ngweekeong anoveltydetectionmachineanditsapplicationtobankfailureprediction AT lishukai noveltydetectionmachineanditsapplicationtobankfailureprediction AT tungwhyeloon noveltydetectionmachineanditsapplicationtobankfailureprediction AT ngweekeong noveltydetectionmachineanditsapplicationtobankfailureprediction |