Extending the decomposition algorithm for support vector machines training
The Support Vector Machine (SVM) is found to de a capable learning machine. It has the ability to handle difficult pattern recognition tasks such as speech recognition, and has demonstrated reasonable performance. The formulation in a SVM is elegant in that it is simplified to a convex Quadratic IPr...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universiti Utara Malaysia Press
2003
|
| Subjects: | |
| Online Access: | https://repo.uum.edu.my/id/eprint/345/1/N.M.Zaki.pdf |
| _version_ | 1803624110377402368 |
|---|---|
| author | Zaki, N,M. Deris, S. Chin, K.K. |
| author_facet | Zaki, N,M. Deris, S. Chin, K.K. |
| author_sort | Zaki, N,M. |
| collection | UUM |
| description | The Support Vector Machine (SVM) is found to de a capable learning machine. It has the ability to handle difficult pattern recognition tasks such as speech recognition, and has demonstrated reasonable performance. The formulation in a SVM is elegant in that it is simplified to a convex Quadratic IProgramming (QP) problem. Theoretically the training is guaranteed to converge to a global optimal. The training of SVM is not as straightforward as it seems. Numerical problems will cause the training to give non- optimal decision boundaries. Using a conventional optimizer to train SVM is not the ideal solution. One can design a dedicated optimizer that will take full advantage of the specific nature of the QP problem in SVM training. The decomposition algorithm developed by Osuna et al. (1997a) reduces the training cost to an acceptable level. In this paper we have analyzed and developed an extension to Osuna's method in order 110 achieve better performance. The modified method can be used to solve the training of practical SVMs, in which the training might not otherwise converge. |
| first_indexed | 2024-07-04T05:13:10Z |
| format | Article |
| id | uum-345 |
| institution | Universiti Utara Malaysia |
| language | English |
| last_indexed | 2024-07-04T05:13:10Z |
| publishDate | 2003 |
| publisher | Universiti Utara Malaysia Press |
| record_format | dspace |
| spelling | uum-3452010-07-28T13:41:24Z https://repo.uum.edu.my/id/eprint/345/ Extending the decomposition algorithm for support vector machines training Zaki, N,M. Deris, S. Chin, K.K. QA Mathematics The Support Vector Machine (SVM) is found to de a capable learning machine. It has the ability to handle difficult pattern recognition tasks such as speech recognition, and has demonstrated reasonable performance. The formulation in a SVM is elegant in that it is simplified to a convex Quadratic IProgramming (QP) problem. Theoretically the training is guaranteed to converge to a global optimal. The training of SVM is not as straightforward as it seems. Numerical problems will cause the training to give non- optimal decision boundaries. Using a conventional optimizer to train SVM is not the ideal solution. One can design a dedicated optimizer that will take full advantage of the specific nature of the QP problem in SVM training. The decomposition algorithm developed by Osuna et al. (1997a) reduces the training cost to an acceptable level. In this paper we have analyzed and developed an extension to Osuna's method in order 110 achieve better performance. The modified method can be used to solve the training of practical SVMs, in which the training might not otherwise converge. Universiti Utara Malaysia Press 2003 Article PeerReviewed application/pdf en https://repo.uum.edu.my/id/eprint/345/1/N.M.Zaki.pdf Zaki, N,M. and Deris, S. and Chin, K.K. (2003) Extending the decomposition algorithm for support vector machines training. Journal of Information and Communication Technology, 1 (2). pp. 17-29. ISSN 2180-3862 http://jict.uum.edu.my |
| spellingShingle | QA Mathematics Zaki, N,M. Deris, S. Chin, K.K. Extending the decomposition algorithm for support vector machines training |
| title | Extending the decomposition algorithm for support vector machines training |
| title_full | Extending the decomposition algorithm for support vector machines training |
| title_fullStr | Extending the decomposition algorithm for support vector machines training |
| title_full_unstemmed | Extending the decomposition algorithm for support vector machines training |
| title_short | Extending the decomposition algorithm for support vector machines training |
| title_sort | extending the decomposition algorithm for support vector machines training |
| topic | QA Mathematics |
| url | https://repo.uum.edu.my/id/eprint/345/1/N.M.Zaki.pdf |
| work_keys_str_mv | AT zakinm extendingthedecompositionalgorithmforsupportvectormachinestraining AT deriss extendingthedecompositionalgorithmforsupportvectormachinestraining AT chinkk extendingthedecompositionalgorithmforsupportvectormachinestraining |