Combining Model-based and Discriminative Approaches in a Modular Two-stage Classification System: Application to Isolated Handwritten Digit Recognition
The motivation of this work is based on two key observations. First, the classification algorithms can be separated into two main categories: discriminative and model-based approaches. Second, two types of patterns can generate problems: ambiguous patterns and outliers. While, the first approach tri...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Computer Vision Center Press
2005-10-01
|
| Series: | ELCVIA Electronic Letters on Computer Vision and Image Analysis |
| Subjects: | |
| Online Access: | https://elcvia.cvc.uab.es/article/view/92 |
| _version_ | 1819107364747345920 |
|---|---|
| author | Jonathan Milgram Robert Sabourin Mohamed Cheriet |
| author_facet | Jonathan Milgram Robert Sabourin Mohamed Cheriet |
| author_sort | Jonathan Milgram |
| collection | DOAJ |
| description | The motivation of this work is based on two key observations. First, the classification algorithms can be separated into two main categories: discriminative and model-based approaches. Second, two types of patterns can generate problems: ambiguous patterns and outliers. While, the first approach tries to minimize the first type of error, but cannot deal effectively with outliers, the second approach, which is based on the development of a model for each class, make the outlier detection possible, but are not sufficiently discriminant. Thus, we propose to combine these two different approaches in a modular two-stage classification system embedded in a probabilistic framework. In the first stage we pre-estimate the posterior probabilities with a model-based approach and we re-estimate only the highest probabilities with appropriate Support Vector Classifiers (SVC) in the second stage. Another advantage of this combination is to reduce the principal burden of SVC, the processing time necessary to make a decision and to open the way to use SVC in classification problem with a large number of classes. Finally, the first experiments on the benchmark database MNIST have shown that our dynamic classification process allows to maintain the accuracy of SVCs, while decreasing complexity by a factor 8.7 and making the outlier rejection available. |
| first_indexed | 2024-12-22T02:52:52Z |
| format | Article |
| id | doaj.art-21e620f80a6f437e8ff3d7c75d289ca8 |
| institution | Directory Open Access Journal |
| issn | 1577-5097 |
| language | English |
| last_indexed | 2024-12-22T02:52:52Z |
| publishDate | 2005-10-01 |
| publisher | Computer Vision Center Press |
| record_format | Article |
| series | ELCVIA Electronic Letters on Computer Vision and Image Analysis |
| spelling | doaj.art-21e620f80a6f437e8ff3d7c75d289ca82022-12-21T18:41:20ZengComputer Vision Center PressELCVIA Electronic Letters on Computer Vision and Image Analysis1577-50972005-10-015210.5565/rev/elcvia.9263Combining Model-based and Discriminative Approaches in a Modular Two-stage Classification System: Application to Isolated Handwritten Digit RecognitionJonathan MilgramRobert SabourinMohamed CherietThe motivation of this work is based on two key observations. First, the classification algorithms can be separated into two main categories: discriminative and model-based approaches. Second, two types of patterns can generate problems: ambiguous patterns and outliers. While, the first approach tries to minimize the first type of error, but cannot deal effectively with outliers, the second approach, which is based on the development of a model for each class, make the outlier detection possible, but are not sufficiently discriminant. Thus, we propose to combine these two different approaches in a modular two-stage classification system embedded in a probabilistic framework. In the first stage we pre-estimate the posterior probabilities with a model-based approach and we re-estimate only the highest probabilities with appropriate Support Vector Classifiers (SVC) in the second stage. Another advantage of this combination is to reduce the principal burden of SVC, the processing time necessary to make a decision and to open the way to use SVC in classification problem with a large number of classes. Finally, the first experiments on the benchmark database MNIST have shown that our dynamic classification process allows to maintain the accuracy of SVCs, while decreasing complexity by a factor 8.7 and making the outlier rejection available.https://elcvia.cvc.uab.es/article/view/92Classifier CombinationSupport Vector ClassifierModel-based ApproachOutlier DetectionError-Reject TradeoffClassifying Cost |
| spellingShingle | Jonathan Milgram Robert Sabourin Mohamed Cheriet Combining Model-based and Discriminative Approaches in a Modular Two-stage Classification System: Application to Isolated Handwritten Digit Recognition ELCVIA Electronic Letters on Computer Vision and Image Analysis Classifier Combination Support Vector Classifier Model-based Approach Outlier Detection Error-Reject Tradeoff Classifying Cost |
| title | Combining Model-based and Discriminative Approaches in a Modular Two-stage Classification System: Application to Isolated Handwritten Digit Recognition |
| title_full | Combining Model-based and Discriminative Approaches in a Modular Two-stage Classification System: Application to Isolated Handwritten Digit Recognition |
| title_fullStr | Combining Model-based and Discriminative Approaches in a Modular Two-stage Classification System: Application to Isolated Handwritten Digit Recognition |
| title_full_unstemmed | Combining Model-based and Discriminative Approaches in a Modular Two-stage Classification System: Application to Isolated Handwritten Digit Recognition |
| title_short | Combining Model-based and Discriminative Approaches in a Modular Two-stage Classification System: Application to Isolated Handwritten Digit Recognition |
| title_sort | combining model based and discriminative approaches in a modular two stage classification system application to isolated handwritten digit recognition |
| topic | Classifier Combination Support Vector Classifier Model-based Approach Outlier Detection Error-Reject Tradeoff Classifying Cost |
| url | https://elcvia.cvc.uab.es/article/view/92 |
| work_keys_str_mv | AT jonathanmilgram combiningmodelbasedanddiscriminativeapproachesinamodulartwostageclassificationsystemapplicationtoisolatedhandwrittendigitrecognition AT robertsabourin combiningmodelbasedanddiscriminativeapproachesinamodulartwostageclassificationsystemapplicationtoisolatedhandwrittendigitrecognition AT mohamedcheriet combiningmodelbasedanddiscriminativeapproachesinamodulartwostageclassificationsystemapplicationtoisolatedhandwrittendigitrecognition |