Learning from partially labeled data
Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2002.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2005
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/29273 |
| _version_ | 1826200962099838976 |
|---|---|
| author | Szummer, Marcin Olof |
| author2 | Tommi S. Jaakkola, Tomaso A. Poggio and Leslie P. Kaelbling. |
| author_facet | Tommi S. Jaakkola, Tomaso A. Poggio and Leslie P. Kaelbling. Szummer, Marcin Olof |
| author_sort | Szummer, Marcin Olof |
| collection | MIT |
| description | Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2002. |
| first_indexed | 2024-09-23T11:44:27Z |
| format | Thesis |
| id | mit-1721.1/29273 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T11:44:27Z |
| publishDate | 2005 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/292732019-04-10T21:28:26Z Learning from partially labeled data Szummer, Marcin Olof Tommi S. Jaakkola, Tomaso A. Poggio and Leslie P. Kaelbling. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Massachusetts Institute of Technology. Dept. of Electrical Engineering and Computer Science. Electrical Engineering and Computer Science. Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 2002. Includes bibliographical references (p. 75-81). Classification with partially labeled data involves learning from a few labeled examples as well as a large number of unlabeled examples, and represents a blend of supervised and unsupervised learning. Unlabeled examples provide information about the input domain distribution, but only the labeled examples indicate the actual classification task. The key question is how to improve classification accuracy by linking aspects of the input distribution P(x) to the conditional output distribution P(yx ) of the classifier. This thesis presents three approaches to the problem, starting with a kernel classifier that can be interpreted as a discriminative kernel density estimator and is trained via the EM algorithm or via margin-based criteria. Secondly, we employ a Markov random walk representation that exploits clusters and low-dimensional structure in the data in a robust and probabilistic manner. Thirdly, we introduce information regularization, a non-parametric technique based on minimizing information about labels over regions covering the domain. Information regularization provides a direct and principled way of linking P(x) to P(yx), and remains tractable for continuous P(x). The partially labeled problem arises in many applications where it is easy to collect unlabeled examples, but labor-intensive to classify the examples. The thesis demonstrates that the approaches require very few labeled examples for high classification accuracy on text and image-classification tasks. by Marcin Olof Szummer. Ph.D. 2005-10-14T19:34:51Z 2005-10-14T19:34:51Z 2002 2002 Thesis http://hdl.handle.net/1721.1/29273 52060366 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 81 p. 4162202 bytes 4162009 bytes application/pdf application/pdf application/pdf Massachusetts Institute of Technology |
| spellingShingle | Electrical Engineering and Computer Science. Szummer, Marcin Olof Learning from partially labeled data |
| title | Learning from partially labeled data |
| title_full | Learning from partially labeled data |
| title_fullStr | Learning from partially labeled data |
| title_full_unstemmed | Learning from partially labeled data |
| title_short | Learning from partially labeled data |
| title_sort | learning from partially labeled data |
| topic | Electrical Engineering and Computer Science. |
| url | http://hdl.handle.net/1721.1/29273 |
| work_keys_str_mv | AT szummermarcinolof learningfrompartiallylabeleddata |