Integer optimization methods for machine learning
Thesis (Ph. D.)--Massachusetts Institute of Technology, Sloan School of Management, Operations Research Center, 2012.
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2012
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/1721.1/72643 |
| _version_ | 1826194664429977600 |
|---|---|
| author | Chang, Allison An |
| author2 | Massachusetts Institute of Technology. Operations Research Center. |
| author_facet | Massachusetts Institute of Technology. Operations Research Center. Chang, Allison An |
| author_sort | Chang, Allison An |
| collection | MIT |
| description | Thesis (Ph. D.)--Massachusetts Institute of Technology, Sloan School of Management, Operations Research Center, 2012. |
| first_indexed | 2024-09-23T10:00:02Z |
| format | Thesis |
| id | mit-1721.1/72643 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T10:00:02Z |
| publishDate | 2012 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/726432019-04-10T07:45:53Z Integer optimization methods for machine learning Chang, Allison An Massachusetts Institute of Technology. Operations Research Center. Massachusetts Institute of Technology. Operations Research Center. Operations Research Center. Thesis (Ph. D.)--Massachusetts Institute of Technology, Sloan School of Management, Operations Research Center, 2012. This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections. Cataloged from student-submitted PDF version of thesis. Includes bibliographical references (p. 129-137). In this thesis, we propose new mixed integer optimization (MIO) methods to ad- dress problems in machine learning. The first part develops methods for supervised bipartite ranking, which arises in prioritization tasks in diverse domains such as information retrieval, recommender systems, natural language processing, bioinformatics, and preventative maintenance. The primary advantage of using MIO for ranking is that it allows for direct optimization of ranking quality measures, as opposed to current state-of-the-art algorithms that use heuristic loss functions. We demonstrate using a number of datasets that our approach can outperform other ranking methods. The second part of the thesis focuses on reverse-engineering ranking models. This is an application of a more general ranking problem than the bipartite case. Quality rankings affect business for many organizations, and knowing the ranking models would allow these organizations to better understand the standards by which their products are judged and help them to create higher quality products. We introduce an MIO method for reverse-engineering such models and demonstrate its performance in a case-study with real data from a major ratings company. We also devise an approach to find the most cost-effective way to increase the rank of a certain product. In the final part of the thesis, we develop MIO methods to first generate association rules and then use the rules to build an interpretable classifier in the form of a decision list, which is an ordered list of rules. These are both combinatorially challenging problems because even a small dataset may yield a large number of rules and a small set of rules may correspond to many different orderings. We show how to use MIO to mine useful rules, as well as to construct a classifier from them. We present results in terms of both classification accuracy and interpretability for a variety of datasets. by Allison An Chang. Ph.D. 2012-09-11T17:32:28Z 2012-09-11T17:32:28Z 2012 2012 Thesis http://hdl.handle.net/1721.1/72643 807180339 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 137 p. application/pdf Massachusetts Institute of Technology |
| spellingShingle | Operations Research Center. Chang, Allison An Integer optimization methods for machine learning |
| title | Integer optimization methods for machine learning |
| title_full | Integer optimization methods for machine learning |
| title_fullStr | Integer optimization methods for machine learning |
| title_full_unstemmed | Integer optimization methods for machine learning |
| title_short | Integer optimization methods for machine learning |
| title_sort | integer optimization methods for machine learning |
| topic | Operations Research Center. |
| url | http://hdl.handle.net/1721.1/72643 |
| work_keys_str_mv | AT changallisonan integeroptimizationmethodsformachinelearning |