Mathematical analysis of uncertainty in machine learning and deep learning
Thesis: S.M. in Engineering and Management, Massachusetts Institute of Technology, Engineering Systems Division, System Design and Management Program, 2020
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Language: | eng |
| Published: |
Massachusetts Institute of Technology
2022
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/1721.1/145230 |
| _version_ | 1811086848803471360 |
|---|---|
| author | Kashimura, Takuya. |
| author2 | Massachusetts Institute of Technology. Engineering Systems Division. |
| author_facet | Massachusetts Institute of Technology. Engineering Systems Division. Kashimura, Takuya. |
| author_sort | Kashimura, Takuya. |
| collection | MIT |
| description | Thesis: S.M. in Engineering and Management, Massachusetts Institute of Technology, Engineering Systems Division, System Design and Management Program, 2020 |
| first_indexed | 2024-09-23T13:35:38Z |
| format | Thesis |
| id | mit-1721.1/145230 |
| institution | Massachusetts Institute of Technology |
| language | eng |
| last_indexed | 2024-09-23T13:35:38Z |
| publishDate | 2022 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1452302022-09-01T03:21:28Z Mathematical analysis of uncertainty in machine learning and deep learning Kashimura, Takuya. Massachusetts Institute of Technology. Engineering Systems Division. System Design and Management Program. Massachusetts Institute of Technology. Engineering Systems Division System Design and Management Program. Engineering Systems Division. System Design and Management Program. Thesis: S.M. in Engineering and Management, Massachusetts Institute of Technology, Engineering Systems Division, System Design and Management Program, 2020 Cataloged from PDF version of thesis. Includes bibliographical references (pages 69-72). In this paper, we study uncertainty in machine learning and deep learning from the mathematical point of view. Uncertainty is involved in many real-world situations. The Bayesian modelling can handle such uncertainty in machine learning community. However, the traditional deep learning model fails to show uncertainty for its outputs. Recently, at the intersection of the Bayesian modelling and deep learning, a new framework called the Bayesian deep learning (BDL) has been proposed and studied, which enables us to estimate uncertainty of deep learning models. As an example of it, we can review the results of Yarin Gal, in which the famous dropout method can be seen as a Bayesian modelling. We also see that overfitting problem of the framework due to the property of the KL divergence, and review the modified algorithm using o-divergence which generalizes the KL divergence. We also study a confidence band to assess uncertainty of a kernel ridge regression estimator. We propose the formulation to obtain a confidence band as the convex optimization, which enables us to use existing algorithms such as the primal-dual inner point method. The proposed method acquires a more accurate and fast confidence band than a bootstrap algorithm. We also see the effectiveness of our proposed method both in the case of function approximation and an estimate of an actual dataset. by Takuya Kashimura. S.M. in Engineering and Management S.M. in Engineering and Management Massachusetts Institute of Technology, Engineering Systems Division, System Design and Management Program 2022-08-31T16:29:22Z 2022-08-31T16:29:22Z 2020 2020 Thesis https://hdl.handle.net/1721.1/145230 1341996474 eng MIT theses may be protected by copyright. Please reuse MIT thesis content according to the MIT Libraries Permissions Policy, which is available through the URL provided. http://dspace.mit.edu/handle/1721.1/7582 72 pages application/pdf Massachusetts Institute of Technology |
| spellingShingle | Engineering Systems Division. System Design and Management Program. Kashimura, Takuya. Mathematical analysis of uncertainty in machine learning and deep learning |
| title | Mathematical analysis of uncertainty in machine learning and deep learning |
| title_full | Mathematical analysis of uncertainty in machine learning and deep learning |
| title_fullStr | Mathematical analysis of uncertainty in machine learning and deep learning |
| title_full_unstemmed | Mathematical analysis of uncertainty in machine learning and deep learning |
| title_short | Mathematical analysis of uncertainty in machine learning and deep learning |
| title_sort | mathematical analysis of uncertainty in machine learning and deep learning |
| topic | Engineering Systems Division. System Design and Management Program. |
| url | https://hdl.handle.net/1721.1/145230 |
| work_keys_str_mv | AT kashimuratakuya mathematicalanalysisofuncertaintyinmachinelearninganddeeplearning |