Structured Diffusion Processes in Deep Generative Models
Diffusion generative models have emerged as a powerful, versatile, and elegant generative modeling framework for diverse data modalities. However, the high computational cost of inference relative to other frameworks remains a chief limitation of such models. At the same time, the design space of a...
| Main Author: | |
|---|---|
| Other Authors: | |
| Format: | Thesis |
| Published: |
Massachusetts Institute of Technology
2023
|
| Online Access: | https://hdl.handle.net/1721.1/147277 |
| _version_ | 1811074180885512192 |
|---|---|
| author | Jing, Bowen |
| author2 | Jaakkola, Tommi |
| author_facet | Jaakkola, Tommi Jing, Bowen |
| author_sort | Jing, Bowen |
| collection | MIT |
| description | Diffusion generative models have emerged as a powerful, versatile, and elegant generative modeling framework for diverse data modalities. However, the high computational cost of inference relative to other frameworks remains a chief limitation of such models. At the same time, the design space of a key component in their formulation—the forward diffusion process—has been underexplored. This thesis proposes a paradigm to accelerate and improve diffusion generative models by tailoring structured forward diffusion processes to the generative modeling problem at hand.
Case studies of structured diffusion processes are developed and presented for (1) natural images and (2) molecular conformers. First, the subspace structure in images is exploited to develop subspace diffusion, a forward diffusion process that restricts the diffusion via projections to subspaces of decreasing dimensionality. Second, chemical constraints in molecular conformers are exploited to develop torsional diffusion, a forward process that preserves those constraints by operating over a lower-dimensional, non-Euclidean space. Both approaches simultaneously improve sample quality and reduce inference runtime while preserving existing capabilities—and developing new ones—of diffusion generative models. |
| first_indexed | 2024-09-23T09:44:43Z |
| format | Thesis |
| id | mit-1721.1/147277 |
| institution | Massachusetts Institute of Technology |
| last_indexed | 2024-09-23T09:44:43Z |
| publishDate | 2023 |
| publisher | Massachusetts Institute of Technology |
| record_format | dspace |
| spelling | mit-1721.1/1472772023-01-20T03:52:44Z Structured Diffusion Processes in Deep Generative Models Jing, Bowen Jaakkola, Tommi Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Diffusion generative models have emerged as a powerful, versatile, and elegant generative modeling framework for diverse data modalities. However, the high computational cost of inference relative to other frameworks remains a chief limitation of such models. At the same time, the design space of a key component in their formulation—the forward diffusion process—has been underexplored. This thesis proposes a paradigm to accelerate and improve diffusion generative models by tailoring structured forward diffusion processes to the generative modeling problem at hand. Case studies of structured diffusion processes are developed and presented for (1) natural images and (2) molecular conformers. First, the subspace structure in images is exploited to develop subspace diffusion, a forward diffusion process that restricts the diffusion via projections to subspaces of decreasing dimensionality. Second, chemical constraints in molecular conformers are exploited to develop torsional diffusion, a forward process that preserves those constraints by operating over a lower-dimensional, non-Euclidean space. Both approaches simultaneously improve sample quality and reduce inference runtime while preserving existing capabilities—and developing new ones—of diffusion generative models. S.M. 2023-01-19T18:42:19Z 2023-01-19T18:42:19Z 2022-09 2022-10-19T18:57:32.175Z Thesis https://hdl.handle.net/1721.1/147277 In Copyright - Educational Use Permitted Copyright retained by author(s) https://rightsstatements.org/page/InC-EDU/1.0/ application/pdf Massachusetts Institute of Technology |
| spellingShingle | Jing, Bowen Structured Diffusion Processes in Deep Generative Models |
| title | Structured Diffusion Processes in Deep Generative Models |
| title_full | Structured Diffusion Processes in Deep Generative Models |
| title_fullStr | Structured Diffusion Processes in Deep Generative Models |
| title_full_unstemmed | Structured Diffusion Processes in Deep Generative Models |
| title_short | Structured Diffusion Processes in Deep Generative Models |
| title_sort | structured diffusion processes in deep generative models |
| url | https://hdl.handle.net/1721.1/147277 |
| work_keys_str_mv | AT jingbowen structureddiffusionprocessesindeepgenerativemodels |