Sampling from convex sets with a cold start using multiscale decompositions
A standard approach for sampling approximately uniformly from a convex body K ⊆ R n is to run a random walk within K. The requirement is that starting from a suitable initial distribution, the random walk should “mix rapidly”, i.e., after a number of steps that is polynomial in n and the aspect rati...
| Main Authors: | , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | English |
| Published: |
Springer Berlin Heidelberg
2024
|
| Online Access: | https://hdl.handle.net/1721.1/157860 |
| _version_ | 1824457907773636608 |
|---|---|
| author | Narayanan, Hariharan Rajaraman, Amit Srivastava, Piyush |
| author2 | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science |
| author_facet | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Narayanan, Hariharan Rajaraman, Amit Srivastava, Piyush |
| author_sort | Narayanan, Hariharan |
| collection | MIT |
| description | A standard approach for sampling approximately uniformly from a convex body K ⊆ R n is to run a random walk within K. The requirement is that starting from a suitable initial distribution, the random walk should “mix rapidly”, i.e., after a number of steps that is polynomial in n and the aspect ratio R/r (here, K is assumed to contain a ball of radius r and to be contained within a ball of radius R), the distribution of the random walk should come close to the uniform distribution π K on K. Different random walks differ in aspects such as the ease of implementation of each step, or suitability for a specific class of convex bodies. Therefore, the rapid mixing of a wide variety of random walks on convex bodies has been studied. Many proofs of rapid mixing of such random walks however require that the initial distribution of the random walk is not too different from the target distribution π K . In particular, they require that the probability density function of the initial distribution with respect to the uniform distribution π K on K must be bounded above by poly ( n ) : this is called a warm start. Achieving such a warm start often requires a non-trivial pre-processing step before the random walk can be started. This motivates the problem of proving rapid mixing from “cold starts”, i.e., when the density of the initial distribution with respect to π K can be as high as exp ( poly ( n ) ) . In contrast to warm starts, a cold start is usually trivial to achieve. However, rapid mixing from a cold start may not hold for every random walk, e.g., the well-known “ball walk” does not have rapid mixing from an arbitrary cold start. On the other hand, for the “hit-and-run” random walk, Lovász and Vempala proved rapid mixing from a cold start. For the related coordinate hit-and-run (CHR) random walk, which has been found to be promising in computational experiments, a rapid mixing result starting from a warm start was proven only recently, while the question of whether CHR mixes rapidly from a cold start remained open. In this paper, we construct a family of Markov chains inspired by classical multiscale decompositions of subsets of R n into countably many axis-aligned cubes. We show that even with a cold start, the mixing times of these chains are bounded by a polynomial in n and the aspect ratio of the body. Our main technical ingredient is an isoperimetric inequality for K for a metric that magnifies distances between points that are close to the boundary of K. As a byproduct of the analysis of this new family of chains, we show that the coordinate hit-and-run (CHR) random walk also mixes rapidly from a cold start, and also from any point that is not too close to the boundary of the body. |
| first_indexed | 2025-02-19T04:17:27Z |
| format | Article |
| id | mit-1721.1/157860 |
| institution | Massachusetts Institute of Technology |
| language | English |
| last_indexed | 2025-02-19T04:17:27Z |
| publishDate | 2024 |
| publisher | Springer Berlin Heidelberg |
| record_format | dspace |
| spelling | mit-1721.1/1578602025-01-04T06:30:42Z Sampling from convex sets with a cold start using multiscale decompositions Narayanan, Hariharan Rajaraman, Amit Srivastava, Piyush Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science A standard approach for sampling approximately uniformly from a convex body K ⊆ R n is to run a random walk within K. The requirement is that starting from a suitable initial distribution, the random walk should “mix rapidly”, i.e., after a number of steps that is polynomial in n and the aspect ratio R/r (here, K is assumed to contain a ball of radius r and to be contained within a ball of radius R), the distribution of the random walk should come close to the uniform distribution π K on K. Different random walks differ in aspects such as the ease of implementation of each step, or suitability for a specific class of convex bodies. Therefore, the rapid mixing of a wide variety of random walks on convex bodies has been studied. Many proofs of rapid mixing of such random walks however require that the initial distribution of the random walk is not too different from the target distribution π K . In particular, they require that the probability density function of the initial distribution with respect to the uniform distribution π K on K must be bounded above by poly ( n ) : this is called a warm start. Achieving such a warm start often requires a non-trivial pre-processing step before the random walk can be started. This motivates the problem of proving rapid mixing from “cold starts”, i.e., when the density of the initial distribution with respect to π K can be as high as exp ( poly ( n ) ) . In contrast to warm starts, a cold start is usually trivial to achieve. However, rapid mixing from a cold start may not hold for every random walk, e.g., the well-known “ball walk” does not have rapid mixing from an arbitrary cold start. On the other hand, for the “hit-and-run” random walk, Lovász and Vempala proved rapid mixing from a cold start. For the related coordinate hit-and-run (CHR) random walk, which has been found to be promising in computational experiments, a rapid mixing result starting from a warm start was proven only recently, while the question of whether CHR mixes rapidly from a cold start remained open. In this paper, we construct a family of Markov chains inspired by classical multiscale decompositions of subsets of R n into countably many axis-aligned cubes. We show that even with a cold start, the mixing times of these chains are bounded by a polynomial in n and the aspect ratio of the body. Our main technical ingredient is an isoperimetric inequality for K for a metric that magnifies distances between points that are close to the boundary of K. As a byproduct of the analysis of this new family of chains, we show that the coordinate hit-and-run (CHR) random walk also mixes rapidly from a cold start, and also from any point that is not too close to the boundary of the body. 2024-12-17T15:56:56Z 2024-12-17T15:56:56Z 2024-12-13 2024-12-15T04:16:40Z Article http://purl.org/eprint/type/JournalArticle https://hdl.handle.net/1721.1/157860 Narayanan, H., Rajaraman, A. & Srivastava, P. Sampling from convex sets with a cold start using multiscale decompositions. Probab. Theory Relat. Fields (2024). PUBLISHER_CC en https://doi.org/10.1007/s00440-024-01341-w Probability Theory and Related Fields Creative Commons Attribution https://creativecommons.org/licenses/by/4.0/ The Author(s) application/pdf Springer Berlin Heidelberg Springer Berlin Heidelberg |
| spellingShingle | Narayanan, Hariharan Rajaraman, Amit Srivastava, Piyush Sampling from convex sets with a cold start using multiscale decompositions |
| title | Sampling from convex sets with a cold start using multiscale decompositions |
| title_full | Sampling from convex sets with a cold start using multiscale decompositions |
| title_fullStr | Sampling from convex sets with a cold start using multiscale decompositions |
| title_full_unstemmed | Sampling from convex sets with a cold start using multiscale decompositions |
| title_short | Sampling from convex sets with a cold start using multiscale decompositions |
| title_sort | sampling from convex sets with a cold start using multiscale decompositions |
| url | https://hdl.handle.net/1721.1/157860 |
| work_keys_str_mv | AT narayananhariharan samplingfromconvexsetswithacoldstartusingmultiscaledecompositions AT rajaramanamit samplingfromconvexsetswithacoldstartusingmultiscaledecompositions AT srivastavapiyush samplingfromconvexsetswithacoldstartusingmultiscaledecompositions |