Maximum likelihood estimation of a multidimensional log-concave density
Let X_1, ..., X_n be independent and identically distributed random vectors with a log-concave (Lebesgue) density f. We first prove that, with probability one, there exists a unique maximum likelihood estimator of f. The use of this estimator is attractive because, unlike kernel density estimation,...
| Main Authors: | , , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Blackwell Publishing Ltd
2008
|
| _version_ | 1797074170759086080 |
|---|---|
| author | Cule, M Samworth, R Stewart, M |
| author_facet | Cule, M Samworth, R Stewart, M |
| author_sort | Cule, M |
| collection | OXFORD |
| description | Let X_1, ..., X_n be independent and identically distributed random vectors with a log-concave (Lebesgue) density f. We first prove that, with probability one, there exists a unique maximum likelihood estimator of f. The use of this estimator is attractive because, unlike kernel density estimation, the method is fully automatic, with no smoothing parameters to choose. Although the existence proof is non-constructive, we are able to reformulate the issue of computation in terms of a non-differentiable convex optimisation problem, and thus combine techniques of computational geometry with Shor's r-algorithm to produce a sequence that converges to the maximum likelihood estimate. For the moderate or large sample sizes in our simulations, the maximum likelihood estimator is shown to provide an improvement in performance compared with kernel-based methods, even when we allow the use of a theoretical, optimal fixed bandwidth for the kernel estimator that would not be available in practice. We also present a real data clustering example, which shows that our methodology can be used in conjunction with the Expectation--Maximisation (EM) algorithm to fit finite mixtures of log-concave densities. An R version of the algorithm is available in the package LogConcDEAD -- Log-Concave Density Estimation in Arbitrary Dimensions. |
| first_indexed | 2024-03-06T23:32:30Z |
| format | Journal article |
| id | oxford-uuid:6c893860-98a2-4b10-ad5d-bd3cea3d4427 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-06T23:32:30Z |
| publishDate | 2008 |
| publisher | Blackwell Publishing Ltd |
| record_format | dspace |
| spelling | oxford-uuid:6c893860-98a2-4b10-ad5d-bd3cea3d44272022-03-26T19:11:28ZMaximum likelihood estimation of a multidimensional log-concave densityJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:6c893860-98a2-4b10-ad5d-bd3cea3d4427EnglishSymplectic Elements at OxfordBlackwell Publishing Ltd2008Cule, MSamworth, RStewart, MLet X_1, ..., X_n be independent and identically distributed random vectors with a log-concave (Lebesgue) density f. We first prove that, with probability one, there exists a unique maximum likelihood estimator of f. The use of this estimator is attractive because, unlike kernel density estimation, the method is fully automatic, with no smoothing parameters to choose. Although the existence proof is non-constructive, we are able to reformulate the issue of computation in terms of a non-differentiable convex optimisation problem, and thus combine techniques of computational geometry with Shor's r-algorithm to produce a sequence that converges to the maximum likelihood estimate. For the moderate or large sample sizes in our simulations, the maximum likelihood estimator is shown to provide an improvement in performance compared with kernel-based methods, even when we allow the use of a theoretical, optimal fixed bandwidth for the kernel estimator that would not be available in practice. We also present a real data clustering example, which shows that our methodology can be used in conjunction with the Expectation--Maximisation (EM) algorithm to fit finite mixtures of log-concave densities. An R version of the algorithm is available in the package LogConcDEAD -- Log-Concave Density Estimation in Arbitrary Dimensions. |
| spellingShingle | Cule, M Samworth, R Stewart, M Maximum likelihood estimation of a multidimensional log-concave density |
| title | Maximum likelihood estimation of a multidimensional log-concave density |
| title_full | Maximum likelihood estimation of a multidimensional log-concave density |
| title_fullStr | Maximum likelihood estimation of a multidimensional log-concave density |
| title_full_unstemmed | Maximum likelihood estimation of a multidimensional log-concave density |
| title_short | Maximum likelihood estimation of a multidimensional log-concave density |
| title_sort | maximum likelihood estimation of a multidimensional log concave density |
| work_keys_str_mv | AT culem maximumlikelihoodestimationofamultidimensionallogconcavedensity AT samworthr maximumlikelihoodestimationofamultidimensionallogconcavedensity AT stewartm maximumlikelihoodestimationofamultidimensionallogconcavedensity |