Consistency of Gaussian process regression in metric spaces
Gaussian process (GP) regressors are used in a wide variety of regression tasks, and many recent applications feature domains that are non-Euclidean manifolds or other metric spaces. In this paper, we examine formal consistency of GP regression on general metric spaces. Specifically, we consider a G...
| Main Authors: | , |
|---|---|
| Format: | Journal article |
| Language: | English |
| Published: |
Journal of Machine Learning Research
2021
|
| _version_ | 1797112802679193600 |
|---|---|
| author | Koepernik, P Pfaff, F |
| author_facet | Koepernik, P Pfaff, F |
| author_sort | Koepernik, P |
| collection | OXFORD |
| description | Gaussian process (GP) regressors are used in a wide variety of regression tasks, and many recent applications feature domains that are non-Euclidean manifolds or other metric spaces. In this paper, we examine formal consistency of GP regression on general metric spaces. Specifically, we consider a GP prior on an unknown real-valued function with a metric domain space and examine consistency of the resulting posterior distribution. If the kernel is continuous and the sequence of sampling points lies sufficiently dense, then the variance of the posterior GP is shown to converge to zero almost surely monotonically and in Lp
for all p>1
, uniformly on compact sets. Moreover, we prove that if the difference between the observed function and the mean function of the prior lies in the reproducing kernel Hilbert space of the prior's kernel, then the posterior mean converges pointwise in L2
to the unknown function, and, under an additional assumption on the kernel, uniformly on compacts in L1
. This paper provides an important step towards the theoretical legitimization of GP regression on manifolds and other non-Euclidean metric spaces. |
| first_indexed | 2024-03-07T08:29:02Z |
| format | Journal article |
| id | oxford-uuid:534f7216-e07e-49f5-8966-a537fbef7141 |
| institution | University of Oxford |
| language | English |
| last_indexed | 2024-03-07T08:29:02Z |
| publishDate | 2021 |
| publisher | Journal of Machine Learning Research |
| record_format | dspace |
| spelling | oxford-uuid:534f7216-e07e-49f5-8966-a537fbef71412024-03-06T10:05:02ZConsistency of Gaussian process regression in metric spacesJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:534f7216-e07e-49f5-8966-a537fbef7141EnglishSymplectic ElementsJournal of Machine Learning Research2021Koepernik, PPfaff, FGaussian process (GP) regressors are used in a wide variety of regression tasks, and many recent applications feature domains that are non-Euclidean manifolds or other metric spaces. In this paper, we examine formal consistency of GP regression on general metric spaces. Specifically, we consider a GP prior on an unknown real-valued function with a metric domain space and examine consistency of the resulting posterior distribution. If the kernel is continuous and the sequence of sampling points lies sufficiently dense, then the variance of the posterior GP is shown to converge to zero almost surely monotonically and in Lp for all p>1 , uniformly on compact sets. Moreover, we prove that if the difference between the observed function and the mean function of the prior lies in the reproducing kernel Hilbert space of the prior's kernel, then the posterior mean converges pointwise in L2 to the unknown function, and, under an additional assumption on the kernel, uniformly on compacts in L1 . This paper provides an important step towards the theoretical legitimization of GP regression on manifolds and other non-Euclidean metric spaces. |
| spellingShingle | Koepernik, P Pfaff, F Consistency of Gaussian process regression in metric spaces |
| title | Consistency of Gaussian process regression in metric spaces |
| title_full | Consistency of Gaussian process regression in metric spaces |
| title_fullStr | Consistency of Gaussian process regression in metric spaces |
| title_full_unstemmed | Consistency of Gaussian process regression in metric spaces |
| title_short | Consistency of Gaussian process regression in metric spaces |
| title_sort | consistency of gaussian process regression in metric spaces |
| work_keys_str_mv | AT koepernikp consistencyofgaussianprocessregressioninmetricspaces AT pfafff consistencyofgaussianprocessregressioninmetricspaces |