Conditional mean embedding and optimal feature selection via positive definite kernels

Motivated by applications, we consider new operator-theoretic approaches to conditional mean embedding (CME). Our present results combine a spectral analysis-based optimization scheme with the use of kernels, stochastic processes, and constructive learning algorithms. For initially given non-linear...

Full description

Bibliographic Details
Main Authors: Palle E.T. Jorgensen, Myung-Sin Song, James Tian
Format: Article
Language:English
Published: AGH Univeristy of Science and Technology Press 2023-10-01
Series:Opuscula Mathematica
Subjects:
Online Access:https://www.opuscula.agh.edu.pl/vol44/1/art/opuscula_math_4405.pdf
Description
Summary:Motivated by applications, we consider new operator-theoretic approaches to conditional mean embedding (CME). Our present results combine a spectral analysis-based optimization scheme with the use of kernels, stochastic processes, and constructive learning algorithms. For initially given non-linear data, we consider optimization-based feature selections. This entails the use of convex sets of kernels in a construction o foptimal feature selection via regression algorithms from learning models. Thus, with initial inputs of training data (for a suitable learning algorithm), each choice of a kernel \(K\) in turn yields a variety of Hilbert spaces and realizations of features. A novel aspect of our work is the inclusion of a secondary optimization process over a specified convex set of positive definite kernels, resulting in the determination of "optimal" feature representations.
ISSN:1232-9274