Non-Linear Canonical Correlation Analysis Using Alpha-Beta Divergence

We propose a generalized method of the canonical correlation analysis using Alpha-Beta divergence, called AB-canonical analysis (ABCA). From observations of two random variables, x ∈ RP and y ∈ RQ, ABCA finds directions, wx ∈ RP and wy ∈ RQ, such that the AB-divergence between the joint distribution...

Full description

Bibliographic Details
Main Authors: Andrzej Cichocki, Abhijit Mandal
Format: Article
Language:English
Published: MDPI AG 2013-07-01
Series:Entropy
Subjects:
Online Access:http://www.mdpi.com/1099-4300/15/7/2788
Description
Summary:We propose a generalized method of the canonical correlation analysis using Alpha-Beta divergence, called AB-canonical analysis (ABCA). From observations of two random variables, x ∈ RP and y ∈ RQ, ABCA finds directions, wx ∈ RP and wy ∈ RQ, such that the AB-divergence between the joint distribution of (wT x, wT y) and the product x y of their marginal distributions is maximized. The number of significant non-zero canonical coefficients are determined by using a sequential permutation test. The advantage of our method over the standard canonical correlation analysis (CCA) is that it can reconstruct the hidden non-linear relationship between wT xx and wT y, and it is robust against outliers. We extend ABCA when data are observed in terms of tensors. We further generalize this method by imposing sparseness constraints. Extensive simulation study is performed to justify our approach.
ISSN:1099-4300