An Approach to Canonical Correlation Analysis Based on Rényi's Pseudodistances

Entropy (Basel). 2023 Apr 25;25(5):713. doi: 10.3390/e25050713.

Abstract

Canonical Correlation Analysis (CCA) infers a pairwise linear relationship between two groups of random variables, X and Y. In this paper, we present a new procedure based on Rényi's pseudodistances (RP) aiming to detect linear and non-linear relationships between the two groups. RP canonical analysis (RPCCA) finds canonical coefficient vectors, a and b, by maximizing an RP-based measure. This new family includes the Information Canonical Correlation Analysis (ICCA) as a particular case and extends the method for distances inherently robust against outliers. We provide estimating techniques for RPCCA and show the consistency of the proposed estimated canonical vectors. Further, a permutation test for determining the number of significant pairs of canonical variables is described. The robustness properties of the RPCCA are examined theoretically and empirically through a simulation study, concluding that the RPCCA presents a competitive alternative to ICCA with an added advantage in terms of robustness against outliers and data contamination.

Keywords: Information Canonical Correlation Analysis; Kullback–Leibler divergence; Renyi’s pseudodistances; consistency; mutual information; robustness.