A Note on Causation versus Correlation in an Extreme Situation

Entropy (Basel). 2021 Mar 7;23(3):316. doi: 10.3390/e23030316.

Abstract

Recently, it has been shown that the information flow and causality between two time series can be inferred in a rigorous and quantitative sense, and, besides, the resulting causality can be normalized. A corollary that follows is, in the linear limit, causation implies correlation, while correlation does not imply causation. Now suppose there is an event A taking a harmonic form (sine/cosine), and it generates through some process another event B so that B always lags A by a phase of π/2. Here the causality is obviously seen, while by computation the correlation is, however, zero. This apparent contradiction is rooted in the fact that a harmonic system always leaves a single point on the Poincaré section; it does not add information. That is to say, though the absolute information flow from A to B is zero, i.e., TA→B=0, the total information increase of B is also zero, so the normalized TA→B, denoted as τA→B, takes the form of 00. By slightly perturbing the system with some noise, solving a stochastic differential equation, and letting the perturbation go to zero, it can be shown that τA→B approaches 100%, just as one would have expected.

Keywords: causality; correlation; information flow; time series.