Conditional Rényi Entropy and the Relationships between Rényi Capacities

Entropy (Basel). 2020 May 6;22(5):526. doi: 10.3390/e22050526.

Abstract

The analogues of Arimoto's definition of conditional Rényi entropy and Rényi mutual information are explored for abstract alphabets. These quantities, although dependent on the reference measure, have some useful properties similar to those known in the discrete setting. In addition to laying out some such basic properties and the relations to Rényi divergences, the relationships between the families of mutual informations defined by Sibson, Augustin-Csiszár, and Lapidoth-Pfister, as well as the corresponding capacities, are explored.

Keywords: Rényi capacity; Rényi mutual information; Sibson mutual information; conditional Rényi entropy.