ϕ-Informational Measures: Some Results and Interrelations

Entropy (Basel). 2021 Jul 18;23(7):911. doi: 10.3390/e23070911.

Abstract

In this paper, we focus on extended informational measures based on a convex function ϕ: entropies, extended Fisher information, and generalized moments. Both the generalization of the Fisher information and the moments rely on the definition of an escort distribution linked to the (entropic) functional ϕ. We revisit the usual maximum entropy principle-more precisely its inverse problem, starting from the distribution and constraints, which leads to the introduction of state-dependent ϕ-entropies. Then, we examine interrelations between the extended informational measures and generalize relationships such the Cramér-Rao inequality and the de Bruijn identity in this broader context. In this particular framework, the maximum entropy distributions play a central role. Of course, all the results derived in the paper include the usual ones as special cases.

Keywords: (inverse) maximum ϕ-entropy problem; generalized Cramér–Rao inequality; generalized de Bruijn; state-dependent ϕ-entropy; ϕ-Fisher information; ϕ-entropy; ϕ-escort distributions; ϕ-heat equation; ϕ-moments.