When Shannon and Khinchin meet Shore and Johnson: Equivalence of information theory and statistical inference axiomatics

Phys Rev E. 2020 Apr;101(4-1):042126. doi: 10.1103/PhysRevE.101.042126.

Abstract

We propose a unified framework for both Shannon-Khinchin and Shore-Johnson axiomatic systems. We do it by rephrasing Shannon-Khinchine axioms in terms of generalized arithmetics of Kolmogorov and Nagumo. We prove that the two axiomatic schemes yield identical classes of entropic functionals-the Uffink class of entropies. This allows to re-establish the entropic parallelism between information theory and statistical inference that has seemed to be "broken" by the use of non-Shannonian entropies.