Bayes Posterior Convergence for Loss Functions via Almost Additive Thermodynamic Formalism

J Stat Phys. 2022;186(3):35. doi: 10.1007/s10955-022-02885-8. Epub 2022 Feb 3.

Abstract

Statistical inference can be seen as information processing involving input information and output information that updates belief about some unknown parameters. We consider the Bayesian framework for making inferences about dynamical systems from ergodic observations, where the Bayesian procedure is based on the Gibbs posterior inference, a decision process generalization of standard Bayesian inference (see [7, 37]) where the likelihood is replaced by the exponential of a loss function. In the case of direct observation and almost-additive loss functions, we prove an exponential convergence of the a posteriori measures to a limit measure. Our estimates on the Bayes posterior convergence for direct observation are related and extend those in [47] to a context where loss functions are almost-additive. Our approach makes use of non-additive thermodynamic formalism and large deviation properties [39, 40, 57] instead of joinings.

Keywords: Bayesian inference; Gibbs posterior convergence; Large deviations; Thermodynamic formalism.