Jaynes-Gibbs Entropic Convex Duals and Orthogonal Polynomials

Entropy (Basel). 2022 May 16;24(5):709. doi: 10.3390/e24050709.

Abstract

The univariate noncentral distributions can be derived by multiplying their central distributions with translation factors. When constructed in terms of translated uniform distributions on unit radius hyperspheres, these translation factors become generating functions for classical families of orthogonal polynomials. The ultraspherical noncentral t, normal N, F, and χ2 distributions are thus found to be associated with the Gegenbauer, Hermite, Jacobi, and Laguerre polynomial families, respectively, with the corresponding central distributions standing for the polynomial family-defining weights. Obtained through an unconstrained minimization of the Gibbs potential, Jaynes' maximal entropy priors are formally expressed in terms of the empirical densities' entropic convex duals. Expanding these duals on orthogonal polynomial bases allows for the expedient determination of the Jaynes-Gibbs priors. Invoking the moment problem and the duality principle, modelization can be reduced to the direct determination of the prior moments in parametric space in terms of the Bayes factor's orthogonal polynomial expansion coefficients in random variable space. Genomics and geophysics examples are provided.

Keywords: Bayesian inference; Gibbs prior; Jaynes’ maximal entropy principle; entropic convex dual; noncentral distributions; orthogonal polynomials.

Grants and funding

This research received no external funding.