Zipf-Mandelbrot law, f-divergences and the Jensen-type interpolating inequalities

J Inequal Appl. 2018;2018(1):36. doi: 10.1186/s13660-018-1625-y. Epub 2018 Feb 8.

Abstract

Motivated by the method of interpolating inequalities that makes use of the improved Jensen-type inequalities, in this paper we integrate this approach with the well known Zipf-Mandelbrot law applied to various types of f-divergences and distances, such are Kullback-Leibler divergence, Hellinger distance, Bhattacharyya distance (via coefficient), [Formula: see text]-divergence, total variation distance and triangular discrimination. Addressing these applications, we firstly deduce general results of the type for the Csiszár divergence functional from which the listed divergences originate. When presenting the analyzed inequalities for the Zipf-Mandelbrot law, we accentuate its special form, the Zipf law with its specific role in linguistics. We introduce this aspect through the Zipfian word distribution associated to the English and Russian languages, using the obtained bounds for the Kullback-Leibler divergence.

Keywords: Csiszár divergence functional; Jensen inequality; Kullback–Leibler divergence; Zipf and Zipf–Mandelbrot law; f-divergences.