Normal Laws for Two Entropy Estimators on Infinite Alphabets

Entropy (Basel). 2018 May 17;20(5):371. doi: 10.3390/e20050371.

Abstract

This paper offers sufficient conditions for the Miller-Madow estimator and the jackknife estimator of entropy to have respective asymptotic normalities on countably infinite alphabets.

Keywords: Miller–Madow estimator; asymptotic normality; entropy; jackknife estimator; nonparametric estimator.