Information-Theoretic Aspects of Location Parameter Estimation under Skew-Normal Settings

Entropy (Basel). 2022 Mar 13;24(3):399. doi: 10.3390/e24030399.

Abstract

In several applications, the assumption of normality is often violated in data with some level of skewness, so skewness affects the mean's estimation. The class of skew-normal distributions is considered, given their flexibility for modeling data with asymmetry parameter. In this paper, we considered two location parameter (μ) estimation methods in the skew-normal setting, where the coefficient of variation and the skewness parameter are known. Specifically, the least square estimator (LSE) and the best unbiased estimator (BUE) for μ are considered. The properties for BUE (which dominates LSE) using classic theorems of information theory are explored, which provides a way to measure the uncertainty of location parameter estimations. Specifically, inequalities based on convexity property enable obtaining lower and upper bounds for differential entropy and Fisher information. Some simulations illustrate the behavior of differential entropy and Fisher information bounds.

Keywords: Cramér–Rao bound; Fisher information; convexity; differential entropy; location parameter; skewness; skew–normal distribution.

Grants and funding