The Geometry of Generalized Likelihood Ratio Test

Entropy (Basel). 2022 Dec 6;24(12):1785. doi: 10.3390/e24121785.

Abstract

The generalized likelihood ratio test (GLRT) for composite hypothesis testing problems is studied from a geometric perspective. An information-geometrical interpretation of the GLRT is proposed based on the geometry of curved exponential families. Two geometric pictures of the GLRT are presented for the cases where unknown parameters are and are not the same under the null and alternative hypotheses, respectively. A demonstration of one-dimensional curved Gaussian distribution is introduced to elucidate the geometric realization of the GLRT. The asymptotic performance of the GLRT is discussed based on the proposed geometric representation of the GLRT. The study provides an alternative perspective for understanding the problems of statistical inference in the theoretical sense.

Keywords: composite hypothesis testing; generalized likelihood ratio test; information geometry; information loss; maximum likelihood estimation; statistical inference.