Frequency dispersion of high-k dielectrics was observed and classified into two parts: extrinsic cause and intrinsic cause. Frequency dependence of dielectric constant (dielectric relaxation), that is the intrinsic frequency dispersion, could not be characterized before considering the effects of extrinsic frequency dispersion. Several mathematical models were discussed to describe the dielectric relaxation of high-k dielectrics. For the physical mechanism, dielectric relaxation was found to be related to the degree of polarization, which depended on the structure of the high-k material. It was attributed to the enhancement of the correlations among polar nanodomain. The effect of grain size for the high-k materials' structure mainly originated from higher surface stress in smaller grain due to its higher concentration of grain boundary.