Two holographic diffraction gratings with very similar parameters, designed for maximum performance inTM polarization, are investigated, their diffraction efficiency measured, an electron microscopic picture of their surface observed, and numerical simulation of light diffraction done with the surface roughness taken into account. It is demonstrated numerically that a small-scale roughness imposed on the grating surface could increase significantly both scattering and absorption from the surface, this influence being greater in the TM case. A very good coincidence between the numerical and experimental data is obtained in TE polarization, whereas in TM polarization only a qualitative agreement exists.