Optical damage experiments were carried out in a series of Holmium doped congruent lithium niobate (Ho:cLN) crystals as a function of dopant concentration and laser intensity. The light induced beam distortion was recorded with a camera and a detector under the pseudo-Z-scan configuration. At 532 nm, strong suppression of the optical damage was observed for the 0.94 mol. % doped crystal. Increased resistance to optical damage was also observed at 488 nm. The suppression of the optical damage is predominantly attributed to the reduction of the Nb antisites due to the holmium doping.