In the laser driven inertial confinement fusion (ICF) experimental target chamber, like the 3ω (351 nm) laser irradiation, the irradiation of gamma ray and X-rays, will also cause the formation and increase of various defects in the investigated series of fluoride-containing phosphate based glasses that have potential use in novel high performance color separation optics. The induced defects contribute to the increase of absorption in the UV region, which will make the UV performance of these laser glasses deteriorated. Some of the induced defects can be bleached to some extent through the subsequent thermal treatment process, resulting from the release and capture of the electrons in conduction band. Through the gamma radiation and post-heat treatment experiments, a general model of the evolutionary mechanism of the defects in these fluoride-containing phosphate based glasses was proposed.