Ion irradiation is a widely employed tool to fabricate diamond micro- and nano-structures for applications in integrated photonics and quantum optics. In this context, it is essential to accurately assess the effect of ion-induced damage on the variation of the refractive index of the material, both to control the side effects in the fabrication process and possibly finely tune such variations. Several partially contradictory accounts have been provided on the effect of the ion irradiation on the refractive index of single crystal diamond. These discrepancies may be attributable to the fact that in all cases the ions are implanted in the bulk of the material, thus inducing a series of concurrent effects (volume expansion, stress, doping, etc.). Here we report the systematic characterization of the refractive index variations occurring in a 38 µm thin artificial diamond sample upon irradiation with high-energy (3 MeV and 5 MeV) protons. In this configuration the ions are fully transmitted through the sample, while inducing an almost uniform damage profile with depth. Therefore, our findings conclusively identify and accurately quantify the change in the material polarizability as a function of ion beam damage as the primary cause for the modification of its refractive index.