Photonic crystal (PC) films have been widely applied in color displays and the anticounterfeiting field due to their facile fabrication process and easily tunable properties. However, the method for improving the reusability of the color-changed swollen PC films is still a challenge. In this paper, we report the color recovery behavior of epoxy resin inverse opal photonic crystal (EP-IOPC) films, which show different responses after being infiltrated with ethanol, acetone, and dimethyl sulfoxide (DMSO) based on the swelling and deswelling process. DMSO achieved the best effect on the color recovery of the swollen EP-IOPC films compared to ethanol and acetone, and the reflection spectrum blue-shifted in a small range and finally stabilized at a 60 nm deviation from the original spectrum after 10 times recovery. This strategy of color recovery not only solved the problem that the swollen EP-IOPC film's color changes to a certain extent but also showed promising potential in the color display and anticounterfeiting field.