Monolayer direct-band gap transition metal dichalcogenides (TMDCs) have been extensively investigated in the context of light-matter interactions. To reach strong coupling, these studies make use of external optical cavities supporting well-defined resonant modes. However, use of an external cavity might limit the scope of possible applications of such systems. Here, we demonstrate that thin films of TMDCs can themselves serve as high-quality-factor cavities due to the guided optical modes they sustain in the visible and near-infrared ranges. Making use of the prism coupling, we achieve the strong coupling between excitons and guided-mode resonances lying below the light line, and show that the thickness of TMDC membranes can be used to tune and promote photon-exciton interactions within the strong-coupling regime. Additionally, we demonstrate narrowband perfect absorption in thin TMDC films through critical coupling with guided-mode resonances. Our work not only provides a simple and intuitive picture to tame interaction of light and matter in thin TMDC films, but also suggests that these simple systems are a promising platform for realizing polaritonic and optoelectronic devices.