Recent experiments of chemical reactions in optical cavities have shown great promise to alter and steer chemical reactions, but still remain poorly understood theoretically. In particular, the origin of resonant effects between the cavity and certain vibrational modes in the collective limit is still subject to active research. In this paper, we study the unimolecular dissociation reactions of many molecules, collectively interacting with an infrared cavity mode, through their vibrational dipole moment. We find that the reaction rate can slow down by increasing the number of aligned molecules, if the cavity mode is resonant with a vibrational mode of the molecules. We also discover a simple scaling relation that scales with the collective Rabi splitting, to estimate the onset of reaction rate modification by collective vibrational strong coupling and numerically demonstrate these effects for up to 104 molecules.