When a metamaterial (MM) is embedded in a one-dimensional photonic crystal (PC) cavity, the ultra-strong coupling between the MM plasmons and the photons in the PC cavity gives rise to two new polariton modes with high quality factor. Here, we investigate by simulations whether such a strongly coupled system working in the terahertz (THz) frequency range has the potential to be a better sensor than a MM (or a PC cavity) alone. Somewhat surprisingly, one finds that the shift of the resonance frequency induced by an analyte applied to the MM is smaller in the case of the dual resonator (MM and cavity) than that obtained with the MM alone. However, the phase sensitivity of the dual resonator can be larger than that of the MM alone. With the dielectric perturbation theory - well established in the microwave community - one can show that the size of the mode volume plays a decisive role for the obtainable frequency shift. The larger frequency shift of the MM alone is explained by its smaller mode volume as compared with the MM-loaded cavity. Two main conclusions can be drawn from our investigations. First, that the dielectric perturbation theory can be used to guide and optimize the designs of MM-based sensors. And second, that the enhanced phase sensitivity of the dual resonator may open a new route for the realization of improved THz sensors.