We theoretically study the conditions under which two laser fields can undergo Coherent Perfect Absorption (CPA) when shined on a single-mode bi-directional optical cavity coupled with two two-level quantum emitters (natural atoms, artificial atoms, quantum dots, qubits, etc.). In addition to being indirectly coupled through the cavity-mediated field, in our Tavis-Cummings model, the two quantum emitters (QEs) are allowed to interact directly via the dipole-dipole interaction (DDI). Under the mean-field approximation and low-excitation assumption, in this work, we particularly focus on the impact of DDI on the existence of CPA in the presence of decoherence mechanisms (spontaneous emission from the QEs and the leakage of photons from the cavity walls). We also present a dressed-state analysis of the problem to discuss the underlying physics related to the allowed polariton state transitions in the Jaynes-Tavis-Cummings ladder. As a key result, we find that in the strong-coupling regime of cavity quantum electrodynamics, the strong DDI and the emitter-cavity detuning can act together to achieve the CPA at two laser frequencies tunable by the inter-atomic separation which are not possible to attain with a single QE in the presence of detuning. Our CPA results are potentially applicable in building quantum memories that are an essential component in long-distance quantum networking.