The interplay between interference and absorption leads to interesting phenomena like coherent perfect absorption and coherent perfect transparency (CPA and CPT), which can be exploited for fully optical modulation. While it is known that it is possible to harness CPA and CPT for switching a strong signal beam with a weak control beam, it is not immediate that this process suffers from a fundamental compromise between the device efficiency (quantified by device loss and modulation depth) and the asymmetry between signal and control intensity desired for operation. This article quantifies this compromise and outlines a possible way to overcome it by means of a combination of optical gain and loss in the same photonic component. A general formulation and a specific device realization are both discussed.