We propose a scheme for efficient optical frequency conversion at the single-photon power level. The scheme exploits the quantum interference of single-photon states at a three-level quantum emitter coupled to a Sagnac interferometer. We show that this device can achieve single-photon frequency up- or down-conversion with near unity efficiency.