We study a single-photon band structure in a one-dimensional coupled-resonator optical waveguide that chirally couples to an array of two-level quantum emitters (QEs). The chiral interaction between the resonator mode and the QE can break the time-reversal symmetry without the magneto-optical effect and an external or synthetic magnetic field. As a result, nonreciprocal single-photon edge states, band gaps, and flat bands appear. By using such a chiral QE coupled-resonator optical waveguide system, including a finite number of unit cells and working in the nonreciprocal band gap, we achieve frequency-multiplexed single-photon circulators with high fidelity and low insertion loss. The chiral QE-light interaction can also protect one-way propagation of single photons against backscattering. Our work opens a new door for studying unconventional photonic band structures without electronic counterparts in condensed matter and exploring its applications in the quantum regime.