We have used an external cavity self-injection feedback locking (SIFL) system to simultaneously reduce the optical linewidth of over 39 individual wavelength channels of an InAs/InP quantum dot (QD) coherent comb laser (CCL). Linewidth reduction from a few MHz to less than 200 kHz is observed. Measured phase noise spectra clearly indicate a significant decrease in phase noise in the frequency range above 2 kHz. The RF beating signal between two adjacent channels also shows a substantial reduction in 3-dB linewidth from 10 kHz to 300 Hz with the SIFL system, and a corresponding drop in baseline level (-27 dB to -50 dB).