A simple and practical apparatus enabling repetition rate (frep) noise, carrier-envelope frequency (fceo) noise and nth optical comb mode (νn) noise spectra measurements with high precision is established. The frep and νn noise spectra are measured by a fiber delay line interferometer, while fceo noise spectrum is measured by an f-2f interferometer. We utilize this apparatus to characterize the noise performance of an Er-fiber optical frequency comb (OFC) and analyze the origin of dominant noise sources. Moreover, this apparatus provides a powerful tool for diagnosing noise dynamics intrinsic in mode-locked lasers and OFCs. To this end, we uncover the anti-correlation between frep and fceo noise as well as the impact of servo loops on noise characteristics in the stabilized OFC.