We have clearly discriminated the single-, bilayer-, and multiple-layer graphene (<10 layers) on Si substrate with a 285 nm SiO2 capping layer by using contrast spectra, which were generated from the reflection light of a white light source. Calculations based on Fresnel's law are in excellent agreement with the experimental results (deviation 2%). The contrast image shows the reliability and efficiency of this new technique. The contrast spectrum is a fast, nondestructive, easy to be carried out, and unambiguous way to identify the numbers of layers of graphene sheet. We provide two easy-to-use methods to determine the number of graphene layers based on contrast spectra: a graphic method and an analytical method. We also show that the refractive index of graphene is different from that of graphite. The results are compared with those obtained using Raman spectroscopy.