Reduced graphene oxides with varying degrees of reduction have been produced by hydrazine reduction of graphene oxide. The linear and nonlinear optical properties of both graphene oxide as well as the reduced graphene oxides have been measured by single beam Z-scan measurement in the picosecond region. The results reveal both saturable absorption and two-photon absorption, strongly dependent on the intensity of the pump pulse: saturable absorption occurs at lower pump pulse intensity (~1.5 GW/cm2 saturation intensity) whereas two-photon absorption dominates at higher intensities (≥5.7 GW/cm2). Intriguingly, we find that the two-photon absorption coefficient (from 1.5 cm/GW to 4.5cm/GW) and the saturation intensity (from 1 GW/cm2 to 2 GW/cm2) vary with chemical reduction, which is ascribed to the varying concentrations of sp2 domains and sp2 clusters in the reduced graphene oxides. Our results not only provide an insight into the evolution of the nonlinear optical coefficient in reduced graphene oxide, but also suggest that chemical engineering techniques may usefully be applied to tune the nonlinear optical properties of various nano-materials, including atomically thick graphene sheets.