This investigation studies the various magnetic behaviors of graphene oxide (GO) and reduced graphene oxides (rGOs) and elucidates the relationship between the chemical states that involve defects therein and their magnetic behaviors in GO sheets. Magnetic hysteresis loop reveals that the GO is ferromagnetic whereas photo-thermal moderately reduced graphene oxide (M-rGO) and heavily reduced graphene oxide (H-rGO) gradually become paramagnetic behavior at room temperature. Scanning transmission X-ray microscopy and corresponding X-ray absorption near-edge structure spectroscopy were utilized to investigate thoroughly the variation of the C 2p(π*) states that are bound with oxygen-containing and hydroxyl groups, as well as the C 2p(σ*)-derived states in flat and wrinkle regions to clarify the relationship between the spatially-resolved chemical states and the magnetism of GO, M-rGO and H-rGO. The results of X-ray magnetic circular dichroism further support the finding that C 2p(σ*)-derived states are the main origin of the magnetism of GO. Based on experimental results and first-principles calculations, the variation in magnetic behavior from GO to M-rGO and to H-rGO is interpreted, and the origin of ferromagnetism is identified as the C 2p(σ*)-derived states that involve defects/vacancies rather than the C 2p(π*) states that are bound with oxygen-containing and hydroxyl groups on GO sheets.