In this work, we employ 87Rb atoms as rotation media to manipulate the polarization of optical fields in both magnetic and magnetic-free environments. Employing the nonlinear magneto-optical rotation mechanism, we achieve a state-of-the-art magneto-optical rotation coefficient of 1.74×108 rad⋅T-1⋅m-1 which is four orders of magnitude higher than commonly employed materials. Additionally, in a magnetic-free environment, we achieve all-optical cross-polarization modulation between the pump and probe light via Rb atoms. The nonlinear magneto-optical rotation configuration introduces inventive techniques for a new type of magneto-optical modulator while the all-optical configuration paves the way for exploring photonic integrated circuit (PIC) devices free from disruptions caused by electrical or magnetic crosstalk.