We study the optical spin noise spectra of Rb atomic gas with different broadening mechanisms. The first is homogeneous broadening using 250 Torr nitrogen buffer gas, while the other mechanism is inhomogeneous broadening via the Doppler effect without buffer gas. Spin noise signals are measured by the typical spin noise spectroscopy geometry (single-pass geometry) and the saturated absorption spectroscopy geometry (double-pass geometry). In the homogeneously broadened system, the line shape of the optical spin noise spectra shows a pronounced dip that vanishes at the center of the band in both geometries. In the inhomogeneously broadened system, however, a peak in the single-pass geometry and a dip in the double-pass geometry at the band center are observed. The difference between the optical spin noise spectra from these two systems arises from their different level-broadening mechanisms.