A new type of a linear response Hall effect is predicted in time-reversal-invariant systems with a built-in electric field at zero magnetic field. The Hall response results from a quantum Magnus effect where a self-rotating Bloch electron wave packet moving under an electric field develops an anomalous velocity in the transverse direction. We show that in the ballistic limit the Magnus Hall conductance measures the distribution of the Berry curvature on the Fermi surface.