Lateral optical forces in a direction perpendicular to light propagation have attracted increasing interest in recent years. Up to now, all lateral forces can be attributed to the symmetry breaking in the lateral directions caused by either the morphology of the scatterer geometry or the optical fields impinging on the scatterer. Here we demonstrate, both numerically and analytically, that when an isotropic scatterer breaks the electric-magnetic symmetry, a new type of anomalous lateral force can be induced along the direction of translational invariance where the illumination striking the scatterer has no propagation, field gradient, or spin density vortex (Belinfante's spin momentum). Our analytical results are rigorous for an arbitrary size scatterer, ensuring the universality of our conclusion. Furthermore, the electric-magnetic symmetry-breaking-induced lateral force is comparable in magnitude to other components of the optical force and reversible in direction for different polarizations of the illuminating light, rendering it capable of practical optical manipulation as well as enriching the understanding of light-matter interaction.