We measure photoelectron angular distributions of noble gases in intense elliptically polarized laser fields, which indicate strong structure-dependent Coulomb asymmetry. Using a dedicated semiclassical model, we have disentangled the contribution of direct ionization and multiple forward scattering on Coulomb asymmetry in elliptical laser fields. Our theory quantifies the roles of the ionic potential and initial transverse momentum on Coulomb asymmetry, proving that the small lobes of asymmetry are induced by direct ionization and the strong asymmetry is induced by multiple forward scattering in the ionic potential. Both processes are distorted by the Coulomb force acting on the electrons after tunneling. Lowering the ionization potential, the relative contribution of direct ionization on Coulomb asymmetry substantially decreases and Coulomb focusing on multiple rescattering is more important. We do not observe evident initial longitudinal momentum spread at the tunnel exit according to our simulation.