The anomalous Hall effect (AHE) is highly sensitive to disorder in the metallic phase. Here we show that statistical correlations between the charge-spin disorder sectors strongly affect the conductivity and the sign or magnitude of AHE. As the correlation between the charge and gauge-mass components increases, so does the AHE, achieving its universal value, and even exceeding it, although the system is an impure metal. The AHE can change sign when the anticorrelations reverse the sign of the effective Dirac mass, a possible mechanism behind the sign change seen in recent experiments.