Improving the precision of current tests of the equivalence principle with a rotating torsion pendulum requires a more complete analysis of systematic effects. Here, we discuss in detail one of the important systematic effects, the influence from the tilt error motion of the rotation axis of a rotary stage, namely, wandering of the instantaneous rotation axis around its average direction. Its influence on the rotating torsion pendulum is modeled phenomenologically, and the parameters in the model are calibrated. It is shown that the influence can contribute a correction of η ≈ 5 × 10-13 to the equivalence-principle violating parameter for a rotary stage whose tilt error motion of interest is about 31 nrad in magnitude. We also show that such an influence can be reduced to the level of η ≈ 1 × 10-14 by means of active compensation of the tilt error motion using a set of piezoelectric actuators placed under the stage stator.