We examine the visual influence of stabilization in human sensorimotor control using a simulated inverted pendulum. As the inverted pendulum is fully simulated, we are able to manipulate the visual feedback independently from the dynamics during the motor control task. Human subjects performed a balancing task of an upright pendulum on a robotic manipulandum in two different visual feedback conditions. First we examined how subjects perform a task where the visual feedback is congruent with the pendulum dynamics. Second we tested how subjects performed when the physical dynamics were fixed but the visual feedback of the pendulum length was modulated. Subjects exhibited deficits in the control of the pendulum when haptic and visual feedback did not match, even when the visual feedback provided more sensitive information about the state of the pendulum. Overall we demonstrate the importance of accurate feedback regarding task dynamics for stabilization.