Sampling the Boltzmann distribution using forces that violate detailed balance can be faster than with the equilibrium evolution, but the acceleration depends on the nature of the nonequilibrium drive and the physical situation. Here, we study the efficiency of forces transverse to energy gradients in dense liquids through a combination of techniques: Brownian dynamics simulations, exact infinite-dimensional calculation, and a mode-coupling approximation. We find that the sampling speedup varies nonmonotonically with temperature, and decreases as the system becomes more glassy. We characterize the interplay between the distance to equilibrium and the efficiency of transverse forces by means of odd transport coefficients.