We report on the first study of the dynamic transverse forces imparted to an ultrarelativistic positron beam by a long plasma in the underdense regime. Focusing of the 28.5 GeV beam is observed from time-resolved beam profiles after the 1.4 m plasma. The strength of the imparted force varies along the approximately 12 ps full length of the bunch as well as with plasma density. Computer simulations substantiate the longitudinal aberration seen in the data and reveal mechanisms for emittance degradation.