Previous research into autism spectrum disorder (ASD) has shown people with autism to be impaired at visual perspective taking. However it is still unclear to what extent the spatial mechanisms underlying this ability contribute to these difficulties. In the current experiment we examine spatial transformations in adults with ASD and typical adults. Participants performed egocentric transformations and mental rotation of bodies and cars. Results indicated that participants with ASD had general perceptual differences impacting on response times across tasks. However, they also showed more specific differences in the egocentric task suggesting particular difficulty with using the self as a reference frame. These findings suggest that impaired perspective taking could be grounded in difficulty with the spatial transformation used to imagine the self in someone else’s place.