Mobility properties of spatially localized structures arising from chaotic but deterministic forcing of the bistable Swift-Hohenberg equation are studied and compared with the corresponding results when the chaotic forcing is replaced by white noise. Short structures are shown to possess greater mobility, resulting in larger root-mean-square speeds but shorter displacements than longer structures. Averaged over realizations, the displacement of the structure is ballistic at short times but diffusive at larger times. Similar results hold in two spatial dimensions. The effects of chaotic forcing on the stability of these structures is also quantified. Shorter structures are found to be more fragile than longer ones, and their stability region can be displaced outside the pinning region for constant forcing. Outside the stability region the deterministic fluctuations lead either to the destruction of the structure or to its gradual growth.