In single-pixel imaging (SPI), a large number of illuminations is usually required to capture one single image. Consequently, SPI may only achieve a very low frame rate for a fast-moving object and the reconstructed images are contaminated with blur and noise. In previous works, some attempts are made to perform motion estimation between neighboring frames in a SPI video to enhance the image quality. However, the motion estimation and quality enhancement from one single image frame in dynamic SPI was seldom investigated. In this work, it assumed that some prior knowledge about the type of motion the object undergoes is known. A motion model of the target object is constructed and the motion parameters can be optimized within a search space. Our proposed scheme is different from common motion deblur techniques for photographs since the motion blur mechanism in SPI is significantly different from a conventional camera. Experimental results demonstrate that the reconstructed images with our proposed scheme in dynamic SPI have much better quality.