The application of digital holography in several fields is limited since speckle destroys the original information of the reconstructed image. This paper proposes a neighborhood filter based on multiple sub-reconstructed images according to the random distribution of speckle noise. In this method, the denoised value is equal to the weighted sum of neighboring pixel values, and the weight is calculated by the degree of correlation between different positions of multiple sub-holograms. The experimental results show that the method can greatly reduce the speckle noise, and its noise reduction performance is superior to traditional digital image processing algorithms.