Speckle reduction is a crucial technique, since the presence of speckle disturbs the quality of the reconstruction in digital holography. In this paper, we present a redundant speckle elimination method to suppress the speckle noise. For the same position in each of the reconstructed sub-images, we consider pixels with the same gray value as information with the same speckle distribution. Therefore, a speckle-suppressed gray value can be obtained by extracting pixels with different gray values and then averaging. Through theoretical analysis and experiments, we demonstrate that speckle contrast can be decreased significantly by using the proposed method. Moreover, we show that the despeckle strength of the proposed method highly depends on the number of binary masks. These results indicate the potential of the proposed method for various applications.