A new optical configuration of incoherent digital holography is presented to improve the quality of reconstructed images when the random polarization state of incoherent light is used. The proposed system improves the signal-to-noise ratio of the holograms by suppressing the unmodulated terms of a spatial light modulator. To generate the self-interference of a quasi-incoherent point-like source, we use a dual-focusing lens with diffraction gratings. The preliminary experimental results confirm the validity of the proposed method by reconstructing two point-like sources generated by a LED light source. When the pixel pitch of the phase-mode SLM is small enough, the off-axis hologram can be generated. The single-shot recording of the incoherent digital holography is expected.