We propose the polarization difference ghost imaging method and experimentally demonstrate that polarization properties can provide additional information in conventional ghost imaging for object discrimination with contrast enhancement. In our experiment, two kinds of visually similar objects with different polarization properties can be separated for imaging. Meanwhile, an improved polarization difference algorithm is presented, fully utilizing the polarization discrepancy between objects and background, to further enhance the image contrast. Our work facilitates practical applications of ghost imaging.