Polarization-selective diffractive in-line and off-axis lenses are recorded in azopolymer thin films using polarization holography. A simple, yet efficient, and to the best of our knowledge, new method is used to suppress the surface relief grating formation and to improve the polarization properties of the lenses. The in-line lenses are converging for right circularly polarized (RCP) light and diverging for left circularly polarized (LCP) light. Bifocal off-axis lenses are recorded by polarization multiplexing. By rotating the sample at 90° between the exposures, the two focal points of these lenses are located in orthogonal directions O x and O y, so we can refer to these novel lenses as 2D bifocal polarization holographic lenses. The light intensity in their focuses depends on the reconstructing light polarization. According to the recording scheme, they can either reach maximum intensities simultaneously (for LCP or RCP), or alternatively, one of them can be at maximum for LCP, while the other for RCP. These lenses may be used as polarization controllable optical switches, in the field of self-interference incoherent digital holography or for other photonics applications.