Manipulating the polarization of an incident beam using two-dimensional materials has become an important research direction towards the development of nano-optical devices. Black phosphorus (BP) and rhenium diselenide (ReSe2) possess excellent in-plane optical anisotropy with optical birefringence in the visible region, which has led to novel applications in polarizing optics and optoelectronics. Herein, the polarization-dependent absorption of BP and ReSe2 and a modulated pump beam is utilized to obtain the photothermal signal from them. The photothermal anisotropy of BP and ReSe2 has been explored using photothermal detection. Then we have defined the photothermal contrast using the ratio of the maximum to the minimum of the photothermal signal. The photothermal contrast of BP and ReSe2 can be obtained accurately by the relationship between the polarization angle of the pump light and the photothermal signal. We demonstrate that a layered BP with different thicknesses can remarkably change the photothermal contrast. In contrast, the photothermal contrast of ReSe2 does not change with the different thicknesses of the samples. Further, the photothermal anisotropies of BP/ReSe2 heterostructures were also explored. The photothermal contrasts of samples were observed to change with different stacking angles indicating that the photothermal anisotropy of heterostructures is dependent on the stacking angle. Our findings provide new prospects for designing novel optical devices based on two-dimensional anisotropic materials, with potential applications in electronics, photonics, and optoelectronics.