We propose and demonstrate a polarization-sensitive dual-comb spectroscopy (DCS) technique that employs an electro-optic modulator for determining the anisotropic optical responses of materials. This straightforward extension of the typical DCS setup directly provides amplitudes and phases in two mutually orthogonal directions of the electric field of light. Using this method, we determined the optic axis direction and the anisotropy in the complex refractive index of a sample whose optical parameter is well defined. We estimate a birefringence of the sample to be 5.49(55)×10-5 at a comb tooth in the 780 nm region.