A dual-modality birefringence/phase imaging system is presented. The system features a crystal retarder that provides polarization mixing and generates two interferometric carrier waves in a single signal spectrum. The retardation and orientation of sample birefringence can then be measured simultaneously based on spectral multiplexing interferometry. Further, with the addition of a Nomarski prism, the same setup can be used for quantitative differential interference contrast (DIC) imaging. Sample phase can then be obtained with two-dimensional integration. In addition, birefringence-induced phase error can be corrected using the birefringence data. This dual-modality approach is analyzed theoretically with Jones calculus and validated experimentally with malaria-infected red blood cells. The system generates not only corrected DIC and phase images, but a birefringence map that highlights the distribution of hemozoin crystals.