For organic solar cells (OSCs), the charge generation mechanism and the recombination loss are heavily linked with charge transfer states (CTS). Measuring the energy of CTS (ECT) by the most widely used technique, however, has become challenging for the non-fullerene-based OSCs with a small driving force, resulting in difficulty in the understanding of OSC physics. Herein, we present a study of the PM6:Y6 bulk heterojunction. It is demonstrated that electro-absorption can not only reveal the dipolar nature of Y6 but also resolve the morphology-dependent absorption signal of CTS in the sub-bandgap region. The device with the optimum blending weight ratio shows an ECT of 1.27 eV, which is confirmed by independent measurements. Because of the charge transfer characteristics of Y6, the charge generation at PM6:Y6 interfaces occurs efficiently under a small but non-negligible driving force of 0.14 eV, and the total recombination loss is as low as 0.43 eV.