Non-fullerene acceptors (NFAs) have been demonstrated to be promising candidates for highly efficient organic photovoltaic (OPV) devices. The tunability of absorption characteristics of NFAs can be used to make OPVs with complementary donor-acceptor absorption to cover a broad range of the solar spectrum. However, both charge transfer from donor to acceptor moieties and energy (energy) transfer from high-bandgap to low-bandgap materials are possible in such structures. Here, we show that when charge transfer and exciton transfer processes are both present, the coexistence of excitons in both domains can cause a loss mechanism. Charge separation of excitons in a low-bandgap material is hindered due to exciton population in the larger bandgap acceptor domains. Our results further show that excitons in low-bandgap material should have a relatively long lifetime compared to the transfer time of excitons from higher bandgap material in order to contribute to the charge separation. These observations provide significant guidance for design and development of new materials in OPV applications.