We present a thorough study on the various impacts of polymer:nanoparticle ratios on morphology, charge generation and device performance in hybrid solar cells, comprising active layers consisting of a conjugated polymer and in situ prepared copper indium sulfide (CIS) nanoparticles. We conducted morphological studies through transmission electron microscopy and transient absorption measurements to study charge generation in absorber layers with polymer:nanoparticle weight ratios ranging from 1:3 to 1:15. These data are correlated to the characteristic parameters of the prepared solar cells. To gain a deeper understanding of our experimental findings, three-dimensional drift-diffusion-based simulations were performed. Based on elaborate descriptions of the contributions of polymer and nanoparticle phase to device performances, our results suggest that a polymer:CIS volume ratio of 1:2 (weight ratio 1:9) is necessary to obtain a balanced hole and electron percolation. Also at higher CIS loadings the photocurrent remains surprisingly high due to the contribution of the CIS phase to the charge carrier generation.