Grating-based X-ray dark-field imaging is a new imaging modality. It allows the visualization of structures at micrometer scale due to small-angle scattering of the X-ray beam. However, reading darkfield images is challenging as absorption and edge-diffraction effects also contribute to the dark-field signal, without adding diagnostic value. In this paper, we present a novel--and to our knowledge the first--algorithm for isolating small-angle scattering in dark-field images, which greatly improves their interpretability. To this end, our algorithm utilizes the information available from the absorption and differential phase images to identify clinically irrelevant contributions to the dark-field image. Experimental results on phantom and ex-vivo breast data promise a greatly enhanced diagnostic value of dark-field images.