The appearance of the common artifacts of laser speckle contrast imaging (LSCI), namely the granularity in flow rate estimation caused by static scatterers, is a well-known phenomenon. This artifact can be greatly reduced in spatial speckle contrast calculation using interframe decorrelated illumination, forcing true ensemble averaging. We propose a statistical model, which describes the effect of multiple image acquisitions on the contrast map quality when the illumination stable and when the illumination is decorrelated frame by frame. We investigate the improvement as a function of the ratio of dynamic and static scatterers by formulating a statistical distribution based model, using in simulation, flow phantom and in vivo experiments. Our main finding is that the ensemble averaging yields limited improvement in several practical cases due to the highly heterogeneous scatterer structure of living tissues.