For randomly nucleated SiGe/Si(001) islands, a significantly stronger blue-shift of the PL spectra as a function of the excitation intensity is observed when compared to islands grown on patterned substrates side by side within the same run in a solid source molecular beam epitaxy chamber. We ascribe this different PL behavior to the much larger inhomogeneity of the Ge distribution in islands on planar substrates when compared to islands grown on pit-patterned ones, as observed previously. 3D band-structure calculations show that Ge-rich inclusions of approximately 5 nm diameter at the apex of the islands can account for the observed differences in the PL spectra. The existence of such inclusions can be regarded as a quantum dot in an island and is in agreement with recent nano-tomography experiments.