Silicon nanowires (NW) were grown by the vapor-liquid-solid mechanism using gold as the catalyst and silane as the precursor. Gold from the catalyst particle can diffuse over the wire sidewalls, resulting in gold clusters decorating the wire sidewalls. The presence or absence of gold clusters was observed either by high angle annular darkfield scanning transmission electron microscopy images or by scanning electron microscopy. We find that the gold surface diffusion can be controlled by two growth parameters, the silane partial pressure and the growth temperature, and that the wire diameter also affects gold diffusion. Gold clusters are not present on the NW side walls for high silane partial pressure, low temperature, and small NW diameters. The absence or presence of gold on the NW sidewall has an effect on the sidewall morphology. Different models are qualitatively discussed. The main physical effect governing gold diffusion seems to be the adsorption of silane on the NW sidewalls.