The effect of the filler size on the structural and mechanical properties of an attractive fibrillated network composed of oxidised cellulose nanofibrils (OCNF) in water was investigated. Silica nanoparticles with a diameter of ca. 5 nm (SiNp5) and and ca. 158 nm (SiNp158) were chosen as non-interacting fillers of the OCNF network. These filler sizes were chosen, respectively, to have a particle size which was either similar to that of the network mesh size or much larger than it. Contrast matched small angle neutron scattering (SANS) experiments revealed that the presence of the fillers (SiNp5 and SiNp158) did not perturb the structural properties of the OCNF network at the nanometer scale. However, the filler size difference strongly affected the mechanical properties of the hydrogel upon large amplitude oscillatory shear. The presence of the smaller filler, SiNp5, preserved the mechanical properties of the hydrogels, while the larger filler, SiNp158, allowed a smoother breakage of the network and low network recoverability after breakage. This study showed that the filler-to-mesh size ratio, for non-interacting fillers, is pivotal for tailoring the non-linear mechanical properties of the gel, such as yielding and flow.