The interference between conventional multipoles (e.g., electric and magnetic dipole, electric quadrupole, etc.) is known as the cause of unidirectional backward and forward scattering of nanoparticles. However, an unconventional multipole moment, toroidal dipole moment is generally overlooked in the unidirectional scattering. In this work, we systematically investigate the unidirectional scattering in the system of plasmonic nanoparticles. It is found that the toroidal dipole moment can play a significant role in the unidirectional backward scattering. The structural tunability of the unidirectional scattering is also demonstrated. Our results can find applications in the design of nanoantennas.