It is observed that the magnitude of the toroidal rotation speed is reduced by the central electron cyclotron resonance heating (ECRH) regardless of the direction of the toroidal rotation. The magnetohydrodynamics activities generally appear with the rotation change due to ECRH. It is shown that the internal kink mode is induced by the central ECRH and breaks the toroidal symmetry. When the magnetohydrodynamics activities are present, the toroidal plasma viscosity is not negligible. The observed effects of ECRH on the toroidal plasma rotation are explained by the neoclassical toroidal viscosity in this Letter. It is found that the neoclassical toroidal viscosity torque caused by the internal kink mode damps the toroidal rotation.