With the development of portable electronics, higher performance transistors are required to reduce the form factor and improve the performance of the devices. The key issue relies on developing transistors with outstanding electrical properties and low energy consumption at small scale. Here we demonstrate chemical vapor deposition (CVD) grown MoS2 transistors with a high on/off ratio using ZrO2 as a gate dielectric. Using 10 nm thick ZrO2, the transistor has an on/off ratio of 108, a sub-threshold swing of 0.1 V/dec, and a mobility of 64.66 cm2 V-1 s-1. Compared to the MoS2 devices grown on 300 nm SiO2, the electrical performance demonstrates an all round improvement, which indicates the high crystalline quality of MoS2/ZrO2. Owing to the high-k ZrO2 dielectrics, the MoS2 transistor has a high on/off ratio, a low operating voltage, and good channel modulation capability which ensures that MoS2 is a good candidate for low power electronics.