In this Letter, we report, based on our knowledge, the first demonstration of Kerr-induced adiabatic frequency conversion in a silica toroid microcavity. Taking advantage of the instantaneous response of the Kerr effect, we achieved adiabatic frequency conversion with a controllable amount of frequency shift and time width. In addition, thanks to the combination of the Kerr effect and the ultrahigh Q (>107) of the silica toroid microcavity, we also observed multiple frequency conversion within a photon lifetime. Furthermore, use of the Kerr effect allowed us to investigate the influence of the relative phase between the original and converted light.