Mt Kilimanjaro is Africa's highest mountain, and an icon for a country famous for its mammalian fauna. The distribution and abundance of small mammals on the mountain are poorly known. Here we document the distribution of shrews and rodents along an elevational gradient on the southeastern versant of Kilimanjaro. Five sites were sampled with elevational center points of 2000, 2500, 3000, 3500 and 4000 m, using a systematic methodology of standard traps and pitfall lines, to inventory the shrews and rodents of the slope. Sixteen species of mammal were recorded, including 6 shrew and 10 rodent species, and the greatest diversity of both was found at 3000 m, the elevational midpoint of the transect. No species previously unrecorded on Kilimanjaro were observed. Two genera of rodents that occur in nearby mountains (Hylomyscus and Beamys) were not recorded. Myosorex zinki, the only mammal endemic to Mt. Kilimanjaro, which previously was known by only a few specimens collected in the ericaceous or moorland habitat, was found in all but one (the lowest) of the sites sampled, and was one of the most widespread species of small mammal along the gradient. Two shrews (Crocidura allex and Sylvisorex granti) and one rodent (Dendromus insignis) were found throughout the entire transect, with Dendromus being observed at our highest trap point (4240 m). As in similar faunal surveys on other mountains of Tanzania, rainfall influenced the sample success of shrews, but not rodents. Trap success for rodents at 3500 m was notably low. This study contributes further justification for the conservation of the forest habitat of Mt. Kilimanjaro.