To determine the functions of fibromodulin (Fmod), a small leucine-rich keratan sulfate proteoglycan in tooth formation, we investigated the distribution of Fmod in dental tissues by immunohistochemistry and characterized the dental phenotype of 1-day-old Fmod-deficient mice using light and transmission electron microscopy. Immunohistochemistry was also used to compare the relative protein expression of dentin sialoprotein (DSP), dentin matrix protein-1 (DMP 1), bone sialoprotein (BSP), and osteopontin (OPN) between Fmod-deficient mice and wild-type mice. In normal mice and rats, Fmod immunostaining was mostly detected in the distal cell bodies of odontoblasts and in the stratum intermedium and was weaker in odontoblast processes and predentin. The absence of Fmod impaired dentin mineralization, increased the diameter of the collagen fibrils throughout the whole predentin, and delayed enamel formation. Immunohistochemistry provides evidence for compensatory mechanisms in Fmod-deficient mice. Staining for DSP and OPN was decreased in molars, whereas DMP 1 and BSP were enhanced. In the incisors, labeling for DSP, DMP 1, and BSP was strongly increased in the pulp and odontoblasts, whereas OPN staining was decreased. Positive staining was also seen for DMP 1 and BSP in secretory ameloblasts. Together these studies indicate that Fmod restricts collagen fibrillogenesis in predentin while promoting dentin mineralization and the early stages of enamel formation.