Cigarette smoking during pregnancy is associated with various disabilities in the offspring such as attention deficit/hyperactivity disorder, learning disabilities, and persistent anxiety. We have reported that nicotine exposure in female mice during pregnancy, in particular from embryonic day 14 (E14) to postnatal day 0 (P0), induces long-lasting behavioral deficits in offspring. However, the mechanism by which prenatal nicotine exposure (PNE) affects neurodevelopment, resulting in behavioral deficits, has remained unclear. Here, we report that PNE disrupted the proliferation of neuronal progenitors, leading to a decrease in the progenitor pool in the ventricular and subventricular zones. In addition, using a cumulative 5-bromo-2'-deoxyuridine labeling assay, we evaluated the rate of cell cycle progression causing the impairment of neuronal progenitor proliferation, and uncovered anomalous cell cycle kinetics in mice with PNE. Accordingly, the density of glutamatergic neurons in the medial prefrontal cortex (medial PFC) was reduced, implying glutamatergic dysregulation. Mice with PNE exhibited behavioral impairments in attentional function and behavioral flexibility in adulthood, and the deficits were ameliorated by microinjection of D-cycloserine into the PFC. Collectively, our findings suggest that PNE affects the proliferation and maturation of progenitor cells to glutamatergic neuron during neurodevelopment in the medial PFC, which may be associated with cognitive deficits in the offspring.