Ketamine has been used for medical purposes, most typically as an anesthetic, and recent studies support its use in the treatment of depression. However, ketamine tends to be abused by adolescents and young adults. In the current study, we examined the effects of early ketamine exposure on brain structure and function. We employed MRI to assess the effects of ketamine abuse on cerebral gray matter volume (GMV) and functional connectivity (FC) in 34 users and 19 non-users, employing covariates. Ketamine users were categorized as adolescent-onset and adult-onset based on when they were first exposed to ketamine. Imaging data were processed by published routines in SPM and AFNI. The results revealed lower GMV in the left precuneus in ketamine users, with a larger decrease in the adolescent-onset group. The results from a seed-based correlation analysis show that both ketamine groups had higher functional connectivity between left precuneus (seed) and right precuneus than the control group. Compared to controls, ketamine users showed decreased GMV in the right insula, left inferior parietal lobule, left dorsolateral prefrontal cortex/superior frontal gyrus, and left medial orbitofrontal cortex. These preliminary results characterize the effects of ketamine misuse on brain structure and function and highlight the influence of earlier exposure to ketamine on the development of the brain. The precuneus, a structure of central importance to cerebral functional organization, may be particularly vulnerable to the influences of early ketamine exposure. How these structural and functional brain changes may relate to the cognitive and affective deficits remains to be determined with a large cohort of participants.