The Chinese water deer (Hydropotes inermis inermis) is endemic to China. Historically, the species was widely distributed, but now, habitat loss and poaching have reduced its range and number drastically. In order to provide useful information for its conservation, we have investigated the genetic diversity and population structure of the Chinese water deer by analyzing the 403 bp fragment of the mitochondrial DNA (mtDNA) control region (D-loop). Eighteen different haplotypes were detected in 40 samples. Overall, Chinese water deer have a relatively high-genetic diversity compared to other rare cervid species, with a haplotype diversity of 0.923+/-0.025 and nucleotide diversity of 1.318 +/- 0.146%. No obvious phylogenetic structure among haplotypes was found for samples of different origin. An analysis of molecular variance (AMOVA) showed significant differentiation between the Zhoushan and the mainland population (F(ST)= 0.088, P < 0.001; Phi( ST ) = 0.075, P = 0.043), which suggests that exchanges of individuals between Zhoushan and the mainland should be avoided. We also recommend that a breeding center be set up for the mainland population.