A minor QTL for grain weight in rice, qTGW1.2b, was fine-mapped. Its casual gene OsVQ4 was confirmed through CRISPR/Cas9-targeted mutagenesis, exhibiting an effect that was larger than the original QTL effect. The CRISPR/Cas system exhibits a great potential for rice improvement, but the application was severely hindered due to insufficient target genes, especial the lack of validated genes underlying quantitative trait loci having small effects. In this study, a minor QTL for grain weight, qTGW1.2b, was fine-mapped into a 44.0 kb region using seven sets of near isogenic lines (NILs) developed from the indica rice cross (Zhenshan 97)3/Milyang 46, followed by validation of the causal gene using CRISPR/Cas9-targeted mutagenesis. In the NIL populations, 1000-grain weight of the Zhenshan 97 homozygous lines decreased by 0.9-2.0% compared with the Milyang 46 homozygous lines. A gene encoding VQ-motif protein, OsVQ4, was identified as the candidate gene based on parental sequence differences. The effect of OsVQ4 was confirmed by creating CRISPR/Cas9 knockout lines, whose 1000-grain weight decreased by 2.8-9.8% compared with the wild-type transgenic line and the recipient. These results indicate that applying genome editing system could create novel alleles with large phenotypic variation at minor QTLs, which is an effective way to validate causal genes of minor QTLs. Our study establishes a strategy for cloning minor QTLs, which could also be used to identify a large number of potential target genes for the application of CRISPR/Cas system.