Aluminum (Al) stress is becoming the major limiting factor in crop production in acidic soils. Rice has been reported as the most Al-tolerant crop and the capacity of Al toxicity tolerance is generally evaluated by comparing root growth under Al stress. Here, we performed an association mapping of Al toxicity tolerance using a core collection of 211 indica rice accessions with 700 K high quality SNP data. A total of 21 putative QTL affecting shoot height (SH), root length (RL), shoot fresh weight (SFW), shoot dry weight (SDW), root dry weight (RDW) and shoot water content (SWC) were identified at seedling stage, including three QTL detected only under control condition, eight detected only under Al stress condition, ten simultaneously detected in both control and Al stress conditions, and seven were identified by stress tolerance index of their corresponding traits. Total of 21 candidate genes for 7 important QTL regions associated with Al toxicity tolerance were identified based on combined haplotype analysis and functional annotation, and the most likely candidate gene(s) for each important QTL were also discussed. Also a candidate gene Nrat1 on chromosome 2 was further fine-mapped using BSA-seq and linkage analysis in the F2 population derived from the cross of Al tolerant accession CC105 and super susceptible accession CC180. A new non-synonymous SNP variation was observed at Nrat1 between CC105 and CC180, which resulted in an amino-acid substitution from Ala (A) in CC105 to Asp (D) in CC180. Haplotype analysis of Nrat1 using 327 3K RGP accessions indicated that minor allele variations in aus and indica subpopulations decreased Al toxicity tolerance in rice. The candidate genes identified in this study provide valuable information for improvement of Al toxicity tolerance in rice. Our research indicated that minor alleles are important for QTL mapping and its application in rice breeding when natural gene resources are used.