Originating from the Fertile Crescent in the Middle East, barley has now been cultivated widely on different soil types including acid soils, where aluminium toxicity is a major limiting factor. Here we show that the adaptation of barley to acid soils is achieved by the modification of a single gene (HvAACT1) encoding a citrate transporter. We find that the primary function of this protein is to release citrate from the root pericycle cells to the xylem to facilitate the translocation of iron from roots to shoots. However, a 1-kb insertion in the upstream of the HvAACT1 coding region occurring only in the Al-tolerant accessions, enhances its expression and alters the location of expression to the root tips. The altered HvAACT1 has an important role in detoxifying aluminium by secreting citrate to the rhizosphere. Thus, the insertion of a 1-kb sequence in the HvAACT1 upstream enables barley to adapt to acidic soils.