DNA Polymerases generate pyrophosphate every time they catalyze a step of DNA elongation. This elongation reaction is generally believed as thermodynamically favoured by the hydrolysis of pyrophosphate, catalyzed by inorganic pyrophosphatases. However, the specific action of inorganic pyrophosphatases coupled to DNA replication in vivo was never demonstrated. Here we show that the Polymerase-Histidinol-Phosphatase (PHP) domain of Escherichia coli DNA Polymerase III α subunit features pyrophosphatase activity. We also show that this activity is inhibited by fluoride, as commonly observed for inorganic pyrophosphatases, and we identified 3 amino acids of the PHP active site. Remarkably, E. coli cells expressing variants of these catalytic residues of α subunit feature aberrant phenotypes, poor viability, and are subject to high mutation frequencies. Our findings indicate that DNA Polymerases can couple DNA elongation and pyrophosphate hydrolysis, providing a mechanism for the control of DNA extension rate, and suggest a promising target for novel antibiotics.