Forested ecosystems diversified more than 350 Ma to become major engines of continental silicate weathering, regulating the Earth's atmospheric carbon dioxide concentration by driving calcium export into ocean carbonates. Our field experiments with mature trees demonstrate intensification of this weathering engine as tree lineages diversified in concert with their symbiotic mycorrhizal fungi. Preferential hyphal colonization of the calcium silicate-bearing rock, basalt, progressively increased with advancement from arbuscular mycorrhizal (AM) to later, independently evolved ectomycorrhizal (EM) fungi, and from gymnosperm to angiosperm hosts with both fungal groups. This led to 'trenching' of silicate mineral surfaces by AM and EM fungi, with EM gymnosperms and angiosperms releasing calcium from basalt at twice the rate of AM gymnosperms. Our findings indicate mycorrhiza-driven weathering may have originated hundreds of millions of years earlier than previously recognized and subsequently intensified with the evolution of trees and mycorrhizas to affect the Earth's long-term CO(2) and climate history.