We demonstrate the generation of 100 GHz single-cycle pulses with up to 10 MW of peak power using optical rectification and broadband phase matching via the tilted pulse front (TPF) technique in lithium niobate. The optical driver is a cryogenically cooled Yb:YAG amplifier providing tens of mJ energy, ~5 ps long laser pulses. We obtain a high THz pulse energy up to 65 µJ with 31.6 MV/m peak electric field when focused close to its diffraction limit of 2.5 mm diameter. A high optical-to-THz energy conversion efficiency of 0.3% at 85 K is measured in agreement with numerical simulations. This source is of great interest for a broad range of applications, such as nonlinear THz field-matter interaction and charged particle acceleration for ultrafast electron diffraction and table-top X-ray sources.