We demonstrate ultrabroadband electro-optic detection of multi-THz transients using mechanically exfoliated flakes of gallium selenide of a thickness of less than 10 µm, contacted to a diamond substrate by van-der-Waals bonding. While the low crystal thickness allows for extremely broadband phase matching, the excellent optical contact with the index-matched substrate suppresses multiple optical reflections. The high quality of our structure makes our scheme suitable for the undistorted and artifact-free observation of electromagnetic waveforms covering the entire THz spectral range up to the near-infrared regime without the need for correction for the electro-optic response function. With the current revolution of chemically inert quasi-two-dimensional layered materials, we anticipate that exfoliated van-der-Waals materials on index-matched substrates will open new flexible ways of ultrabroadband electro-optic detection at unprecedented frequencies.