Glaciers create some of Earth's steepest topography; yet, many areas that were repeatedly overridden by ice sheets in the last few million years include extensive plateaus. The distinct geomorphic contrast between plateaus and the glacial troughs that dissect them has sustained two long-held hypotheses: first, that ice sheets perform insignificant erosion beyond glacial troughs, and, second, that the plateaus represent ancient pre-glacial landforms bearing information of tectonic and geomorphic history prior to Pliocene-Pleistocene global cooling (~3.5 Myr ago). Here we show that the Fennoscandian ice sheets drove widespread erosion across plateaus far beyond glacial troughs. We apply inverse modelling to 118 new cosmogenic 10Be and 26Al measurements to quantify ice sheet erosion on the plateaus fringing the Sognefjorden glacial trough in western Norway. Our findings demonstrate substantial modification of the pre-glacial landscape during the Quaternary, and that glacial erosion of plateaus is important when estimating the global sediment flux to the oceans.