For amorphous solids, it has been intensely debated whether the traditional view on solids, in terms of the ground state and harmonic low energy excitations on top of it, such as phonons, is still valid. Recent theoretical developments of amorphous solids revealed the possibility of unexpectedly complex free-energy landscapes where the simple harmonic picture breaks down. Here we demonstrate that standard rheological techniques can be used as powerful tools to examine nontrivial consequences of such complex free-energy landscapes. By extensive numerical simulations on a hard sphere glass under quasistatic shear at finite temperatures, we show that above the so-called Gardner transition density, the elasticity breaks down, the stress relaxation exhibits slow, and ageing dynamics and the apparent shear modulus becomes protocol-dependent. Being designed to be reproducible in laboratories, our approach may trigger explorations of the complex free-energy landscapes of a large variety of amorphous materials.