Holographic video requires impractical bitrates for storage and transmission without data compression. We introduce an end-to-end compression pipeline for compressing holographic sequences with known ground truth motion. The compression strategy employs a motion compensation algorithm based on the rotational transformation of an angular spectrum. Residuals arising from the compensation step are represented using short-time Fourier transforms and quantized with uniform mid-rise quantizers whose bit depth is determined by a Lagrangian rate-distortion optimization criterion where the distortion metric is the mean squared error. Experiments use computer-generated holographic videos, and we report Bjøntegaard delta peak signal-to-noise ratio gains of around 20 dB when compared to traditional image/video codecs.