Polysialyltransferases synthesize polysialic acid on cell surface-expressed glycoconjugates, which is crucial for developing processes and signaling pathways in eukaryotes. Recent advances in cancer research have rendered polysialyltransferases important drug targets because polysialic acid contributes to cancer cell progression, metastasis, and treatment of resistant tumors. To aid the development of high-throughput screening assays for polysialyltransferase inhibitors, we demonstrate that a previously developed class of fluorescent CMP-sialic acid mimetics for sialyltransferases has nanomolar affinities for oligo- and polysialyltransferases and can be used for the rapid screening of new polysialyltransferase inhibitors. We demonstrate that these CMP-Neu5Ac mimetics inhibit polysialylation in vitro and perform cell culture experiments, where we observe reduced polysialylation of NCAM. Furthermore, we describe the structural basis of CMP-Neu5Ac mimetics binding to the human oligosialyltransferase ST8SiaIII and extrapolate why their affinity is high for human polysialyltransferases. Our results show that this novel class of compounds is a promising tool for the development of potent and selective drugs against polysialyltransferase activity.