Based on structural data of the RNA-dependent RNA polymerase, rational targeting of key residues, and screens for Coxsackievirus B3 fidelity variants, we isolated nine polymerase variants with mutator phenotypes, which allowed us to probe the effects of lowering fidelity on virus replication, mutability, and in vivo fitness. These mutator strains generate higher mutation frequencies than WT virus and are more sensitive to mutagenic treatments, and their purified polymerases present lower-fidelity profiles in an in vitro incorporation assay. Whereas these strains replicate with WT-like kinetics in tissue culture, in vivo infections reveal a strong correlation between mutation frequency and fitness. Variants with the highest mutation frequencies are less fit in vivo and fail to productively infect important target organs, such as the heart or pancreas. Furthermore, whereas WT virus is readily detectable in target organs 30 d after infection, some variants fail to successfully establish persistent infections. Our results show that, although mutator strains are sufficiently fit when grown in large population size, their fitness is greatly impacted when subjected to severe bottlenecking, which would occur during in vivo infection. The data indicate that, although RNA viruses have extreme mutation frequencies to maximize adaptability, nature has fine-tuned replication fidelity. Our work forges ground in showing that the mutability of RNA viruses does have an upper limit, where larger than natural genetic diversity is deleterious to virus survival.