The need to quantify the potential human health risk posed by the bovine reservoir of Escherichia coli O157 has led to a wealth of prevalence studies and improvements in detection methods over the last two decades. Rectoanal mucosal swabs have been used for the detection of E. coli O157 fecal shedding, colonized animals, and those predisposed to super shedding. We conducted a longitudinal study to compare the detection of E. coli O157 from feces and rectoanal mucosal swabs (RAMS) from a cohort of dairy heifers. We collected 820 samples that were tested by immunomagnetic separation of both feces and RAMS. Of these, 132 were detected as positive for E. coli O157 from both samples, 66 were detected as positive from RAMS only, and 117 were detected as positive from feces only. The difference in results between the two sample types was statistically significant (P < 0.001). The relative sensitivities of detection by immunomagnetic separation were 53% (confidence interval, 46.6 to 59.3) from RAMS and 67% (confidence interval, 59.6 to 73.1) from fecal samples. No association between long-term shedding (P = 0.685) or super shedding (P = 0.526) and detection by RAMS only was observed.