Discoveries of bacterial communities in environments that previously have been described as sterile have in recent years radically challenged the view of these environments. In this study we aimed to use 16S rRNA sequencing to describe the composition and temporal stability of the bacterial microbiota in bovine milk from healthy udder quarters, an environment previously believed to be sterile. Sequencing of the 16S rRNA gene is a technique commonly used to describe bacterial composition and diversity in various environments. With the increased use of 16S rRNA gene sequencing, awareness of methodological pitfalls such as biases and contamination has increased although not in equal amount. Evaluation of the composition and temporal stability of the microbiota in 288 milk samples was largely hampered by background contamination, despite careful and aseptic sample processing. Sequencing of no template control samples, positive control samples, with defined levels of bacteria, and 288 milk samples with various levels of bacterial growth, revealed that the data was influenced by contaminating taxa, primarily Methylobacterium. We observed an increasing impact of contamination with decreasing microbial biomass where the contaminating taxa became dominant in samples with less than 104 bacterial cells per mL. By applying a contamination filtration on the sequence data, the amount of sequences was substantially reduced but only a minor impact on number of identified taxa and by culture known endogenous taxa was observed. This suggests that data filtration can be useful for identifying biologically relevant associations in milk microbiota data.