Some members of the physiological human microbiome occasionally cause life-threatening disease even in immunocompetent individuals. A prime example of such a commensal pathogen is Neisseria meningitidis, which normally resides in the human nasopharynx but is also a leading cause of sepsis and epidemic meningitis. Using N. meningitidis as model organism, we tested the hypothesis that virulence of commensal pathogens is a consequence of within host evolution and selection of invasive variants due to mutations at contingency genes, a mechanism called phase variation. In line with the hypothesis that phase variation evolved as an adaptation to colonize diverse hosts, computational comparisons of all 27 to date completely sequenced and annotated meningococcal genomes retrieved from public databases showed that contingency genes are indeed enriched for genes involved in host interactions. To assess within-host genetic changes in meningococci, we further used ultra-deep whole-genome sequencing of throat-blood strain pairs isolated from four patients suffering from invasive meningococcal disease. We detected up to three mutations per strain pair, affecting predominantly contingency genes involved in type IV pilus biogenesis. However, there was not a single (set) of mutation(s) that could invariably be found in all four pairs of strains. Phenotypic assays further showed that these genetic changes were generally not associated with increased serum resistance, higher fitness in human blood ex vivo or differences in the interaction with human epithelial and endothelial cells in vitro. In conclusion, we hypothesize that virulence of meningococci results from accidental emergence of invasive variants during carriage and without within host evolution of invasive phenotypes during disease progression in vivo.