Combining extensive molecular dynamics simulations of lipid bilayer systems of varying chemical compositions with single-trajectory analyses, we systematically elucidate the stochastic nature of the lipid motion. We observe subdiffusion over more than 4 orders of magnitude in time, clearly stretching into the submicrosecond domain. The lipid motion depends on the lipid chemistry, the lipid phase, and especially the presence of cholesterol. We demonstrate that fractional Langevin equation motion universally describes the lipid motion in all phases, including the gel phase, and in the presence of cholesterol. The results underline the relevance of anomalous diffusion in lipid bilayers and the strong effects of the membrane composition.