Ten rye varieties grown in one location were analyzed for their contents of dietary fiber (arabinoxylan and beta-glucan) and phytochemicals (folate, tocols, phenolic acids, alkylresorcinols, and sterols). The varieties included old and modern varieties from five European countries. Significant differences were observed in the contents of all phytochemicals in whole grains and in the fiber contents in the flour and bran. The old French varieties Haute Loire and Queyras had high contents of most phytochemicals, whereas the Polish varieties Dankowskie-Zlote and Warko were relatively poor in phytochemicals. The varieties with a high content of folate tended to have low alkylresorcinol contents and vice versa. Furthermore, high contents of arabinoxylans were associated with high contents in tocols and sterols. The 10 selected rye samples comprising old populations and old and modern varieties from different ecological regions of Europe demonstrate high natural variation in their composition and show that landraces and old populations are useful genetic resources for plant breeding. The contents of single phytochemicals can likely be affected by breeding, and they may be adjusted by the right selection of genotype.