Hybrid wheat breeding is a promising strategy to improve the level of leaf rust and stripe rust resistance in wheat. Leaf rust and stripe rust belong to the most important fungal diseases in wheat production. Due to a dynamic development of new virulent races, epidemics appear in high frequency and causes significant losses in grain yield and quality. Therefore, research is needed to develop strategies to breed wheat varieties carrying highly efficient resistances. Stacking of dominant resistance genes through hybrid breeding is such an approach. Within this study, we investigated the genetic architecture of leaf rust and stripe rust resistance of 1750 wheat hybrids and their 230 parental lines using a genome-wide association study. We observed on average a lower rust susceptibility for hybrids in comparison to their parental inbred lines and some hybrids outperformed their better parent with up to 56%. Marker-trait associations were identified on chromosome 3D and 4A for leaf rust and on chromosome 2A, 2B, and 6A for stripe rust resistance by using a genome-wide association study with a Bonferroni-corrected threshold of P < 0.10. Detected loci on chromosomes 4A and 2A were located within previously reported genomic regions affecting leaf rust and stripe rust resistance, respectively. The degree of dominance was for most associations favorable in the direction of improved resistance. Thus, resistance can be increased in hybrid wheat breeding by fixing complementary leaf rust and stripe rust resistance genes with desired dominance effects in opposite parental pools.