Molecular markers based on retrotransposon insertions are widely used for various applications including phylogenetic analysis. Multiple cases were described where retrotransposon-based markers, namely sequence-specific amplification polymorphism (SSAP), were superior to other marker types in resolving the phylogenetic relationships due to their higher variability and informativeness. However, the patterns of evolutionary relationships revealed by SSAP may be dependent on the underlying retrotransposon activity in different periods of time. Hence, the proper choice of retrotransposon family is essential for obtaining significant results. We compared the phylogenetic trees for a diverse set of diploid A-genome wheat species (Triticum boeoticum, T. urartu and T. monococcum) based on two unrelated retrotransposon families, BARE-1 and Jeli. BARE-1 belongs to Copia class and has a uniform distribution between common wheat (T. aestivum) genomes of different origin (A, B and D), indicating similar activity in the respective diploid genome donors. Gypsy-class family Jeli was found by us to be an A-genome retrotransposon with >70% copies residing in A genome of hexaploid common wheat, suggesting a burst of transposition in the history of A-genome progenitors. The results indicate that a higher Jeli transpositional activity was associated with T. urartu versus T. boeoticum speciation, while BARE-1 produced more polymorphic insertions during subsequent intraspecific diversification; as an outcome, each retrotransposon provides more informative markers at the corresponding level of phylogenetic relationships. We conclude that multiple retroelement families should be analyzed for an image of evolutionary relationships to be solid and comprehensive.