Agrobacterium is a genus of soilborne gram-negative bacteria. Members carrying oncogenic plasmids can cause crown gall disease, which has significant economic costs, especially for the orchard and nursery industries. Early and rapid detection of pathogenic Agrobacterium spp. is key to the management of crown gall disease. To this end, we designed oligonucleotide primers and probes to target virD2 for use in a molecular diagnostic tool that relies on isothermal amplification and lateral-flow-based detection. The oligonucleotide tools were tested in the assay and evaluated for detection limit and specificity in detecting alleles of virD2. One set of primers that successfully amplified virD2 when used with an isothermal recombinase was selected. Both tested probes had detection limits in picogram amounts of DNA. Probe 1 could detect all tested pathogenic isolates that represented most of the diversity of virD2. Finally, the coupling of lateral-flow detection to the use of these oligonucleotide primers in isothermal amplification helped to reduce the onerousness of the process, and alleviated reliance on specialized tools necessary for molecular diagnostics. The assay is an advancement for the rapid molecular detection of pathogenic Agrobacterium spp.