Discovery of new germplasm sources and identification of haplotypes for the durable Soybean mosaic virus resistance gene, Rsv 4, provide novel resources for map-based cloning and genetic improvement efforts in soybean. The Soybean mosaic virus (SMV) resistance locus Rsv4 is of interest because it provides a durable type of resistance in soybean [Glycine max (L.) Merr.]. To better understand its molecular basis, we used a population of 309 BC3F2 individuals to fine-map Rsv4 to a ~120 kb interval and leveraged this genetic information in a second study to identify accessions 'Haman' and 'Ilpumgeomjeong' as new sources of Rsv4. These two accessions along with three other Rsv4 and 14 rsv4 accessions were used to examine the patterns of nucleotide diversity at the Rsv4 region based on high-depth resequencing data. Through a targeted association analysis of these 19 accessions within the ~120 kb interval, a cluster of four intergenic single-nucleotide polymorphisms (SNPs) was found to perfectly associate with SMV resistance. Interestingly, this ~120 kb interval did not contain any genes similar to previously characterized dominant disease resistance genes. Therefore, a haplotype analysis was used to further resolve the association signal to a ~94 kb region, which also resulted in the identification of at least two Rsv4 haplotypes. A haplotype phylogenetic analysis of this region suggests that the Rsv4 locus in G. max is recently introgressed from G. soja. This integrated study provides a strong foundation for efforts focused on the cloning of this durable virus resistance gene and marker-assisted selection of Rsv4-mediated SMV resistance in soybean breeding programs.