Coxsackievirus (CV)-B5 is a common human enterovirus reported worldwide; swine vesicular disease virus (SVDV) is a porcine variant of CV-B5. To clarify the transmission dynamics and molecular basis of host switching between CV-B5 and SVDV, we analysed and compared the VP1 and partial 3Dpol gene regions of these two viruses. Spatiotemporal dynamics of viral transmission were estimated using a Bayesian statistical inference framework. The detected selection events were used to analyse the key molecules associated with host switching. Analyses of VP1 sequences revealed six CV-B5 genotypes (A1-A4 and B1-B2) and three SVDV genotypes (I-III). Analyses of partial 3Dpol revealed five clusters (A-E). The genotypes evolved sequentially over different periods, albeit with some overlap. The major hub of CV-B5 transmission was in China whereas the major hubs of SVDV transmission were in Italy. Network analysis based on deduced amino acid sequences showed a diverse extension of the VP1 structural protein, whereas most sequences were clustered into two haplotypes in the partial 3Dpol region. Residue 178 of VP1 showed four epistatic interactions with residues known to play essential roles in viral host tropism, cell entry, and viral decoating.