Zika virus (ZIKV) is now in a post-pandemic period, for which the potential for re-emergence and future spread is unknown. Adding to this uncertainty is the unique capacity of ZIKV to directly transmit between humans via sexual transmission. Recently, we demonstrated that direct transmission of ZIKV between vertebrate hosts leads to rapid adaptation resulting in enhanced virulence in mice and the emergence of three amino acid substitutions (NS2A-A117V, NS2A-A117T, and NS4A-E19G) shared among all vertebrate-passaged lineages. Here, we further characterized these host-adapted viruses and found that vertebrate-passaged viruses also have enhanced transmission potential in mosquitoes. To understand the contribution of genetic changes to the enhanced virulence and transmission phenotype, we engineered these amino acid substitutions, singly and in combination, into a ZIKV infectious clone. We found that NS4A-E19G contributed to the enhanced virulence and mortality phenotype in mice. Further analyses revealed that NS4A-E19G results in increased neurotropism and distinct innate immune signaling patterns in the brain. None of the substitutions contributed to changes in transmission potential in mosquitoes. Together, these findings suggest that direct transmission chains could enable the emergence of more virulent ZIKV strains without compromising mosquito transmission capacity, although the underlying genetics of these adaptations are complex.