A significant degree of heterogeneity in synaptic conductance is present in neuron to neuron connections. We study the dynamics of weakly coupled pairs of neurons with heterogeneities in synaptic conductance using Wang-Buzsaki and Hodgkin-Huxley model neurons which have Types I and II excitability, respectively. This type of heterogeneity breaks a symmetry in the bifurcation diagrams of equilibrium phase difference versus the synaptic rate constant when compared to the identical case. For weakly coupled neurons coupled with identical values of synaptic conductance a phase locked solution exists for all values of the synaptic rate constant, α. In particular, in-phase and anti-phase solutions are guaranteed to exist for all α. Heterogeneity in synaptic conductance results in regions where no phase locked solution exists and the general loss of the ubiquitous in-phase and anti-phase solutions of the identically coupled case. We explain these results through examination of interaction functions using the weak coupling approximation and an in-depth analysis of the underlying multiple cusp bifurcation structure of the systems of coupled neurons.