Structural α-relaxation dispersion in binary molecular glass forming mixtures with distinct mixing enthalpy ΔHmix was investigated using enthalpic and dielectric relaxation measurements across the entire composition range. This study focused on the dependence of the relaxation dispersion on the mixing thermodynamics by determining the non-exponential exponent β, and its composition dependence. The β values determined by the enthalpic and dielectric relaxations agree well. Remarkably, it is found that the systems with positive enthalpy of mixing (exothermic, ΔHmix >0) have positive deviations in the composition dependence of β from the linear averaging of the two β values of the pure components, while negative deviations are observed for the systems with negative enthalpy of mixing (endothermic, ΔHmix <0). Furthermore, the relation between the non-exponential behaviors and entropy of mixing is discussed, revealing that the positive or negative deviation of β in its composition dependence on mixing is accompanied by the same sign of the excess entropy of mixing relative to the ideal one.