Zn2+-responsive magnetic resonance imaging (MRI) contrast agents are typically composed of a Gd chelate conjugated to a Zn2+-binding moiety via a linker. They allow for Zn2+ detection in the presence of human serum albumin (HSA). In order to decipher the key parameters that drive their Zn2+-dependent MRI response, we designed a pyridine-based ligand, PyAmC2mDPA, and compared the properties of GdPyAmC2mDPA to those of analogue complexes with varying Gd core, Zn-binding moiety, or linker sizes. The stability constants determined by pH potentiometry showed the good selectivity of PyAmC2mDPA for Gd3+ (log KGd = 16.27) versus Zn2+ (log KZn = 13.58), proving that our modified Zn2+-binding DPA moiety prevents the formation of previously observed dimeric species. Paramagnetic relaxation enhancement measurements indicated at least three sites that are available for GdPyAmC2mDPA binding on HSA, as well as a 2-fold affinity increase when Zn2+ is present (KD = 170 μM versus KDZn = 60 μM). Fluorescence competition experiments provided evidence of the higher affinity for site II vs site I, as well as the importance of both the Zn-binding part and the Gd core in generating enhanced HSA affinity in the presence of Zn2+. Finally, an analysis of nuclear magnetic relaxation dispersion (NMRD) data suggested a significantly increased rigidity for the Zn2+-bound system, which is responsible for the Zn2+-dependent relaxivity response.