Three novel naphthalenediimide-based (NDI-based) coordination polymers (CPs), namely [Cd(3-PMNDI)(2,2'-BPDC)] (1), [Cd2(3-PMNDI)1.5(4,4'-BPDC)2(H2O)3]·DMF (2) and [Cd(3-PMNDI)(4,4'-SDC)] (3) (2,2'-H2BPDC = 2,2'-biphenyldicarboxylic acid, 4,4'-H2BPDC = 4,4'-biphenyldicarboxylic acid, 4,4'-H2SDC = 4,4'-stilbenedicarboxylic acid, 3-PMNDI = N,N'-bis(3-pyridylmethyl)-1,4,5,8-naphthalenediimide, and DMF = N,N'-dimethylformamide), have been designed and synthesized here from electron-deficient PMNDI (electron acceptors, EAs) and electron-rich aromatic carboxylic acids (electron donors, EDs) in the presence of cadmium ions. The introduction of aromatic carboxylic acids with different sizes and conjugation degrees leads to the generation of a two-dimensional (2D) layer in 1, a two-fold interpenetrated three-dimensional (3D) network in 2 and an eight-fold interpenetrated 3D framework in 3. Furthermore, the use of distinct electron-donating aromatic carboxylic acids and the consequent different numbers and strengths of lone pair-π and π-π interactions in the interfacial contacts of EDs/EAs give rise to distinct intermolecular charge transfer (ICT) and initial colors of the three CPs, and consequently cause different photoinduced intermolecular electron transfer (PIET) and distinguishing photo-responsive behaviors (weak photochromic performance for 1, excellent photochromic properties for 2 and non-photochromism for 3). This study indicates that an appropriate ICT is beneficial for PIET, but too weak or too strong ICT is not conducive to PIET, which provides an effective strategy for the construction of functional CPs with distinguishing photo-responsive properties through the subtle balance of ICT and PIET.