Metal-organic frameworks (MOFs) are attracting increasing attention as adsorbents of contaminants of emerging concern that are difficult to remove by conventional processes. This paper examines how functional groups covering the pore walls of phosphinate-based MOFs affect the adsorption of specific pharmaceutical pollutants (diclofenac, cephalexin, and sulfamethoxazole) and their hydrolytic stability. New structures, isoreticular to the phosphinate MOF ICR-7, are presented. The phenyl ring facing the pore wall of the presented MOFs is modified with dimethylamino groups (ICR-8) and ethyl carboxylate groups (ICR-14). These functionalized MOFs were obtained from two newly synthesized phosphinate linkers containing the respective functional groups. The presence of additional functional groups resulted in higher affinity toward the tested pollutants compared to ICR-7 or activated carbon. However, this modification also comes with a reduced adsorption capacity. Importantly, the introduction of the functional groups enhanced the hydrolytic stability of the MOFs.