Three new POM-based compounds, with formulae [Na0.63Ag3(Htba)2.37(tba)0.63(H2O)2(PMo12O40)]·4H2O (Ag3PMo), [Ag4(Htba)4(H2O)2(PMo12O40)](NO3)·H2O (Ag4PMo), and [Ag3(Htba)2(tba)(PW12O40)0.5](NO3)0.5·13H2O (Ag3PW), were prepared with a 3-(4H-1,2,4-triazol-4-yl)benzoic acid (Htba) ligand, Keggin-type anions ([PMo12O40]3-/[PW12O40]3-), and a silver ion (Ag+). The structural features of these compounds are particularly different from the multinuclear subunits, which are [Ag3(tba)3] clusters in Ag3PMo, [Ag4(tba)3] chains in Ag4PMo, and [Ag3(tba)3]2 clusters in Ag3PW, connected by multidonor atom tba ligands and Ag+ ions. Meanwhile, in these compounds, polyanions act as polydentate ligands to link adjacent Ag-tba metal-organic units and expand their spatial dimensions. These compounds, as heterogeneous catalysts, exhibit high stability and excellent catalytic activity to construct benzimidazoles. Ag3PMo could efficiently catalyze the condensation of benzene-1,2-diamines and benzaldehydes and produce benzimidazoles in good yields. In addition, Ag3PMo could be reused up to 7 times and was suitable for gram-scale reactions.