We define the anisotropic structure building unit that encompasses diverse chemical bonds (ABUCB). The ABUCB is highly likely to cause anisotropy in both crystallographic structure and spatial electron distribution, ultimately resulting in enhanced macroscopic optical anisotropy. Accordingly, the (PO3F)2- or (SO3F)- tetrahedron involving the unique P-F or S-F bond serves as such an ABUCB. The distinct chemical bond effectively alters the microscopic nature of the structure building unit, such as polarizability anisotropy, hyperpolarizability, and geometry distortion; this consequently changes the macroscopic second-order nonlinear optical (2nd-NLO) properties of the materials. In this review, we summarize both typical and newly emerged compounds containing ABUCBs. These compounds encompass approximately 90 examples representing six distinct categories, including phosphates, borates, sulfates, silicates, chalcogenides and oxyhalides. Furthermore, we demonstrate that the presence of ABUCBs in DUV/UV NLO compounds contributes to an increase in birefringence and retention of a large band gap, facilitating phase matching in high-energy short-wavelength spectral ranges. On the other hand, the inclusion of ABUCBs in IR NLO compounds offers a feasible method for increasing the band gap and consequently enhancing the larger laser-induced damage threshold. This review consolidates various trial-and-error explorations and presents a novel strategy for designing 2nd-NLO compounds, potentially offering an opportunity for the development of high-performance 2nd-NLO materials.