Together with experimental data, theoretically predicted dipole moments represent a valuable tool for different branches in the chemical and physical sciences. With the diversity of levels of theory and basis sets available, a reliable combination must be carefully chosen in order to achieve accurate predictions. In a recent publication (J. Chem. Theory Comput. 2018, 14 (4), 1969-1981), Hait and Head-Gordon took a first step in this regard by providing recommendations on the best density functionals suitable for these purposes. However, no extensive study has been performed to provide recommendations on the basis set choice. Here, we shed some light into this matter by evaluating the performance of 38 general-purpose basis sets of single- up to triple-ζ-quality, when coupled with nine different levels of theory, in the computation of dipole moments. The calculations were performed on a data set with 114 small molecules containing second- and third-row elements. We based our analysis in regularized root-mean-square errors (regularized RMSE), in which the difference between the calculated μcalc and benchmark μbmk dipole moment values is derived as (μcalc[D] - μbmk[D])/(max(μbmk[D],1[D])). This procedure ensures relative errors for ionic species and absolute errors for species with small dipole moment values. Our results indicate that the best compromise between accuracy and computational efficiency is achieved by performing the computations with an augmented double-ζ-quality basis set (i.e., aug-pc-1, aug-pcseg-1, aug-cc-pVDZ) together with a hybrid functional (e.g., ωB97X-V, SOGGA11-X). Augmented triple-ζ basis sets could enhance the accuracy of the computations, but the computational cost of introducing such a basis set is substantial compared with the small improvement provided. These findings also highlight the crucial role that augmentation of the basis set with diffuse functions on both hydrogen and non-hydrogen atoms plays in the computation of dipole moments.