Phosphorylation of serine, threonine, and tyrosine is one of the most frequently occurring and crucial post-translational modifications of proteins often associated with important structural and functional changes. We investigated the direct effect of phosphorylation on the intrinsic conformational preferences of amino acids as a potential trigger of larger structural events. We conducted a comparative study of force fields on terminally capped amino acids (dipeptides) as the simplest model for phosphorylation. Our bias-exchange metadynamics simulations revealed that all model dipeptides sampled a great heterogeneity of ensembles affected by introduction of mono- and dianionic phosphate groups. However, the detected changes in populations of backbone conformers and side-chain rotamers did not reveal a strong discriminatory shift in preferences, as could be anticipated for the bulky, charged phosphate group. Furthermore, the AMBER and CHARMM force fields provided inconsistent populations of individual conformers as well as net structural trends upon phosphorylation. Detailed analysis of ensembles revealed competition between hydration and formation of internal hydrogen bonds involving amide hydrogens and the phosphate group. The observed difference in hydration free energy and potential for hydrogen bonding in individual force fields could be attributed to the different partial atomic charges used in each force field and, hence, the different parametrization strategies. Nevertheless, conformational propensities and net structural changes upon phosphorylation are difficult to extract from experimental measurements, and existing experimental data provide limited guidance for force field assessment and further development.