A major challenge to end the pandemic caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is to develop a broadly protective vaccine that elicits long-term immunity. As the key immunogen, the viral surface spike (S) protein is frequently mutated, and conserved epitopes are shielded by glycans. Here, we revealed that S protein glycosylation has site-differential effects on viral infectivity. We found that S protein generated by lung epithelial cells has glycoforms associated with increased infectivity. Compared to the fully glycosylated S protein, immunization of S protein with N-glycans trimmed to the mono-GlcNAc-decorated state (SMG) elicited stronger immune responses and better protection for human angiotensin-converting enzyme 2 (hACE2) transgenic mice against variants of concern (VOCs). In addition, a broadly neutralizing monoclonal antibody was identified from SMG-immunized mice that could neutralize wild-type SARS-CoV-2 and VOCs with subpicomolar potency. Together, these results demonstrate that removal of glycan shields to better expose the conserved sequences has the potential to be an effective and simple approach for developing a broadly protective SARS-CoV-2 vaccine.