Epstein-Barr virus (EBV) is a human cancer-related virus closely associated with lymphoid and epithelial malignancies, and EBV glycoprotein B (gB) plays an essential role in viral entry into both B cells and epithelial cells by promoting cell-cell fusion. EBV gB is exclusively modified with high-mannose-linked N-glycans and primarily localizes to the endoplasmic reticulum (ER) with low levels on the plasma membrane (PM). However, the mechanism through which gB is regulated within host cells is largely unknown. Here, we report the identification of F-box only protein 2 (FBXO2), an SCF ubiquitin ligase substrate adaptor that preferentially binds high-mannose glycans and attenuates EBV infectivity by targeting N-glycosylated gB for degradation. gB possesses seven N-glycosylation sites, and FBXO2 directly binds to these high-mannose moieties through its sugar-binding domain. The interaction promotes the degradation of glycosylated gB via the ubiquitin-proteasome pathway. Depletion of FBXO2 not only stabilizes gB but also promotes its transport from the ER to the PM, resulting in enhanced membrane fusion and viral entry. FBXO2 is expressed in epithelial cells but not B cells, and EBV infection up-regulates FBXO2 levels. In summary, our findings highlight the significance of high-mannose modification of gB and reveal a novel host defense mechanism involving glycoprotein homeostasis regulation.