In the endoplasmic reticulum (ER), the sugar chain is initially introduced onto newly synthesized proteins as a triantennary tetradecasaccharide (Glc3Man9GlcNAc2). The attached oligosaccharide chain is subjected to stepwise trimming by the actions of specific glucosidases and mannosidases. In these processes, the transiently expressed N-glycans, as processing intermediates, function as signals for the determination of glycoprotein fates, i.e., folding, transport, or degradation through interactions of a series of intracellular lectins. The monoglucosylated glycoforms are hallmarks of incompletely folded states of glycoproteins in this system, whereas the outer mannose trimming leads to ER-associated glycoprotein degradation. This review outlines the recently emerging evidence regarding the molecular and structural basis of this glycoprotein quality control system, which is regulated through dynamic interplay among intracellular lectins, glycosidases, and glycosyltransferase. Structural snapshots of carbohydrate-lectin interactions have been provided at the atomic level using X-ray crystallographic analyses. Conformational ensembles of uncomplexed triantennary high-mannose-type oligosaccharides have been characterized in a quantitative manner using molecular dynamics simulation in conjunction with nuclear magnetic resonance spectroscopy. These complementary views provide new insights into glycoprotein recognition in quality control coupled with N-glycan processing.