Silicon-based materials, namely zeolites, clays, and silica gel have been widely used in organic synthesis, allowing mild reaction conditions and environmentally friendly methodologies. These heterogeneous catalysts are easy to handle, possess nontoxic and noncorrosive character and offer the possibility of recovery and reuse, thus contributing to clean and sustainable organic transformations. Moreover, they present shape-selective properties and provide stereo- and regiocontrol in chemical reactions. Herein, we survey the most significant applications of silicon-based materials as catalysts in carbohydrate chemistry, to mediate important transformations such as glycosylation, sugar protection and deprotection, and hydrolysis and dehydration. Emphasis is placed on their promising synthetic potential in comparison with conventional catalysts.