High-entropy oxides (HEOs) are a special class of materials that utilize the concept of high-entropy alloys (HEAs) with five or more elements randomly distributing at a single sublattice in near-equiatomic proportions. HEOs have been attracting increasing attention owing to their many outstanding physical and chemical properties. However, unlike HEAs, for which local chemical compositions, order/disorder behaviors, and property-structure relationships have been comprehensively investigated, detailed information on the atomic-scale chemical and structural features and their correlations with functionalities in HEOs so far is still not sufficient. Herein, we select four typical HEOs with pyrochlore, spinel, perovskite and rock-salt type structures, and directly observe and quantify sub-Ångstrom-scale structure variations in different manners by means of advanced aberration-corrected scanning transmission electron microscopy techniques. Visualization and quantification of local structural variations and lattice distortions in the current work may show a valuable example for future investigations on local fluctuating structures and their relationships with properties in more systems of HEOs.