Marine oligosaccharides have attracted increasing attention recently in developing potential drugs and biomaterials for their particular physical and chemical properties. However, the composition and sequence analysis of marine oligosaccharides are very challenging for their structural complexity and heterogeneity. Mass spectrometry (MS) has become an important technique for carbohydrate analysis by providing more detailed structural information, including molecular mass, sugar constituent, sequence, inter-residue linkage position and substitution pattern. This paper provides an overview of the structural analysis based on MS approaches in marine oligosaccharides, which are derived from some biologically important marine polysaccharides, including agaran, carrageenan, alginate, sulfated fucan, chitosan, glycosaminoglycan (GAG) and GAG-like polysaccharides. Applications of electrospray ionization mass spectrometry (ESI-MS) are mainly presented and the general applications of matrix-assisted laser desorption/ionization mass spectrometry (MALDI-MS) are also outlined. Some technical challenges in the structural analysis of marine oligosaccharides by MS have also been pointed out.