The preparation and applications of graphene (G)-based materials are attracting increasing interests due to their unique electronic, optical, magnetic, thermal, and mechanical properties. Compared to G-based hybrid and composite materials, G-based inorganic hybrid membrane (GIHM) offers enormous advantages ascribed to their facile synthesis, planar two-dimensional multilayer structure, high specific surface area, and mechanical stability, as well as their unique optical and mechanical properties. In this review, we report the recent advances in the technical fabrication and structure-specific applications of GIHMs with desirable thickness and compositions. In addition, the advantages and disadvantages of the methods utilized for creating GIHMs are discussed in detail. Finally, the potential applications and key challenges of GIHMs for future technical applications are mentioned.