Carbon nanomaterials have enormous applications in various fields, such as adsorption, membrane separation, catalysis, electronics, capacitors, batteries, and medical sciences. Owing to their exceptional properties, such as large specific surface area, carrier mobility, flexibility, electrical conductivity, and optical pellucidity, the family of carbon nanomaterials is considered as one of the most studied group of materials to date. They are abundantly used in membrane science for multiple applications, such as the separation of organics, enantiomeric separation, gas separation, biomolecule separation, heavy metal separation, and wastewater treatment. This study provides an overview of the significant studies on carbon nanomaterial-based membranes and their emerging applications in our membrane research journey. The types of carbon nanomaterials, their utilization in membrane-based separations, and the mechanism involved are summarized in this study. Techniques for the fabrication of different nanocomposite membranes are also highlighted. Lastly, we have provided an overview of the existing issues and future scopes of carbon nanomaterial-based membranes for technological perspectives.