Current commercial polymer membranes have shown high performance and durability in water treatment, converting poor quality waters to higher quality suitable for drinking, agriculture and recycling. However, to extend the treatment into more challenging water sources containing abrasive particles, micro and ultrafiltration membranes with enhanced physical durability are highly desirable. This review summarises the current limits of the existing polymeric membranes to treat harsh water sources, followed by the development of nanocomposite poly(vinylidene fluoride) (PVDF) membranes for improved physical durability. Various types of nanofillers including nanoparticles, carbon nanotubes (CNT) and nanoclays were evaluated for their effect on flux, fouling resistance, mechanical strength and abrasion resistance on PVDF membranes. The mechanisms of abrasive wear and how the more durable materials provide resistance was also explored.