Milk oligosaccharides are associated with improved health outcomes in infants. Nanofiltration (NF) is used for isolation of bovine milk oligosaccharides (BMO). The study aim was to improve the recovery of BMO from lactose-hydrolyzed colostrum whey permeate. The retention factors of carbohydrates at various pH and transmembrane pressures were determined for a nanofiltration membrane, which was used at pilot scale to purify BMO. Carbohydrates were quantified by liquid chromatography and characterized using nano-LC-Chip-QToF mass spectrometry. BMO purity was improved from an initial 4% in colostrum whey permeate to 98%, with 99.8% permeation of monosaccharides and 96% recovery of oligosaccharides, represented by 23 unique BMO compounds identified in the final retentate. The pH during NF was a determining factor in the selectivity of carbohydrate separation. This NF method can be applied to conventional cheese-whey permeate and other milk types for extraction of bioactive oligosaccharides providing new options for the dairy industry.