We have developed and describe here for the first time a highly sensitive method for the fast and unambiguous detection of viable Escherichia coli in food matrices. The new approach is based on using label-free phages (T4), obligate parasites of bacteria, which are attractive for pathogen detection because of their inherent natural specificity and ease of use. A specific immunomagnetic separation was used to capture the progeny phages produced. Subsequently, T4 phage markers were detected by liquid chromatography coupled to targeted mass spectrometry. Combining the specificity of these three methodologies is of great interest in developing an alternative to conventional time-consuming culture-based technologies for the detection of viable bacteria for industrial applications. First, optimization experiments with phage T4 spiked in complex matrices (without a phage amplification event) were performed and demonstrated specific, sensitive, and reproducible phage capture and detection in complex matrices including Luria-Bertani broth, orange juice, and skimmed milk. The method developed was then applied to the detection of E. coli spiked in foodstuffs (with a phage amplification event). After having evaluated the impact of infection duration on assay sensitivity, we showed that our assay specifically detects viable E. coli in milk at an initial count of ≥1 colony-forming unit (cfu)/mL after an 8-h infection. This excellent detection limit makes our new approach an alternative to PCR-based assays for rapid bacterial detection.