Legionella pneumophila, found in engineered water systems such as HVAC cooling towers, poses a significant public health risk. Culture, though routinely used to quantify L. pneumophila, has several disadvantages including long turnaround time, low sensitivity, and inter-laboratory variability. In this study, we validated the performance of an on-site quantitative polymerase chain reaction (qPCR) detection system for L. pneumophila in accordance with International Standards Organization Technical Specification 12869:2012. We evaluated specificity, limit of detection and quantification, and calibration curve linearity. Additionally, we evaluated whole system recovery and robustness using samples taken from taps and evaporative cooling towers. We then compared the system's performance against laboratory culture and laboratory qPCR across 53 cooling towers in a 12-week in-field study. We found that concordance between on-site qPCR and culture was both laboratory- and site/sample-dependent. Comparison of laboratory qPCR with on-site qPCR revealed that laboratory results were highly variable and showed little concordance. Some discordance may be explained by time delay between sample collection and testing ('shipping effect') which may lead to inaccurate reporting. Overall, our study highlights the value of on-site qPCR detection of L. pneumophila, demonstrates that laboratories are prone to misreporting results due to shipping effects, and reveals significant discordance between laboratory qPCR and culture.