There is substantial interest in developing prediction models capable of identifying rare disease patients in population-scale databases such as electronic health records (EHRs). Deriving these models is challenging for many reasons, perhaps the most important being the limited number of patients with 'gold standard' confirmed diagnoses from which to learn. This paper presents a new cascade learning methodology which induces accurate prediction models from noisy 'silver standard' labeled data-patients provisionally labeled as positive for the target disease based on unconfirmed evidence. The algorithm combines unsupervised feature selection, supervised ensemble learning, and unsupervised ensemble clustering to enable robust learning from noisy labels. The efficacy of the approach is illustrated through a case study involving the detection of Iipodystrophy patients in a country-scale database of EHRs. The case study demonstrates our algorithm outperforms state-ofthe-art prediction techniques and can discover previously undiagnosed patients in large EHR databases.