Cardiac magnetic resonance imaging (MRI) has advanced to become a powerful diagnostic tool in clinical practice. Robust and fast cardiac modeling is important for structural and functional analysis of the heart. Cardiac anchors provide strong cues to extract morphological and functional features for diagnosis and disease monitoring. We present a fully automatic method and system that is able to detect these cues. The proposed approach explores expert knowledge embedded in a large annotated database. Exemplar cues in our experiments include left ventricle (LV) base plane and LV apex from long-axis images, and right ventricle (RV) insertion points from short-axis images. We evaluate the proposed approach on 8304 long-axis images from 188 patients and 891 short-axis images from 338 patients that are acquired from different vendors. In addition, another evaluation is conducted on an independent 7140 images from 87 patient studies. Experimental results show promise of the proposed approach.