The accurate acquisition of multiview fetal cardiac ultrasound images is very important for the diagnosis of fetal congenital heart disease (FCHD). However, these manual clinical procedures have drawbacks, e.g., varying technical capabilities and inefficiency. Therefore, exploring automatic recognition method for multiview images of fetal heart ultrasound scans is highly desirable to improve prenatal diagnosis efficiency and accuracy. In this work, we propose an improved multi-head self-attention mechanism called IMSA combined with residual networks to stably solve the problem of multiview identification and anatomical structure localization. In details, IMSA can capture short- and long-range dependencies from different subspaces and merge them to extract more precise features, thus making use of the correlation between fetal heart structures to make view recognition more focused on anatomical structures rather than disturbing regions, such as artifacts and speckle noises. We validate our proposed method on fetal cardiac ultrasound imaging datasets from a single center and 38 multicenter studies and the results outperform other state-of-the-art networks by 3%-15% of F1 scores in fetal heart six standard view recognition.Clinical Relevance- This technology has great potential in assisting cardiologists to complete the automatic acquisition of multi-section fetal echocardiography images.