Industrial system monitoring includes fault diagnosis and anomaly detection, which have received extensive attention, since they can recognize the fault types and detect unknown anomalies. However, a separate fault diagnosis method or anomaly detection method cannot identify unknown faults and distinguish between different fault types simultaneously; thus, it is difficult to meet the increasing demand for safety and reliability of industrial systems. Besides, the actual system often operates in varying working conditions and is disturbed by the noise, which results in the intraclass variance of the raw data and degrades the performance of industrial system monitoring. To solve these problems, a metric learning-based fault diagnosis and anomaly detection method is proposed. Fault diagnosis and anomaly detection are adaptively fused in the proposed end-to-end model, where anomaly detection can prevent the model from misjudging the unknown anomaly as the known type, while fault diagnosis can identify the specific type of system fault. In addition, a novel multicenter loss is introduced to restrain the intraclass variance. Compared with manual feature extraction that can only extract suboptimal features, it can learn discriminant features automatically for both fault diagnosis and anomaly detection tasks. Experiments on three-phase flow (TPF) facility and Case Western Reserve University (CWRU) bearing have demonstrated that the proposed method can avoid the interference of intraclass variances and learn features that are effective for identifying tasks. Moreover, it achieves the best performance in both fault diagnosis and anomaly detection.