False alarms in cardiac monitoring affect the quality of medical care, impacting on both patients and healthcare providers. In continuous cardiac monitoring using wireless Body Sensor Networks (BSNs), the quality of ECG signals can be deteriorated owing to several factors, e.g., noises, low battery power, and network transmission problems, often resulting in high false alarm rates. In addition, body movements occurring from activities of daily living (ADLs) can also create false alarms. This paper presents a two-phase framework for false arrhythmia alarm reduction in continuous cardiac monitoring, using signals from an ECG sensor and a 3D accelerometer. In the first phase, classification models constructed using machine learning algorithms are used for labeling input signals. ECG signals are labeled with heartbeat types and signal quality levels, while 3D acceleration signals are labeled with ADL types. In the second phase, a rule-based expert system is used for combining classification results in order to determine whether arrhythmia alarms should be accepted or suppressed. The proposed framework was validated on datasets acquired using BSNs and the MIT-BIH arrhythmia database. For the BSN dataset, acceleration and ECG signals were collected from 10 young and 10 elderly subjects while they were performing ADLs. The framework reduced the false alarm rate from 9.58% to 1.43% in our experimental study, showing that it can potentially assist physicians in diagnosing a vast amount of data acquired from wireless sensors and enhance the performance of continuous cardiac monitoring.