Automatic signal analysis using artificial intelligence is getting popular in digital healthcare, such as ECG rhythm analysis, where ECG signals are collected from traditional ECG machines or wearable ECG sensors. However, the risk of using an automated system for ECG analysis when noise is present can lead to incorrect diagnosis or treatment decisions. A noise detector is crucial to minimise the risk of incorrect diagnosis. Machine learning (ML) models are used in ECG noise detection before clinical decision-making systems to mitigate false alarms. However, it is essential to prove the generalisation capability of the ML model in different situations. ML models performance is 50% lesser when the model is trained with synthetic and tested with physiologic ECG datasets compared to trained and tested with physiologic ECG datasets. This suggests that the ML model must be trained with physiologic ECG datasets rather than synthetic ones or add more various types of noise in synthetic ECG datasets that can mimic physiologic ECG.Clinical relevance- ML model trained with synthetic noisy ECG can increase the 50% misclassification rate in ECG noise detection compared to training with physiologic ECG datasets. The wrong classification of noise-free and noisy ECG will lead to misdiagnosis regarding the patient's condition, which could be a cause of death.