The QRS complex is the most prominent feature of the electrocardiogram (ECG) that is used as a marker to identify the cardiac cycles. Identification of QRS complex locations enables arrhythmia detection and heart rate variability estimation. Therefore, accurate and consistent localization of the QRS complex is an important component of automated ECG analysis which is necessary for the early detection of cardiovascular diseases. This study evaluates the performance of six popular publicly available QRS complex detection methods on a large dataset of over half a million ECGs in a diverse population of patients. We found that a deep-learning method that won first place in the 2019 Chinese physiological challenge (CPSC-1) outperforms the remaining five QRS complex detection methods with an F1 score of 98.8% and an absolute sdRR error of 5.5 ms. We also examined the stratified performance of the studied methods on various cardiac conditions. All six methods had a lower performance in the detection of QRS complexes in ECG signals of patients with pacemakers, complete atrioventricular block, or indeterminate cardiac axis. We also concluded that, in the presence of different cardiac conditions, CPSC-1 is more robust than Pan-Tompkins which is the most popular model for QRS complex detection. We expect that this study can potentially serve as a guide for researchers on the appropriate QRS detection method for their target applications.Clinical Relevance-This study highlights the overall performance of publicly available QRS detection algorithms in a large dataset of diverse patients. We showed that there are specific cardiac conditions that are associated with the poor performance of QRS detection algorithms and may adversely influence the performance of algorithms that rely on accurate and reliable QRS detection.