Critical comparison of background correction algorithms used in chromatography

Abstract

The objective of the present work was to make a quantitative and critical comparison of a number of drift and noise-removal algorithms, which were proven useful by other researchers, but which had never been compared on an equal basis. To make a rigorous and fair comparison, a data generation tool is developed in this work, which utilizes a library of experimental backgrounds, as well as peak shapes obtained from curve fitting on experimental data. Several different distribution functions are used, such as the log-normal, bi-Gaussian, exponentially convoluted Gaussian, exponentially modified Gaussian and modified Pearson VII distributions. The tool was used to create a set of hybrid (part experimental, part simulated) data, in which the background and all peak profiles and areas are known. This large data set (500 chromatograms) was analysed using seven different drift-correction and five different noise-removal algorithms (35 combinations). Root-mean square errors and absolute errors in peak area were determined and it was shown that in most cases the combination of sparsity-assisted signal smoothing and asymmetrically reweighted penalized least-squares resulted in the smallest errors for relatively low-noise signals. However, for noisier signals the combination of sparsity-assisted signal smoothing and a local minimum value approach to background correction resulted in lower absolute errors in peak area. The performance of correction algorithms was studied as a function of the density and coverage of peaks in the chromatogram, shape of the background signal, and noise levels. The developed data-generation tool is published along with this article, so as to allow similar studies with other simulated data sets and possibly other algorithms. The rigorous assessment of correction algorithms in this work may facilitate further automation of data-analysis workflows.

Keywords: Background correction; Chemometrics; Data processing; Noise filtering; Pre-processing; Smoothing.