Tutorial review of error evaluation in experimental water research at the example of membrane filtration

Abstract

Experimental water research lacks clear methodology to estimate experimental error. Especially when natural waters are involved, the characterization tools bear method-specific artifacts while the varying environmental conditions prevent regular repeats. This tutorial review identifies common mistakes, and proposes a practical procedure to determine experimental errors at the example of membrane filtration. Statistical analysis is often applied to an insufficient number of repeated measurements, while not all error sources and contributions are considered. This results in an underestimation of the experimental error. Variations in relevant experimental parameters need to be investigated systematically, and the related errors are quantified as a half of the variation between the max and min values when standard deviation is not applicable. Error of calculated parameters (e.g. flux, pollutant removal and mass loss) is estimated by applying error propagation, where weighing contributions of the experimental parameters are considered. Appropriate judgment and five-time repetition of a selected experiment under identical conditions are proposed to validate the propagated experimental error. For validation, the five repeated data points should lie within the estimated error range of the error bar. The proposed error evaluation procedure is adaptable in experimental water research and intended for researchers to identify the contributing factors of an experimental error and carry out appropriate error quantification and validation. The most important aim is to raise awareness of the necessity to question error methodology and reproducibility of experimental data, to produce and publish high quality research.

Keywords: Analytical error; Calibration & validation; Error propagation; Reproducibility & repeatability; Standard deviation.