Combining experts: decomposition and aggregation order

Risk Anal. 2013 Jun;33(6):1116-27. doi: 10.1111/j.1539-6924.2012.01937.x. Epub 2012 Dec 12.

Abstract

In this article we ask, if quantities in an elicitation have been decomposed, is it better to combine experts before or after recomposing the quantities? We find that combining experts earlier, before recomposition of the quantities, leads to smaller errors with less variance. A simulation shows that these differences may be quite small on average; while an application to actual data shows that the differences can be significant in individual decision problems.