An important quality of upper limb force estimation is the repeatability and worst-case performance of the estimator. The following paper proposes a methodology using an ensemble learning technique coupled with the fast orthogonal search (FOS) algorithm to reliably predict varying isometric contractions of the right arm. This method leverages the rapid and precise modelling offered by FOS combined with a univariate outlier detection algorithm to dynamically combine the output of numerous FOS models. This is performed using high-density surface electromyography (HD-SEMG) obtained from three upper-arm muscles, the biceps brachii, triceps brachii and brachioradialis. This method offers improved performance over other HD-SEMG and SEMG based force estimators, with a substantial reduction in the number of channels required.