Identification of MISO Hammerstein system using sparse multiple kernel-based hierarchical mixture prior and variational Bayesian inference

Abstract

The Hammerstein model is a cascade composition of a static memoryless nonlinear function followed by a linear time-invariant dynamical subsystem, which is capable of modeling a wide range of nonlinear dynamical systems. Model structural parameter selection (including the model order and the nonlinearity order) and sparse representation of the static nonlinear function are two issues that receive increasing interests in Hammerstein system identification. In this paper, a novel Bayesian sparse multiple kernel-based identification method (BSMKM) for multiple-input single-output (MISO) Hammerstein system is proposed to handle those issues, where the basis-function model and the finite impulse response model are used to represent the nonlinear part and the linear part respectively. Firstly, in order to jointly realize the model parameter estimation, the sparse representation of static nonlinear function (the nonlinearity order selection can also be realized indirectly) and the model order selection of linear dynamical system, a hierarchical prior distribution is constructed based on Gaussian scale mixture model and sparse multiple kernel, which can characterize both inter-group sparsity and intra-group correlation structure. Then, a full Bayesian method based on variational Bayesian inference is proposed to estimate all unknown model parameters, including finite impulse response coefficients, hyperparameters and noise variance. Finally, the performance of the proposed BSMKM identification method is evaluated by numerical experiments using both simulation and real data.

Keywords: Hammerstein model; Hierarchical Bayesian modeling; Parameter identification; Sparse multiple kernel; Variational Bayesian inference.