This paper reports on a multiclass arousal recognition system based on autonomic nervous system linear and nonlinear dynamics during affective visual elicitation. We propose a new hybrid method based on Lagged Poincaré Plot (LPP) and symbolic analysis, hereinafter called LPPsymb. This tool uses symbolic analysis to evaluate the irregularity of the trends of Lagged Poincaré Plot (LPP) quantifiers over the lags, and is here applied to investigate complex Heart Rate Variability (HRV) changes during emotion stimuli. In the experimental protocol 22 healthy subjects were elicited through a passive visualization of affective images gathered from the international affective picture system. LPPsymb and standard HRV analysis (defined in time and frequency domains) were applied to HRV series of one minute length. Then, an ad-hoc pattern recognition algorithm based on quadratic discriminant classifier was implemented and validated through a leave-onesubject-out procedure. The best performance of the proposed classification algorithm for recognizing the four classes of arousal was obtained using nine features comprising heartbeat complex dynamics, achieving an accuracy of 71.59%.