We propose a generalized energy model of complex cells to describe modulatory contextual influences on the responses of neurons in the primary visual cortex (V1). Many orientation-selective cells in V1 respond to contrast of orientation and motion of stimuli exciting the classical receptive field (CRF) and the non-CRF, or surround. In the proposed model, a central spatiotemporal filter, defining the CRF, is nonlinearly combined with a spatiotemporal filter extending into the non-CRF. These filters are assumed to describe simple-cell responses, while the nonlinear combination of their responses describes the responses of complex cells. This mathematical operation accounts for the inherent nonlinearity of complex cells, such as phase independence and frequency doubling, and for nonlinear interactions between stimuli in the CRF and surround of the cell, including sensitivity to feature contrast. If only the CRF of the generalized complex cell is stimulated by a drifting grating, the model reduces to the standard energy model. The theoretical predictions of the model are supported by computer simulations and compared with experimental data from V1.