A new compact stilbene crystal neutron spectrometer has been investigated and applied in the neutron emission spectroscopy on the EAST tokamak. A new components analysis method is presented to study the anisotropic light output in the stilbene crystal detector. A Geant4 code was developed to simulate the neutron responses in the spectrometer. Based on both the optimal light output function and the fitted pulse height resolution function, a reliable neutron response matrix was obtained by Geant4 simulations and validated by 2.5 MeV and 14 MeV neutron measurements at a 4.5 MV Van de Graaff accelerator. The spectrometer was used to diagnose the ion temperature in plasma discharges with lower hybrid wave injection and ion cyclotron resonance heating on the EAST tokamak.