The purpose of this study was to investigate health-related quality of life (HRQOL) and associated factors in patients with chronic neck pain (CNP). The HRQOL of patients with CNP was assessed by the Short Form-36 questionnaire in this cross-sectional study. To evaluate the psychological factors related to HRQOL, the Eysenck Personality Questionnaire, Chinese Health Questionnaire, and Beck Anxiety Inventory were used. The scores for the eight subscales of Short Form-36 were all lower than the Taiwanese age-matched normative values (p < 0.001). The two most strongly affected subscales were the role-physical subscale and the bodily pain subscale; both scores were below half the score of the age-/sex-matched normative values. The physical components summary score, a summary measure, was moderately correlated with age (rho = -0.43), education level (rho = 0.37) and Beck Anxiety Inventory score (rho = -0.36). The mental components summary score was moderately to highly correlated with the Chinese Health Questionnaire score (rho = -0.72), the neuroticism domain of Eysenck Personality Questionnaire (rho = -0.52) and Beck Anxiety Inventory score (rho = -0.41). The HRQOL of patients with CNP was worse than that of normal subjects across all domains. Furthermore, patients with a neurotic personality, minor psychiatric morbidity and higher anxiety status showed poor mental health, as measured by the Short Form-36. We found that patients with CNP had multiple physical and mental health problems in terms of. The mental health of patients with CNP was strongly associated with various psychological factors. Comprehensive assessment of the physical and mental functioning of patients with CNP can improve the management and care of these patients.