The tumor microenvironment (TME) is of great clinical significance for predicting the therapeutic effect of tumors. Nonetheless, there was no systematic analysis of cellular interactions in the TME of head and neck cancer (HNSC). This study used gene expression data from 816 patients with HNSC to analyze the scores of 22 immune cells. On this basis, we have established a novel TMEscore-based prognostic risk model. The relationship between TMEscore and clinical and genomic characteristics was analyzed. The sample was divided into risk-H and risk-L groups based on the prognosis risk model of TMEscore, with significant differences in overall survival between the two groups (log rank p < 0.001). In terms of clinical features, the TMEscore is closely related to the T staging, Grade, and HPV. As for genomic characteristics, the genomic features of the Risk-H samples are a low expression of immune-related genes and high-frequency mutations of TP53 and CEP152. This model was validated in an external test set, in which the prognosis for Risk-H group and Risk-L group was also significantly different (log rank p = 0.017). A quantitative method of TME infiltration pattern is established, which may be a potential predictor of HNSC prognosis.