Grading of oral squamous cell carcinomas - Intra and interrater agreeability: Simpler is better?

J Oral Pathol Med. 2020 Aug;49(7):630-635. doi: 10.1111/jop.12990. Epub 2020 Jan 19.

Abstract

Background: Numerous studies have been presented on histological grading of oral squamous cell carcinomas (OSCC) for predicting survival, but uncertainty of their usefulness rises due to discordances of results. A scoring system should be robust and well validated, and intra- and interrater agreement can be used as a tool to visualize the strength of reproducibility.

Methods: Here, we present an intra- and inter-observer study on evaluation of OSCC using some of the most common histopathological parameters. The observers were from different Norwegian university hospitals, and calibration to ensure accuracy was first performed. Percentage of the agreement was calculated for the score made by the individual observer at different times, as well as between pairs of observers.

Results: The evaluation made by the same observer at two different time points (intrarater) correlated better than observations made by different participants (interrater). In an attempt to increase the rate of agreement, many of the parameters were either dichotomized into simply low- and high grade, or to a three-tier system when more than three options in the original design. This increased the concurrence with 15.4% for the intrarater and with 23% for the interrater comparisons.

Conclusion: High agreement for histopathological parameters can be difficult to obtain on hematoxylin and eosin staining in scoring systems with many options. A simpler system might be more advantageous to achieve higher degree of reproducibility.

Keywords: histopathological parameters; intrarater and interrater agreement; oral cancer; squamous cell carcinoma.

MeSH terms

  • Algorithms
  • Carcinoma, Squamous Cell* / diagnosis
  • Humans
  • Mouth Neoplasms* / diagnosis
  • Neoplasm Grading*
  • Observer Variation
  • Reproducibility of Results