Validating the Reliability and Clinical Relevance of an Infraorbital Hollow Photonumeric Scale

Aesthet Surg J Open Forum. 2023 Aug 9:5:ojad052. doi: 10.1093/asjof/ojad052. eCollection 2023.

Abstract

Background: Infraorbital hollowing is a facial aesthetic issue for which a broad age range of patients seek treatment. Expanding treatment options for this region warrants the development of validated tools to objectively assess infraorbital hollow (IOH) severity before and after treatment.

Objectives: To validate a 4-point rating scale to assess depression of IOH, depression relative to the mid-pupillary line, and visibility of the lateral orbital rim.

Methods: The IOH scale described herein was developed and subjected to live validation with a total of 73 patients representing the full range of IOH severities. Scale validation was performed by board-certified plastic surgeons and dermatologists (3 raters) over 2 rounds, 2 weeks apart. Intrarater and interrater reliabilities were used to demonstrate test-retest reliability as quantitated with percentage of agreement, weighted kappa statistic with 95% confidence interval (CI), and intraclass correlation coefficient with 95% CI. The clinical relevance of a 1-grade difference was evaluated by comparing rater assessments of 77 photo pairs with their previously determined designation as "clinically different" or "not clinically different."

Results: The IOH scale demonstrated substantial to near-perfect intrarater and interrater reliabilities when utilized by trained raters to assess a diverse group of live patients. Furthermore, clinically relevant differences between grades were established, and detection of a 1-point difference could be achieved by trained evaluators using the IOH scale.

Conclusions: This highly reliable, clinically relevant, and validated IOH scale provides a user-friendly, standardized grading system to objectively evaluate and track changes in infraorbital hollowing in clinical practice and research.