Self-assessments are commonly used to track Army readiness in specialized communities, but they are rarely analyzed for reliability and predictive validity. Before introducing new assessments, existing ones should be reevaluated. We examined the Global Assessment Tool (GAT), an annual Army-required self-assessment with multiple psychosocial and health behavior short scales. Psychometric analyses on nine scales included item response theory (IRT) and measurement invariance models across total Army (n = 743,057) and special operations forces (SOF; n = 3,478) cohorts. Predictive analyses examined demographic-adjusted associations between GAT scales and one-year incident medical non-readiness (MNR). Most scales had adequate reliability, although some exhibited highly skewed distributions, which likely increased measurement error. Most scales exhibited metric and scalar measurement equivalence across total Army and SOF groups. Scores from scales measuring positive characteristics were associated with lower odds of MNR (good coping, flexibility, optimism, positive affect, work engagement, friendship, organization trust; adjusted odds ratios ≤ 0.75); scores from scales measuring negative characteristics were associated with increased odds of MNR (poor sleep, depression, negative affect, loneliness; adjusted odds ratios ≥ 1.4). Associations were similar across Army and SOF cohorts. In conclusion, self-report data can potentially contribute to command surveillance, but iterative quality-checks are necessary after deployment.
Keywords: Readiness; army; item response theory; measurement equivalence; surveillance.