Female somatic X-chromosome inactivation (XCI) balances the X-linked transcriptional dosages between the sexes. Skewed XCI toward one parental X has been observed in several complex human traits, but the extent to which genetics and environment influence skewed XCI is largely unexplored. To address this, we quantify XCI-skew in multiple tissues and immune cell types in a twin cohort. Within an individual, XCI-skew differs between blood, fat and skin tissue, but is shared across immune cell types. XCI skew increases with age in blood, but not other tissues, and is associated with smoking. XCI-skew is increased in twins with Rheumatoid Arthritis compared to unaffected identical co-twins. XCI-skew is heritable in blood of females >55 years old (h2 = 0.34), but not in younger individuals or other tissues. This results in a Gene x Age interaction that shifts the functional dosage of all X-linked heterozygous loci in a tissue-restricted manner.