Perception is a product of the interaction between bottom-up sensory processing and top-down higher order cognitive activity. For example, when the initial phoneme of a word is obliterated and replaced with noise, listeners hear it as intact provided there is semantic context. We modified this phonemic restoration paradigm by masking (not obliterating) the initial phoneme of a target word and presenting it within a carrier phrase which was informative (I), uninformative (U), or misinformative (M). Bias in favor of top-down context was measured as the extent to which M trials mislead listeners into reporting a target word other than that which was presented (relative to U trials that have irrelevant top-down semantic context). Forty-one participants (20 men) completed 600 test trials (300 delayed report of the phrase, 300 forced choice). Relative to the U condition, women were more affected by both the I and M cues than men, at certain levels of audibility during the forced choice condition. Moreover, the semantic strength of the I carrier phrases was correlated with the rate of correct reports of the target words in women but not in men.This suggests that women can be more affected by top-down semantic context than men.