14 mothers of children who were deaf or hard of hearing provided magnitude estimation scaling responses for the speech intelligibility and speech annoyance of narrative speech samples produced by children who were deaf or hard of hearing. Analysis indicated that listeners scaled intelligibility and annoyance the same. As samples became more difficult to understand, they also became more annoying to these listeners. Implications for further research are discussed.