This study investigated the effect of a spatial factor, the magnitude of interaural cross-correlation (IACC) function, on subjective responses to heavy-weight floor impact sounds. Heavy-weight impact sounds were generated by a heavy/soft impact source (impact ball) in real apartments, so that impact sound pressure levels (SPLs) (L(Amax)) and IACC could be analyzed. Just noticeable differences (JNDs) of impact SPL and IACC were investigated through the use of impact ball sounds. JNDs were determined by the criteria of 75% correct answers by participants, and it was found that JNDs of impact SPL and IACC were around 1.5 dB and 0.12-0.13, respectively. In addition, the annoyance caused by an impact ball was evaluated by changes in these two parameters. The results show that annoyance increased with increasing impact SPL and with decreasing IACC; the contributions of the two parameters to the scale value of annoyance were 79.3% and 20.4%, respectively. This indicates that the effects of IACC should be considered for the evaluation of annoyance, and the subjective response to impact ball sounds can be improved by controlling IACC, as well as impact SPL.