Auditory evoked potential (AEP) recordings often require subjects to ignore the stimuli and stay awake. In the present experiment, early (ABR), middle (MLR), and late latency (LLR) AEPs were recorded to compare the effect of five different distracting tasks: (1) doing nothing eyes open, (2) reading, (3) watching a movie, (4) solving a three-digit sum, and (5) doing nothing eyes closed (or counting the stimuli for LLR). Results showed that neither the amplitudes nor the latencies of the ABR, MLR, or LLR were affected by task. However, the amount of pre-stimulus activity (noise) or amplitude rejection was significantly and differently affected by the distracting task. For the ABR, the math task was the noisiest but, for the MLR, the amount of noise was greater when watching a movie. As for the LLR, reading and watching a movie yielded the lowest percentage of rejected traces. In conclusion, the choice of distracting task depends on the AEP being measured and should be chosen to improve the quality of the AEP traces and thus reduce recording time.